Projects, Reports and Export
This chapter describes how the state of an analysis is saved and recovered, and how figures, processed data, reports and batches of files are exported.
Projects
A project file (.efaproj) keeps everything about one
event in one file, so that work can be resumed exactly where it was
left. Since version 3.2.0 it holds the work of every window; a project
may hold any of these parts on its own, without a radio spectrum:
- Radio analysis
-
the loaded or combined data with the list of source files and the combination method; the processing state (background subtraction, RFI cleaning, isolated burst); the view (display range, thresholds, units, axis scale, color map and graph properties); annotations, light curves and a loaded STEREO/SWAVES panel; the active processing preset, the operation log and the last time-window synchronization; and the analysis session (maximum-intensity points, the fundamental/harmonic choice, the Analyzer’s fit, density model, fold and , and band-splitting points and fits).
- Solar Image Analysis
-
the frames, the data source, display, crop and playback settings, the CME measurements and the PFSS settings (Chapter 17).
- GCS CME Fitting
-
the channels, display settings, front points and recorded fits of both models (Chapter 21).
- Event context
-
the geomagnetic response, the Event Context Strip with its source choices, and the Event Figure settings (Chapter 15).
Projects are managed from the File menu of the main window:
- Save Project
-
(
Ctrl+S, or the toolbar tool) saves to the current project file, asking for a name the first time.Ctrl+Sin the Solar Image Analysis or GCS window saves the same project. - Save Project As...
-
(
Ctrl+Shift+S) saves to a new file. When the project holds solar or GCS images, you choose how to keep them (Section 10.1.1). - Open Project...
-
(
Ctrl+Shift+O) opens a project and every window it needs: Solar Image Analysis and the GCS window open and are restored. A project file can also be dropped onto the main window. - Recent Projects
-
lists the last ten projects opened or saved; Clear Recent Projects empties the list, and an entry whose file is missing is removed with a message.
Before a project is opened, new data are loaded, or the application is reset or closed, you are asked whether to save unsaved changes. Changes in any of the three windows count.
Linking or embedding images
When a project holds solar or GCS images, Save Project As... asks how the project should keep them (Figure 10.1):
- Link data (small)
-
the project refers to the image files on this computer and stays a few hundred kilobytes. If the files are later moved, or the download cache is cleared, they are fetched again from the archive when the project is opened.
- Embed data (portable)
-
the images are stored inside the project; the button shows the expected size. The project opens anywhere, even offline.
The radio arrays are always stored in the project. The choice is kept
in the file, so Ctrl+S does not ask again.
Reopening projects
A part of a project that cannot be read is skipped and named in a message, while the rest opens.
Solar Image Analysis measurements are matched to the reloaded frames by observation time.
An overlay composite that was built when the project was saved, such as the AIA Sun in the LASCO occulter, is built again once the frames are in.
The geomagnetic response, the catalogs and the Event Figure settings are restored without fetching anything.
Compatibility
Projects saved by version 3.2.0 cannot be opened by version 3.1.
Version 3.1 radio projects open unchanged. A version 3.1
.ecsolar Solar Image Analysis session can be opened with
Open Project...: it is imported as a new, unsaved
project. .ecsolar files are no longer written.
Restored analysis sessions
When a project with an analysis session is opened, the Analysis Summary panel reports that the session has been restored. Processing > Analysis Session > Open Restored Analysis reopens the windows that were open when the project was saved — the Maximum Intensities window, the Burst Analyzer and the Type II Band-splitting window — with their points, fits and settings.
Autosave and recovery
While a project has content and unsaved changes, the application writes a recovery snapshot every three minutes. Snapshots always link solar and GCS images rather than embed them, so they stay small and fast. The ten most recent snapshots are kept. If the application did not close normally, it offers to recover the latest snapshot at the next start. File > Recover Last Session... restores the most recent snapshot at any time.
Exporting figures
File > Export As > Export Figure
(Ctrl+E, or the Export toolbar tool) saves
the main plot as a PNG, PDF, EPS, SVG, TIFF or JPG file. Whatever
renderer and theme are on screen, the exported figure is drawn as a
publication-style (“OriginPro-style”) graph in light mode:
Arial type, a closed black frame with inward major and minor ticks on all four sides, a framed color scale, and time ticks on whole UT minutes;
the current zoom, color map, display range, linear or logarithmic frequency axis, and the titles and font sizes from Graph Properties;
every visible overlay: light curves, annotations, the GOES X-ray overlay, the ruler measurement, the STEREO/SWAVES panel and the Event Context Strip.
The plot on screen keeps its own look. On Windows, if the proposed
folder is not writable (for example inside C:
Program Files), you are asked to choose another folder.
The Maximum Intensities window, the Burst Analyzer, the band-splitting window, the Multi-Station Comparison and the Solar Image Analysis tracking panel export their graphs in the same style.
Exporting FITS files
File > Export As > Export to FIT
(Ctrl+F, or the Export as FITS toolbar
tool) writes the spectrum on show as a new FITS file, for downstream
analysis or machine learning. The processed data are exported if
processing has been applied, and the raw data otherwise; combined
datasets are exported as one file.
Before saving, choose the data type (BITPIX):
Auto (the recommended type is shown), 8
(unsigned byte), 16 (signed int16) or
32 (signed int32). Integer types are offered because
some FITS viewers cannot read 64-bit floating-point data. The exported
file keeps the original header, updated with:
HISTORYrecords naming the application, the plot type, the intensity units and the source file(s);COMBINED,COMBMETH(combination method) andNFILESfor combined data;BUNIT,DATAMINandDATAMAX;
and an AXIS binary-table extension with the
FREQUENCY and TIME columns, as in standard
CALLISTO files (see Appendix B).
Provenance reports and analysis logs
For reproducibility, two structured reports can be exported from File > Export As:
- Export Provenance Report...
-
writes a Markdown (
.md) and a JSON (.json) summary with the sections App, Data Source, Processing, RFI, Annotations, Time Sync and Operation Log. - Export Analysis Log...
-
writes
<name>_analysis_log.csvand<name>_analysis_log.txtwith the Analyzer’s fit parameters and the derived shock quantities.
These reports are suitable for laboratory notebooks, collaboration hand-overs and the preparation of papers.
Project report PDF
File > Generate Project Report... creates a consolidated PDF of the current project. A progress dialog is shown while the report is built. Catalogs and the geomagnetic response that are not yet loaded are fetched first, even when Solar Events > Fetch Event Context Automatically is off; they are then kept, so the sidebar card and the event strip show them and the project saves them. A project without a radio spectrum has a report too: the radio sections are left out.
Event Story
The report opens with an Event Story that tells what happened, in order, from the Sun to the Earth (Figure 10.2):
a headline and a one-line chain, for example flare radio burst CME shock at Earth storm;
the event chain graphic: Sun, corona, heliosphere and Earth lanes on a compressed time axis (minutes near the eruption, days at Earth), with the time between the key steps;
Key Numbers;
What Happened, four short chapters: at the Sun, in the corona, through the heliosphere and at Earth;
a Timeline of every milestone; bold rows are the steps joined on the event chain;
the event overview and Geomagnetic Response figures;
Sources and Caveats.
The pieces are drawn from the loaded radio data, the event catalogs (GOES flares, CDAW and DONKI CMEs, DONKI shock arrivals and storms, the e-CALLISTO burst list), a GCS reconstruction and the geomagnetic response. They are associated by timing and by DONKI’s own links, and the story says when they do not fit: a storm that peaked before this event’s shock arrived is attributed to earlier eruptions. Without radio data the story starts from the Solar Image Analysis frames or the GCS event.
Caution
The Event Story associates events by timing and by DONKI’s links. Check the associations before citing them.
Report sections
After the Event Story the report contains the sections listed below; sections without content are omitted.
Data Source and Selected FITS Header;
Processing, and RFI, Annotations, and Light Curves;
Analysis Summary and Type II Results, including the fit equation (with when it is not the file start), the density model, and band-splitting output;
Figures: the raw and background-subtracted spectra (with the Event Context Strip when it is shown), light curves with the spectrum, the maximum-intensity fit, the Type II band-splitting plots, the STEREO/SWAVES split view, and any available GOES X-ray, GOES proton, Dst and Kp context plots;
Solar Image Analysis, when that window holds frames: the current frame as on screen, the instrument, product, frames and processing, the overlay layers, and the CME measurements with their kinematics;
GCS CME Fitting, when the GCS window holds work: the viewpoints and a table of the recorded fits (the GCS window’s own report draws every fit on its images, Section 22.8);
Full FITS Header Appendix.
Every graph in the report is drawn in the same style as Export Figure, on a white page even in the dark theme.
Event Figure
File > Export As > Event Figure… composes one publication figure of the whole event from the spectrum, other instruments, catalogs, image thumbnails and the geomagnetic response. It is described in Section 15.4.
Batch processing
Processing > Batch Processing > Open Batch Processor opens the Batch FIT Processing dialog (Figure 10.3), which renders every FIT file in a folder as a PNG image with consistent settings.
- Input Folder, Output Folder
-
the folder of FIT files to process and the folder for the PNG images (one per input file, at 300 dpi; existing names are not overwritten).
- Output Type
-
Raw or Background Subtracted.
- Processing Options
-
the Background Method (Mean, Median or Plotutil Median (dB)) and the Colormap. Plotutil Median (dB) converts digits to dB with the CALLISTO scale before subtracting the median, and defaults to a display range of to 8 dB.
- Aligned View
-
Use current display range and Use current visual settings apply the main window’s display range and appearance; Load View Config... applies a saved
.efaview.jsonfile instead. These options give many station spectra identical time and frequency axes. - Start, Cancel, Close
-
start the run, cancel it after the current file, or close the dialog. A summary is shown when the run finishes, including any files that failed.