Overview
Exports time series data to file in CSV format with an extensive header. The export type is BigModCsv.
This new export type has been implemented in the release 2024.01.
BigModCsv Export Configuration
The export contains three sections: the comment section, the header section and the timeseries values section.
The comment section is composed of 4 lines:
- all properties, separated by commas, followed by the dispatch time
- start time (day/month/year) and end time (day/month/year) of the timeseries, separated by commas
- fixed fields "Field,Precision,Infill,Last month" followed by the part before the colon (':') of resolved external qualifiers. For example if the resolved qualifiers are "Site:03MGI01" and "Measurand:1", "Site,Measurand" are added to the fixed fields. Note that to ensure the same order as defined in the id map configuration, the first time series set should have a non-empty value for each qualifier.
- end of comment indicator
The header section is composed of:
- integer indicating the number of timeseries headers
- for each timeseries, a line containing the values for "Field,Precision,Infill,Last month" followed by the part after the colon (':') of resolved external qualifiers.
time series header line containing fixed fields [Dy, Mn, Year] followed by ordered list of locations using locationIdMap, the order follows the timeseriesset processing order
- end of header indicator
The timeseries values section is composed of:
- for each timestamp, the values for all timeseries, in the same order as in the header
Here is an example configuration:
<export> <general> <exportTypeStandard>BigModCsv</exportTypeStandard> <folder>path_to_my_export_folder</folder> <exportFileName> <name>FileName.csv</name> </exportFileName> <idMapId>IdMapBigModCsvExport</idMapId> </general> <properties> <string key="ModelVersion" value="6.73.4"/> <string key="property2" value="property 2"/> </properties> <timeSeriesSet> <moduleInstanceId>RunSource$ModelId$$DevScheme$</moduleInstanceId> <valueType>scalar</valueType> <parameterId>Inflow</parameterId> <locationId>F_03MGI01</locationId> <timeSeriesType>simulated forecasting</timeSeriesType> <timeStep id="dayAEST"/> <readWriteMode>read complete forecast</readWriteMode> </timeSeriesSet> </export>
<idMap xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" version="1.1" xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/idMap.xsd"> <function internalLocationSet="Nodes$Valley$Flow9Source$DevScen$" internalParameterFunction="@ParameterIdSource$DevScen$@" externalLocationFunction="@MdbaSiteId@" externalParameterFunction="@ParameterIdSource$DevScen$@" externalQualifierFunction="Site:@MdbaSiteId@" externalQualifierFunction1="Measurand:@MeasurandIdSource$DevScen$@" externalQualifierFunction2="Quality:@QualitySource$DevScen$@" externalQualifierFunction3="Name:@TimeSeriesNameSource$DevScen$@" externalQualifierFunction4="Description:@RecordingVariableSource$DevScen$@"/> <enableOneToOneMapping/> </idMap>
and the corresponding export
6.73.4 | 11/07/2011 14:42:23+10.00 | |||||||
1/07/1895 | 30/06/2009 | |||||||
Field | Precision | Infill | Last month | Site | Measurand | Quality | Name | Description |
EOC | ||||||||
2 | ||||||||
1 | 4 | 0 | 0 | 03MGI01 | 1 | 9 | 03MGI01 | "Mid Condamine R1 - Cooby Creek - Gauged inflow (ML/d)" |
2 | 4 | 0 | 0 | 03MUI01 | 1 | 9 | 03MUI01 | "Mid Condamine R1 - Oakey Creek - Ungauged inflow (ML/d)" |
Dy | Mn | Year | 03MGI01 | 03MUI0 | ||||
EOH | ||||||||
1 | 7 | 1895 | 2,5749 | 19,0250 | 0 | |||
2 | 7 | 1895 | 2,5749 | 19,0250 | 0 | |||
3 | 7 | 1895 | 1,7166 | 19,0250 | 0 | |||
4 | 7 | 1895 | 2,5749 | 19,0250 | 0 | |||
5 | 7 | 1895 | 1,7166 | 19,0250 | 0 |