Original question

I'm trying to export time-series data using export type NETCDF-CF_TIMESERIES for 100 years of daily data at 3000 locations and I'm getting an error: "Illegal argument Variable starting pos=2297032636 may not exceed 2147483647 passed at ucar.nc2.iosp.netcdf3.N3header.create:602"

looking online, it appears that I've exceeded the netCDF-3 Classic Format file size limit. Apparently, there's an argument "-isLargeFile" that can be added to the netCDF call (e.g., "java -classpath netcdfAll-4.6.13.jar ucar.nc2.dataset.NetcdfDataset -in <path> -out <path> -isLargeFile") that allows for the writing of a 64-bit Offset netCDF-3 format file.  Can arguments such as "-isLargeFile" be added to the NETCDF-CF_TIMESERIES call? If not, is there another suggested means of exporting large time-series data?

Solution

If you try and export the timeseries through a general adapter run, instead of through the timeseries Export module, you have the possibility to define the NetCDF write format of "netcdf4" in the timeSeriesExportRun as a property, e.g.:

</general>
<properties>
            <string key="netCDFWriteFormat" value=" netcdf4"/>
</properties> 
<timeSeriesSet>



This might allow you to export the timeseries in one file. Take a look at: 05 General Adapter Module#05GeneralAdapterModule-exportNetcdfActivity

  • No labels

Disclaimer