.nc file is 3-4x larger than input files

[aallenlanghans]

I am generating .nc files for radiometric spectral data and the files often come out being considerably larger than the files I input. My most recent example is of 18Gb file divided into 3 csv's and the output .nc file was 70Gb.

[leonfoks]

When you write out the netcdf file try adding the following.

ds.to_netcdf(format=“NETCDF4”, engine=“h5netcdf”, encoding= {"compression": "gzip", "compression_opts": 9})