Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Homogenize and compress NetCDF files #4

Open
skosukhin opened this issue Jan 23, 2024 · 4 comments
Open

Homogenize and compress NetCDF files #4

skosukhin opened this issue Jan 23, 2024 · 4 comments

Comments

@skosukhin
Copy link

It would be nice to convert all NetCDF files in the repo to the same format and compress them.

Something like nccopy -4 -d 4 -s before.nc after.nc should do the job.

@RobertPincus
Copy link
Member

RobertPincus commented Dec 13, 2024

Staged on develop in commit 122b662

Files in example/rfmip-clear-sky are left alone because they are traceable back to the ESGF

@skosukhin
Copy link
Author

Currently, we have files in the classic and in the netCDF-4 formats. We can use the netCDF4 Python package to read both but it would be nice to be able to avoid the dependency on the NetCDF C library and use h5netcdf. Alas, it cannot read the classic format and we still need either netCDF4 or scipy, which is even heavier.

@RobertPincus
Copy link
Member

@skosukhin Ah, so you want the files from ESGF to also be changed?

@skosukhin
Copy link
Author

It was just a thought. If there are good arguments against changing the format for some files, I'm fine with not doing that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants