[jira] [Updated] (SDAP-481) Enable internal compression for netcdf match up outputs

["Riley Kuttruff (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SDAP-481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Riley Kuttruff updated SDAP-481:
--------------------------------
    Assignee: Riley Kuttruff  (was: Stepheny Perez)
      Status: In Progress  (was: To Do)

> Enable internal compression for netcdf match up outputs
> -------------------------------------------------------
>
>                 Key: SDAP-481
>                 URL: https://issues.apache.org/jira/browse/SDAP-481
>             Project: Apache Science Data Analytics Platform
>          Issue Type: New Feature
>          Components: nexus-analysis
>            Reporter: Stepheny Perez
>            Assignee: Riley Kuttruff
>            Priority: Minor
>
> From Vardis:
> {quote}Here is a prior SPURS Saildrone  example of the application of netCDF internal compression ..
> It uses the nccopy command with -d 5 parameter (deflate=compress at level 5) applied to an existing netcdf file.
> _$ nccopy -4 -d 5 saildrone-gen_6-arctic_misst_2021-sd1058-20210706T000000-20211020T235959-5_minutes-v1.1638218824631.nc new.nc_
> This reduced the file size from 43mb originally to 6.3mb.
> I am sure there is a way of actually writing the compressed netCDF natively from the outset with -d.
> [https://www.unidata.ucar.edu/blogs/developer/en/entry/netcdf_compression]  (some info)
> [http://climate-cms.wikis.unsw.edu.au/NetCDF_Compression_Tools]   (python package and general info on nc compression).
> [https://docs.xarray.dev/en/latest/generated/xarray.Dataset.to_netcdf.html] (xarray write netCDF - compression syntax/parameters mentioned)
> {quote}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)