[GitHub] [incubator-sdap-ingester] RKuttruff commented on pull request #73: SDAP-435 + SDAP-437 - Dimension squeezing and timedelta array support

["RKuttruff (via GitHub)" <gi...@apache.org>]

RKuttruff commented on PR #73:
URL: https://github.com/apache/incubator-sdap-ingester/pull/73#issuecomment-1409071377

   SDAP-437: Could (should?) probably expand this out to a number of preprocessing steps that may be necessary in the future.
   
   Eg:
   ```yaml
   collections:
     - id: VIIRS
       path: /data/granules/viirs_sub/*.nc4
       priority: 1
       forward-processing-priority: 5
       projection: SwathMulti
       dimensionNames:
         latitude: lat
         longitude: lon
         time: sst_dtime
         variables:
         - sea_surface_temperature
         - wind_speed
       slices:
         nj: 15
         ni: 15
       preprocess:
       - squeeze:
         - time
    ```
   Would yield a RMQ message like:
   
   ```yaml
   granule:
     resource: /data/granules/viirs_sub/20180710093600-JPL-L2P_GHRSST-SSTskin-VIIRS_NPP-N-v02.0-fv01.0_subsetted.nc4
   processors:
   - latitude: lat
     longitude: lon
     name: SwathMulti
     time: sst_dtime
     variable: '["sea_surface_temperature", "wind_speed"]'
   - name: emptyTileFilter
   - name: subtract180FromLongitude
   - name: kelvinToCelsius
   - dataset_name: VIIRS
     name: tileSummary
   - name: generateTileId
   slicer:
     dimension_step_sizes:
       ni: 15
       nj: 15
     name: sliceFileByStepSize
   preprocessors:
   - squeeze:
     - time
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@sdap.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org