You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sdap.apache.org by GitBox <gi...@apache.org> on 2022/12/22 20:20:20 UTC
[GitHub] [incubator-sdap-ingester] RKuttruff opened a new pull request, #69: SDAP-417: Prevent SolrStore from generating documents with incorrect WKT for small tiles
RKuttruff opened a new pull request, #69:
URL: https://github.com/apache/incubator-sdap-ingester/pull/69
For narrow tiles (max/min lat/lon difference ~<0.001) the generated WKT for the geo field for the Solr document would essentially collapse to a lower dimensional shape while being described as a higher dimensional shape (ie a POLYGON that was a line or a LINESTRING that was a point). Solr would throw an error when trying to write such documents, which has been observed occurring when ingesting granules for the VIIRS_NPP-JPL-L2P-v2016.2 dataset.
To fix this, we now check to see if the collapse will occur (if the bbox values differ but the string representations don't) and then force the string representations of the max/min values to have at least a 0.001 difference.
This has been tested successfully with a granule that previously caused this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@sdap.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sdap-ingester] RKuttruff commented on pull request #69: SDAP-417: Prevent SolrStore from generating documents with incorrect WKT for spatially small tiles
Posted by "RKuttruff (via GitHub)" <gi...@apache.org>.
RKuttruff commented on PR #69:
URL: https://github.com/apache/incubator-sdap-ingester/pull/69#issuecomment-1402823267
Metadata dictionary for tile with this issue:
{
"table_s": "sea_surface_temp",
"geo": "POLYGON((179.999 -28.293, 179.999 -28.293, 179.999 -28.156, 179.999 -28.156, 179.999 -28.293))",
"id": "01b584a4-1bd7-34e6-9647-905e3a1505cc",
"solr_id_s": "VIIRS_NPP-JPL-L2P-v2016.2!01b584a4-1bd7-34e6-9647-905e3a1505cc",
"sectionSpec_s": "ni:3195:3200,nj:1830:1845,time:0:1",
"dataset_s": "VIIRS_NPP-JPL-L2P-v2016.2",
"granule_s": "20171222140600-JPL-L2P_GHRSST-SSTskin-VIIRS_NPP-N-v02.0-fv01.0.nc",
"tile_var_name_ss": [
"sea_surface_temperature",
"wind_speed"
],
"day_of_year_i": 356,
"tile_min_lon": 179.99855041503906,
"tile_max_lon": 179.99856567382812,
"tile_min_lat": -28.29263687133789,
"tile_max_lat": -28.156116485595703,
"tile_depth": 0.0,
"tile_min_time_dt": "2017-12-22T14:06:00Z",
"tile_max_time_dt": "2017-12-22T14:06:00Z",
"tile_min_val_d": -37.345001220703125,
"tile_max_val_d": -21.8699951171875,
"tile_avg_val_d": -29.822452545166016,
"tile_count_i": 55,
"sea_surface_temperature.tile_standard_name_s": "sea_surface_skin_temperature",
"wind_speed.tile_standard_name_s": "wind_speed"
}
Attempting to add this to Solr will cause an error.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@sdap.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sdap-ingester] RKuttruff merged pull request #69: SDAP-417: Prevent SolrStore from generating documents with incorrect WKT for spatially small tiles
Posted by "RKuttruff (via GitHub)" <gi...@apache.org>.
RKuttruff merged PR #69:
URL: https://github.com/apache/incubator-sdap-ingester/pull/69
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@sdap.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org