You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sdap.apache.org by GitBox <gi...@apache.org> on 2021/05/20 20:51:50 UTC
[GitHub] [incubator-sdap-nexus] skorper opened a new pull request #129: SDAP-312: Improved UTM reprojection speed
skorper opened a new pull request #129:
URL: https://github.com/apache/incubator-sdap-nexus/pull/129
I noticed the following pyproj call was deprecated:
```python
pyproj.transform(p1=lonlat_proj, p2=aeqd_proj, x=x, y=y)
```
I updated this call to the following:
```python
aeqd_proj(x, y)
```
which no longer throws a deprecation warning. I also noticed it's significantly faster. Here's a minimal example I threw together:
```python
matchup_center_lon=-86.36720670954534
matchup_center_lat=19.85014715590842
y=22.1
x=-94.0
lonlat_proj = pyproj.Proj(proj='lonlat')
aeqd_proj = pyproj.Proj(proj='aeqd', lon_0=matchup_center_lon, lat_0=matchup_center_lat)
pyproj.transform(p1=lonlat_proj, p2=aeqd_proj, x=x, y=y)
aeqd_proj(x, y)
```
Both return the same result, but the first transform takes 0.073577404 seconds and the second takes 0.000022650 seconds.
I integrated this with the matchup algorithm and here are some example request times before/after:
```
{{big_data_url}}/match_spark?primary=avhrr-l4-glob-v2-daily-ncei-ghrsst-sstblend-avhrr-oi-glob-v020-fv020&startTime=2012-09-25T00:00:00Z&endTime=2012-09-30T23:59:59Z&tt=86400&rt=1000&b=-45,15,-30,30&platforms=1,2,3,4,5,6,7,8,9¶meter=sss&depthMin=0&depthMax=5&matchOnce=true&matchup=spurs
```
Before: 5.23s
After: 1.01s
```
{{big_data_url}}/match_spark?primary=avhrr-l4-glob-v2-daily-ncei-ghrsst-sstblend-avhrr-oi-glob-v020-fv020&startTime=2012-09-25T00:00:00Z&endTime=2012-10-25T00:00:00Z&tt=86400&rt=1000&b=-45,15,-30,30&platforms=1,2,3,4,5,6,7,8,9¶meter=sst&depthMin=0&depthMax=5&matchOnce=true&matchup=spurs
```
Before: 13.35s
After: 2.79s
```
{{big_data_url}}/match_spark?primary=avhrr-l4-glob-v2-daily-ncei-ghrsst-sstblend-avhrr-oi-glob-v020-fv020&startTime=2012-09-25T00:00:00Z&endTime=2012-10-25T00:00:00Z&tt=86400&rt=1000&b=-100,0,-30,30&platforms=1,2,3,4,5,6,7,8,9¶meter=sst&depthMin=0&depthMax=5&matchOnce=false&matchup=spurs
```
Before: 67.72s
After: 23.82s
```
{{big_data_url}}/match_spark?primary=avhrr-l4-glob-v2-daily-ncei-ghrsst-sstblend-avhrr-oi-glob-v020-fv020&startTime=2012-09-25T00:00:00Z&endTime=2012-12-25T00:00:00Z&tt=86400&rt=1000&b=-45,15,-30,30&platforms=1,2,3,4,5,6,7,8,9¶meter=sst&depthMin=0&depthMax=5&matchOnce=false&matchup=spurs
```
Before: 41.91s
After: 9.34s
```
{{big_data_url}}/match_spark?primary=avhrr-l4-glob-v2-daily-ncei-ghrsst-sstblend-avhrr-oi-glob-v020-fv020&startTime=2012-09-25T00:00:00Z&endTime=2012-09-30T23:59:59Z&tt=86400&rt=1000&b=-100,0,-30,30&platforms=1,2,3,4,5,6,7,8,9¶meter=sst&depthMin=0&depthMax=5&matchOnce=false&matchup=spurs
```
Before: 20.34s
After: 1.94s
Here are the before/after metrics graphs:
|Before|After|
|--|--|
|||
|||
|||
|||
**Note: total time (as indicated in the graphs above and the before/after times above are the sum of the captured metrics, not the client total request time.**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sdap-nexus] ngachung merged pull request #129: SDAP-312: Improved UTM reprojection speed
Posted by GitBox <gi...@apache.org>.
ngachung merged pull request #129:
URL: https://github.com/apache/incubator-sdap-nexus/pull/129
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org