You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@sdap.apache.org by GitBox <gi...@apache.org> on 2020/08/11 20:17:41 UTC

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl opened a new pull request #107: Sdap 268: asynchronous request management

tloubrieu-jpl opened a new pull request #107:
URL: https://github.com/apache/incubator-sdap-nexus/pull/107


   So far:
   - added the fair scheduling option in spark (no tested with big jobs yet)
   - added NexusHandlerManager to manage different end-points for a single algorthim. The demonstrate that with:
       - legacy end-points
       - rest end point (for the Spark, for example /TimeAvgMapSpark --> /rest/TimeAvgMap )
   
   Later on I'll add the WPS end point to enable asynchronous requests.
   
   I would like you to review that before I go forward with that.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl commented on pull request #107: Sdap 268: asynchronous request management

Posted by GitBox <gi...@apache.org>.

tloubrieu-jpl commented on pull request #107:
URL: https://github.com/apache/incubator-sdap-nexus/pull/107#issuecomment-986064244


   @ngachung @jjacob7734, I often have issues with 504 error on SDAP bigdata and when it happens, I need to wait for SDAP to consume all the requests I previously sent (through a parallelized script) before I resend a more reasonable series of requests.
   
   Do you have the same experience ?
   
   I was thinking 1) this is consuming a lot a computing resources for nothing and 2) we don't have a way to insure that the client can get a response from SDAP. 
   
   So I was thinking that could be helpful to move forward with this pull request, since that would enable to get the SDAP request results whatever the duration of the processing. 
   
   That being said I don't remember the exact status of the development and now there are conflicts with the current dev.
   
   Thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@sdap.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org