[GitHub] spark pull request: SPARK-1537 publisher-side code and tests

[steveloughran <gi...@git.apache.org>]

Github user steveloughran commented on the pull request:

    https://github.com/apache/spark/pull/8744#issuecomment-145818164
  
    @tgravescs: ATS v1. What we got from the ATS team was a commitment to not break that API at some ws/v1/ endpoint they'll continue to offer.
    
    However, V2 is designed to address other things (like availability), as well as scale. 1.x clients won't get that. 
    
    This implementation is designed to keep load on ATS down (you can tell it not to do any refresh in the background), but an 8GB event, while it should be handled by leveldb, is a pretty serious json ser/deser load at both ends. I'd like to move to background playback where the getAppUI() returns the UI, but the UI is built up asynchronously, as you'd get from a running app. The filesystem history provider could do the same thing.
    



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org