[GitHub] spark pull request: SPARK-2582. Make Block Manager Master pluggabl...

[pwendell <gi...@git.apache.org>]

Github user pwendell commented on the pull request:

    https://github.com/apache/spark/pull/1506#issuecomment-56289168
  
    Hey @harishreedharan thanks for submitting, but like to close this PR for now pending a more complete design proposal about how external implementations of the block storage service would work. There are a bunch of other challenges in decoupling the block storage service from the SparkContext... it's definitely an interesting idea longer term but one that would need a thorough design and consensus. If we make this pluggable it will signal to the community that we want to head down this direction, so I'd propose getting a consensus on that before proceeding.
    
    For streaming specifically I know you and @tdas are working on some more specific mechanisms to provide H/A in that case.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org