You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by ScrapCodes <gi...@git.apache.org> on 2018/09/03 10:44:44 UTC

[GitHub] spark issue #17745: [SPARK-17159][Streaming] optimise check for new files in...

Github user ScrapCodes commented on the issue:

    https://github.com/apache/spark/pull/17745
  
    It appears, there are more people using object store now, than ever. For those who are attached to old versions of spark streaming, having this would be good.
    
    Hi @steveloughran, are you planning to work on it ? or shall I take it forward from here? 
    I am contemplating what can be done. So far the plan is we will temporarily maintain it as an experimental component in Apache Bahir, for the time it is not merged in mainstream spark. If you are willing to maintain the component, then please send a pull request to Bahir with just this patch applied.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org