You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/02/27 00:41:34 UTC

[GitHub] jose-torres commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

jose-torres commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query
URL: https://github.com/apache/spark/pull/22952#issuecomment-467675211
 
 
   I guess my major quesiton is the user-facing motivation for this - why do Spark users want to use these options? Is it just a matter of controlling storage space without an offline janitor? (This may be obvious - I just want to make sure we aren't overlooking some simpler way to accomplish the end goal.)
   
   There have also been a lot of comments discussed without unit tests written to confirm we've resolved the issue.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org