[GitHub] [spark] thousandhu commented on pull request #40363: [SPARK_42744] delete uploaded file when job finish for k8s

["thousandhu (via GitHub)" <gi...@apache.org>]

thousandhu commented on PR #40363:
URL: https://github.com/apache/spark/pull/40363#issuecomment-1467439787

   > 
   
   We are using HDFS as the storage. 
   And the ttl is not enough to all apps, such as streaming and AI training job which runs for several days.
   If TTL is too short, it will affect the failover for spark apps. If TTL is very long, it cases storage waste.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org