[GitHub] [spark] boneanxs commented on pull request #36775: [SPARK-39389]Filesystem closed should not be considered as corrupt files

[GitBox <gi...@apache.org>]

boneanxs commented on PR #36775:
URL: https://github.com/apache/spark/pull/36775#issuecomment-1165432681

   Thanks for you guys reviews, I think @JoshRosen's way is more appropriate, we better change the implementation to "false negatives", though it may need more efforts to implement it and it's a breaking change to the users.
   
   Do we need to implement it or change this to identify whether it's an exception from `DFSClient.checkOpen` to make the codes more robust?
   
   cc: @mridulm @HyukjinKwon @dongjoon-hyun 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org