[GitHub] [iceberg] jackye1995 commented on issue #2991: No such file or directory when using multiple Spark executors + Iceberg in EMR

[GitBox <gi...@apache.org>]

jackye1995 commented on issue #2991:
URL: https://github.com/apache/iceberg/issues/2991#issuecomment-923106782


   @alex-shchetkov @fcvr1010 sorry I was sick out last few days, thanks for the detailed investigations! It's true that it always creates temp file with prefix `s3fileio`, but I think we should not depend on that behavior. There seem to be 2 issues at the same time, where (1) something is wrong with EMR Spark temp directory, and (2) the program should not hang when this happens. Let me pull in a few EMR Spark folks for this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org