[GitHub] [iceberg] kbendick commented on issue #2991: No such file or directory when using multiple Spark executors + Iceberg in EMR

[GitBox <gi...@apache.org>]

kbendick commented on issue #2991:
URL: https://github.com/apache/iceberg/issues/2991#issuecomment-914573807


   Hi @fcvr1010! Thank you for your input. Sorry for the delay, was out sick for a good portion of last week.
   
   I'll take a closer look at what you've reported, though if the `File.createTempFile` was created by a java process that had already closed, that would explain why it wasn't available to view via `bpftrace` (throwing that out there in case that were the case).
   
   But it is interesting that EMR (and possibly more generally, yarn) has this conflicting `tmp` issue. Thank you for your report and please, feel free to provide ANY further information you might think is relevant. =)
   
   I'd also ask you to reach out to your AWS rep (if you have one), in case this is an EMR specific oddity (or a yarn specific oddity that they can help you debug).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org