[GitHub] [spark] mridulm edited a comment on pull request #30486: [SPARK-33530][CORE] Support --archives and spark.archives option natively

[GitBox <gi...@apache.org>]

mridulm edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-735209644


   Thanks for the details @HyukjinKwon !
   
   So my understanding is that the PR is adding functionality which is existing in yarn for archives into a general support for other resource managers too - with spark on yarn continuing to rely on distributed cache (and there should be no functionality change in yarn mode). That sounds fine to me - but it would be good if @tgravescs can also take a look, I am a bit rusty on some of these now - and iirc there are a bunch of corner cases in this.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org