You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/03/02 07:07:57 UTC

[GitHub] [spark] ScrapCodes edited a comment on issue #27735: [SPARK-30985][SPARK-25065][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

ScrapCodes edited a comment on issue #27735: [SPARK-30985][SPARK-25065][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.
URL: https://github.com/apache/spark/pull/27735#issuecomment-593251699
 
 
   > > ill let the user specific configuration files be mounted on the driver and executor pods'
   > 
   > Can you expand on this, what does "mount" mean here in a distributed environment. The place $SPARK_CONF_DIR is pointing has to be on distributed filesystem. if its pointing to local disk how do you mount that on remote pod.
   
   @tgravescs, Hi Thomas Graves, the mount here refers to the kubernetes feature that it lets us mount ConfigMaps as Volumes. More details here. https://kubernetes.io/docs/concepts/storage/volumes/#configmap. `SPARK_CONF_DIR` is not required to be on a distributed filesystem.
   
   I have also updated the description with more details how the Kubernetes config map will work here. 
   
   Thanks a lot for taking a look though, do you have more comments? can you please help review this patch !

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org