[GitHub] [spark] lys0716 commented on issue #23941: [MINOR][DOC] Add more details to descriptions of customized class path

[GitBox <gi...@apache.org>]

lys0716 commented on issue #23941: [MINOR][DOC] Add more details to descriptions of customized class path
URL: https://github.com/apache/spark/pull/23941#issuecomment-469149631
 
 
   Hi HyukjinKwon, thanks for your reply. What I am trying to do is to improve the document descriptions. Especially how to use customized class in spark cluster.
   
   If you check stackoverflow, there are lots of discussions. But none of them gives a satisfied answer. Even this [one](https://stackoverflow.com/questions/37132559/add-jars-to-a-spark-job-spark-submit) 
   
   We had hard time to test spark on the hadoop cluster. One of the main reason is that we spent a lot of time figuring out how to prepend the customized jar.
   
   I think <code>spark.executor.userClassPathFirst</code> is very helpful in developing, especially you set some customized class path in <code>spark.executor.extraClassPath</code>. It is like <code>setUserClassesTakesPrecedence</code> in hadoop world. 
   
   In the end, if you think we should not mix the experimental and stable feature. I am totally ok with it. I can withdraw this pr.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org