You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by GitBox <gi...@apache.org> on 2020/01/20 05:14:56 UTC
[GitHub] [spark-website] HyukjinKwon opened a new pull request #252: Add
some info about OBJC_DISABLE_INITIALIZE_FORK_SAFETY and macOS High Sierra
for PySpark
HyukjinKwon opened a new pull request #252: Add some info about OBJC_DISABLE_INITIALIZE_FORK_SAFETY and macOS High Sierra for PySpark
URL: https://github.com/apache/spark-website/pull/252
To run some PySpark features like pandas UDF, it requires to set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY` on macOS High Sierra+. See https://issues.apache.org/jira/browse/SPARK-25473 and https://bugs.python.org/issue33725
I had to explain this multiple times. I wasn't particularly worried about PySpark itself because the production env is not usually Mac.
I target to describe `OBJC_DISABLE_INITIALIZE_FORK_SAFETY` in testing page as Mac is usually dev env.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] HyukjinKwon commented on issue #252: Add some info
about OBJC_DISABLE_INITIALIZE_FORK_SAFETY and macOS High Sierra+ for PySpark
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on issue #252: Add some info about OBJC_DISABLE_INITIALIZE_FORK_SAFETY and macOS High Sierra+ for PySpark
URL: https://github.com/apache/spark-website/pull/252#issuecomment-576124070
Thanks, merged!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
[GitHub] [spark-website] HyukjinKwon closed pull request #252: Add some info
about OBJC_DISABLE_INITIALIZE_FORK_SAFETY and macOS High Sierra+ for PySpark
Posted by GitBox <gi...@apache.org>.
HyukjinKwon closed pull request #252: Add some info about OBJC_DISABLE_INITIALIZE_FORK_SAFETY and macOS High Sierra+ for PySpark
URL: https://github.com/apache/spark-website/pull/252
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org