You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/08/18 12:13:09 UTC

[GitHub] [hudi] jslorrma commented on issue #3492: [SUPPORT] PySpark Quickstart Guide fails on Insert Data with `java.lang.UnsatisfiedLinkError` for Hudi 0.8.0 or 0.7.0 & PySpark 3.1.2

jslorrma commented on issue #3492:
URL: https://github.com/apache/hudi/issues/3492#issuecomment-901062144


   I tried today instead of running the code above locally (`.set("spark.master", "local[*]")`) to run it on our Hadoop cluster via YARN (`.set("spark.master", "yarn")`). Everything works as expected and without any error on the cluster. So the error seems to have something to do with my local Spark / Hadoop installation and configuration. Via Google I found [this link](https://sparkbyexamples.com/spark/spark-hadoop-exception-in-thread-main-java-lang-unsatisfiedlinkerror-org-apache-hadoop-io-nativeio-nativeiowindows-access0ljava-lang-stringiz/) which might help in this context (`java.lang.UnsatisfiedLinkError`), although it is for OS=Windows.
   
   So, @dev-Team / @support-Team, should I close this issue, as it seems to be not related to Hudi or keep it open for further discussions?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org