You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "pycoder2000 (via GitHub)" <gi...@apache.org> on 2023/02/08 07:29:55 UTC

[GitHub] [hudi] pycoder2000 commented on issue #7555: [SUPPORT] Spark 3.3.1 and HUDI 0.12.1 and hadoop3.2.2

pycoder2000 commented on issue #7555:
URL: https://github.com/apache/hudi/issues/7555#issuecomment-1422149102

   > # Note
   > I was able to resolve this by lowering version of hadoop I feel this is bug we need to address it
   > 
   > ```
   > Install
   > https://dlcdn.apache.org/spark/spark-3.3.1/spark-3.3.1-bin-hadoop2.tgz
   > 
   > hadoop2.7
   > https://github.com/soumilshah1995/winutils/blob/master/hadoop-2.7.7/bin/winutils.exe
   > 
   > pyspark --packages org.apache.hudi:hudi-spark3.3-bundle_2.12:0.12.1 --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'
   > ```
   > 
   > it fails on hadoop 3.0
   
   Thank you so much! Hudi writeout of my local system had been failing for days and yours was the only solution that worked!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org