You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "bkosuru (via GitHub)" <gi...@apache.org> on 2023/05/25 01:41:53 UTC

[GitHub] [hudi] bkosuru opened a new issue, #8800: GCP: Hudi stopped working in Dataproc Serverless 1.1.4

bkosuru opened a new issue, #8800:
URL: https://github.com/apache/hudi/issues/8800

   Hi All,
   
   I was able to load hudi data in GCP Dataproc Serverless 1.1.3.  1.1.3 is deprecated and not available to use. 
   I can load the data in parquet format but not in hudi format in Dataproc Serverless 1.1.4
   
   spark.read.format("hudi").load(path) - 0 rows
   spark.read.format("parquet").load(path) - 6500 rows
   
   I tested with hudi 0.12.12 and 0.13.0. I downloaded jars from hudi-spark3.3-bundle_2.12
   
   From dataproc release notes https://cloud.google.com/dataproc/docs/release-notes, the following upgrades were made to 1.1.4 -
   Spark to [3.3.2]
   Jackson to 2.13.5
   Jetty to 9.4.50.v20221201
   ORC to 1.8.2
   Protobuf to 3.21.12
   RoaringBitmap to 0.9.39
   
   Any of these changes impact Hudi?
   
   Thanks,
   Bindu


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xushiyan closed issue #8800: GCP: Hudi stopped working in Dataproc Serverless 1.1.4

Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan closed issue #8800: GCP: Hudi stopped working in Dataproc Serverless 1.1.4
URL: https://github.com/apache/hudi/issues/8800


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] bkosuru commented on issue #8800: GCP: Hudi stopped working in Dataproc Serverless 1.1.4

Posted by "bkosuru (via GitHub)" <gi...@apache.org>.
bkosuru commented on issue #8800:
URL: https://github.com/apache/hudi/issues/8800#issuecomment-1564989781

   I also created a support ticket for GCP


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] ad1happy2go commented on issue #8800: GCP: Hudi stopped working in Dataproc Serverless 1.1.4

Posted by "ad1happy2go (via GitHub)" <gi...@apache.org>.
ad1happy2go commented on issue #8800:
URL: https://github.com/apache/hudi/issues/8800#issuecomment-1569526594

   @bkosuru Let us know the response from GCP. It is a bit strange that the code is succeeding but actually not loading the data.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] ad1happy2go commented on issue #8800: GCP: Hudi stopped working in Dataproc Serverless 1.1.4

Posted by "ad1happy2go (via GitHub)" <gi...@apache.org>.
ad1happy2go commented on issue #8800:
URL: https://github.com/apache/hudi/issues/8800#issuecomment-1598375590

   @bkosuru Normally we don't make any updates related to dependencies in the minor release. 
   
   Anyway Closing out this issue as it works with 0.13.1.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] bkosuru commented on issue #8800: GCP: Hudi stopped working in Dataproc Serverless 1.1.4

Posted by "bkosuru (via GitHub)" <gi...@apache.org>.
bkosuru commented on issue #8800:
URL: https://github.com/apache/hudi/issues/8800#issuecomment-1572227348

   It started working with hudi 0.13.1, did you fix anything in 0.13.1 to make it work?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org