You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/10/22 20:22:38 UTC

[GitHub] [hudi] nsivabalan commented on issue #6808: [SUPPORT] Cannot sync to spark embedded derby hive meta store (the default one)

nsivabalan commented on issue #6808:
URL: https://github.com/apache/hudi/issues/6808#issuecomment-1287904751

   @jonvex : can you follow up on this issue based on your exp w/ local derby. 
   CC @xushiyan 
   @schlichtanders : From our exp, no one uses derby in a prod env and hence we don't have much exp on that end. can you help us understand your use-case. 
   
   btw, we have a script that we developed recently to test out local derby using a derby client. we developed this flow to test hive sync using spark-bundle. 
   You can find the scripts here https://github.com/apache/hudi/tree/master/packaging/bundle-validation/spark-write-hive-sync
   
   specifically: 
   https://github.com/apache/hudi/blob/master/packaging/bundle-validation/spark-write-hive-sync/Dockerfile
   https://github.com/apache/hudi/blob/master/packaging/bundle-validation/spark-write-hive-sync/validate.scala
   
   that should help you w/ your case. we just need derby client, hive, spark and use the docker. 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org