[jira] [Created] (HUDI-4847) hive sync fails w/ utilities bundle in 0.13-snapshot, but succeeds w/ 0.11

["sivabalan narayanan (Jira)" <ji...@apache.org>]

sivabalan narayanan created HUDI-4847:
-----------------------------------------

             Summary: hive sync fails w/ utilities bundle in 0.13-snapshot, but succeeds w/ 0.11
                 Key: HUDI-4847
                 URL: https://issues.apache.org/jira/browse/HUDI-4847
             Project: Apache Hudi
          Issue Type: Bug
          Components: meta-sync
            Reporter: sivabalan narayanan


I used to run HiveSyncTool direclty as spark job to trigger hive sync and I use hudi-utilities bundle for it. this used to work with 0.11 hudi jars. but with 0.13-snapshot, it fails. I use hms based sync. 

 

sample job configs used:
{code:java}
arguments:
  - --database
  - test_db
  - --table
  - catalog_sales
  - --base-path
  - [TABLE_PATH]
  - --user
  - dbuser
  - --pass
  - dbuser
  - --metastore-uris
  - 'thrift://metastore123:9083'
  - --sync-mode
  - hms
  - --partitioned-by
  - cs_sold_date_sk
  - --partition-value-extractor
  - org.apache.hudi.hive.MultiPartKeysValueExtractor {code}
Same exact configs works with 0.11 utilities bundle. 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)