You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/10 06:18:51 UTC

[GitHub] [hudi] vaibhav2ghadge opened a new issue #5005: [SUPPORT] java.lang.IllegalArgumentException: Partition key parts [] does not match with partition values []. Check partition strategy.

vaibhav2ghadge opened a new issue #5005:
URL: https://github.com/apache/hudi/issues/5005


   **_Tips before filing an issue_**
   
   - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
   
   - Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
   
   - If you have triaged this as a bug, then file an [issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
   
   **Describe the problem you faced**
   I'm writing data to a non-partitioned table on S3, job executed successfully and data also get written into S3 but when I check job logs fond following error 
   `Caused by: java.lang.IllegalArgumentException: Partition key parts [] does not match with partition values []. Check partition strategy. 
   	at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:40)
   	at org.apache.hudi.hive.HoodieHiveClient.getPartitionClause(HoodieHiveClient.java:163)
   	at org.apache.hudi.hive.HoodieHiveClient.constructAddPartitions(HoodieHiveClient.java:147)
   	at org.apache.hudi.hive.HoodieHiveClient.addPartitionsToTable(HoodieHiveClient.java:121)
   	at org.apache.hudi.hive.HiveSyncTool.syncPartitions(HiveSyncTool.java:206)
   	... 45 more`
   	
   	I'm using following configuration for the writer 
   	`writer.option(DataSourceWriteOptions.PARTITIONPATH_FIELD_OPT_KEY(), "")
                       .option(DataSourceWriteOptions.HIVE_STYLE_PARTITIONING_OPT_KEY(), "true")
                       .option(DataSourceWriteOptions.HIVE_PARTITION_FIELDS_OPT_KEY(), "")
                       .option(DataSourceWriteOptions.KEYGENERATOR_CLASS_OPT_KEY(), NonpartitionedKeyGenerator.class.getCanonicalName())
                       .option(DataSourceWriteOptions.HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY(), NonPartitionedExtractor.class.getCanonicalName());`
   
   A clear and concise description of the problem.
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1.
   2.
   3.
   4.
   
   **Expected behavior**
   Hive shouldn't sync the partition because there is no partition 
   A clear and concise description of what you expected to happen.
   
   **Environment Description**
   We are using emr-6.3.1
   * Hudi version :
   0.7.0-amzn-0
   * Spark version :
   3.1.1
   * Hive version :
   3.1.2
   * Hadoop version :
   3.2.1
   * Storage (HDFS/S3/GCS..) :
   S3
   * Running on Docker? (yes/no) :
   NO
   
   **Additional context**
   
   Add any other context about the problem here.
   
   **Stacktrace**
   
   ```Add the stacktrace of the error.```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] vaibhav2ghadge closed issue #5005: [SUPPORT] java.lang.IllegalArgumentException: Partition key parts [] does not match with partition values []. Check partition strategy.

Posted by GitBox <gi...@apache.org>.
vaibhav2ghadge closed issue #5005:
URL: https://github.com/apache/hudi/issues/5005


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org