You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "vinoyang (Jira)" <ji...@apache.org> on 2021/03/29 09:35:00 UTC
[jira] [Commented] (HUDI-1731) Rename UpsertPartitioner in both
hudi-java-client and hudi-spark-client to differentiate them from each
other
[ https://issues.apache.org/jira/browse/HUDI-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310530#comment-17310530 ]
vinoyang commented on HUDI-1731:
--------------------------------
[~pandaman1984] Thanks for reporting this issue. I have given you Jira contributor permission.
> Rename UpsertPartitioner in both hudi-java-client and hudi-spark-client to differentiate them from each other
> -------------------------------------------------------------------------------------------------------------
>
> Key: HUDI-1731
> URL: https://issues.apache.org/jira/browse/HUDI-1731
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Code Cleanup
> Reporter: Leo Zhu
> Assignee: Leo Zhu
> Priority: Minor
> Labels: pull-request-available
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> There's same fully-qualified name class - "org.apache.hudi.table.action.commit.UpsertPartitioner" in both hudi-spark-client and hudi-java-client module. When both jars are included in classpath, one would override another, and below error would happen,
> Exception in thread "main" java.lang.VerifyError: Bad return typeException in thread "main" java.lang.VerifyError: Bad return typeException Details: Location: org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.getUpsertPartitioner(Lorg/apache/hudi/table/WorkloadProfile;)Lorg/apache/spark/Partitioner; @34: areturn Reason: Type 'org/apache/hudi/table/action/commit/UpsertPartitioner' (current frame, stack[0]) is not assignable to 'org/apache/spark/Partitioner' (from method signature) Current Frame: bci: @34 flags: \{ } locals: \{ 'org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor', 'org/apache/hudi/table/WorkloadProfile' } stack: \{ 'org/apache/hudi/table/action/commit/UpsertPartitioner' } Bytecode: 0x0000000: 2bc7 000d bb00 9859 12bc b700 9bbf bb00 0x0000010: 8d59 2b2a b400 0f2a b400 052a b400 03b7 0x0000020: 00bd b0 Stackmap Table: same_frame(@14)
> at org.apache.hudi.table.HoodieSparkCopyOnWriteTable.insert(HoodieSparkCopyOnWriteTable.java:97) at org.apache.hudi.table.HoodieSparkCopyOnWriteTable.insert(HoodieSparkCopyOnWriteTable.java:82) at org.apache.hudi.client.SparkRDDWriteClient.insert(SparkRDDWriteClient.java:169)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)