You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/05/17 06:54:25 UTC
[GitHub] [hudi] easonwood opened a new issue, #5602: [SUPPORT] Problems in SparkRDDWriteClient.upsert
easonwood opened a new issue, #5602:
URL: https://github.com/apache/hudi/issues/5602
Hudi version : 0.8.0
Spark version : 3.1.2
I tried to upsert hudi by client.
Found the HoodieJavaWriteClient API only support COW tables (why not support MOR).
So I used SparkRDDWriteClient API.
But Faced with such error.
Can anybody help with it?
22/05/17 02:43:21 ERROR ApplicationMaster: User class threw exception: java.lang.VerifyError: Bad return type
Exception Details:
Location:
org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor.getUpsertPartitioner(Lorg/apache/hudi/table/WorkloadProfile;)Lorg/apache/spark/Partitioner; @34: areturn
Reason:
Type 'org/apache/hudi/table/action/commit/UpsertPartitioner' (current frame, stack[0]) is not assignable to 'org/apache/spark/Partitioner' (from method signature)
Current Frame:
bci: @34
flags: { }
locals: { 'org/apache/hudi/table/action/commit/BaseSparkCommitActionExecutor', 'org/apache/hudi/table/WorkloadProfile' }
stack: { 'org/apache/hudi/table/action/commit/UpsertPartitioner' }
Bytecode:
0x0000000: 2bc7 000d bb00 9a59 12ca b700 9dbf bb00
0x0000010: 8f59 2b2a b400 0f2a b400 052a b400 03b7
0x0000020: 00cb b0
Stackmap Table:
same_frame(@14)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] easonwood commented on issue #5602: [SUPPORT] Problems in SparkRDDWriteClient.upsert
Posted by GitBox <gi...@apache.org>.
easonwood commented on issue #5602:
URL: https://github.com/apache/hudi/issues/5602#issuecomment-1128653028
It turns out that
when your project's dependencies contains both hudi-java-client and hudi-spark-client, this error will happen
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] easonwood closed issue #5602: [SUPPORT] Problems in SparkRDDWriteClient.upsert
Posted by GitBox <gi...@apache.org>.
easonwood closed issue #5602: [SUPPORT] Problems in SparkRDDWriteClient.upsert
URL: https://github.com/apache/hudi/issues/5602
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org