You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "CaesarWangX (via GitHub)" <gi...@apache.org> on 2024/03/01 01:23:30 UTC
Re: [I] [SUPPORT] Migration partitionned table with complex key generator to 0.14.1 leads to duplicates when recordkey length =1 [hudi]
CaesarWangX commented on issue #10508:
URL: https://github.com/apache/hudi/issues/10508#issuecomment-1972274975
Hi @ad1happy2go
Can you try this in your local?
"hoodie.datasource.write.partitionpath.field" = "region:SIMPLE"
"hoodie.datasource.write.keygenerator.class" = "org.apache.hudi.keygen.CustomKeyGenerator"
First time, run a job with 0.11.1.
Then run a job with 0.14.0
And you will find this issue: https://github.com/apache/hudi/issues/8372
Our job is already running on 0.11.1 using the above configuration. If we upgrade to 0.14.0, an error will be reported. The reason can be found in the link I sent, which is why we want to modify Custom to Complex without re importing data.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org