You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "CaesarWangX (via GitHub)" <gi...@apache.org> on 2024/03/01 01:23:30 UTC

Re: [I] [SUPPORT] Migration partitionned table with complex key generator to 0.14.1 leads to duplicates when recordkey length =1 [hudi]

CaesarWangX commented on issue #10508:
URL: https://github.com/apache/hudi/issues/10508#issuecomment-1972274975

   Hi @ad1happy2go 
   Can you try this in your local?
   "hoodie.datasource.write.partitionpath.field" = "region:SIMPLE"
   "hoodie.datasource.write.keygenerator.class" = "org.apache.hudi.keygen.CustomKeyGenerator"
   
   First time, run a job with 0.11.1.
   Then run a job with 0.14.0
   And you will find this issue: https://github.com/apache/hudi/issues/8372
   
   Our job is already running on 0.11.1 using the above configuration. If we upgrade to 0.14.0, an error will be reported. The reason can be found in the link I sent, which is why we want to modify Custom to Complex without re importing data.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org