You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/10/14 05:23:27 UTC

[GitHub] [hudi] LeoHsu0802 edited a comment on issue #933: Support for multiple level partitioning in Hudi

LeoHsu0802 edited a comment on issue #933:
URL: https://github.com/apache/hudi/issues/933#issuecomment-708162635


   > Hi @LeoHsu0802, hoodie.datasource.write.partitionpath.field needs to be a comma separated string. So for your key I believe it would be `'hoodie.datasource.write.partitionpath.field': 'year,month,day'`
   > Additionally, are you using hive as your metastore?
   > 
   > With hudi version 0.6.0 a new CustomKeyGenerator was added, so I would encourage looking into this new generator. I'm trying to switch to it myself now, although getting some errors that I'm trying to identify if they are with my code or as a result of changes aws made to the hudi jar that is packaged in emr now.
   
   Hi @afeldman1 ,
   Thank you for your reply!
   I changed the partitionpath to this format 
   `'hoodie.datasource.write.partitionpath.field': 'year,month,day'`
   but only get  `default ` partition folder
   
   I run an EMR and write the partition parquet file to S3 so maybe need to do other config setting?
   Thanks


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org