You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Istvan Darvas (Jira)" <ji...@apache.org> on 2022/05/02 10:37:00 UTC

[jira] [Created] (HUDI-4008) Delta Streamer does not respect hoodie.datasource.write.drop.partition.columns config

Istvan Darvas created HUDI-4008:
-----------------------------------

             Summary: Delta Streamer does not respect hoodie.datasource.write.drop.partition.columns config
                 Key: HUDI-4008
                 URL: https://issues.apache.org/jira/browse/HUDI-4008
             Project: Apache Hudi
          Issue Type: Bug
    Affects Versions: 0.10.1
         Environment: AWS EMR 6.5 / HUDI v0.10.1
            Reporter: Istvan Darvas


Hi Guys!

 

I have set this parameter in DeltaStreamer

    hoodie.datasource.write.drop.partition.columns=true

but parquet files which were writen by DeltaStreamer contain the partition culumns.

 

I Also have to say, SparkAPI respects this parameter. So what I wrote with spark.write that was OK

 

Darvi

 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)