You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/05/04 20:16:00 UTC

[jira] [Closed] (HUDI-4008) Delta Streamer does not respect hoodie.datasource.write.drop.partition.columns config

     [ https://issues.apache.org/jira/browse/HUDI-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Kudinkin closed HUDI-4008.
---------------------------------
    Fix Version/s: 0.11.0
       Resolution: Duplicate

> Delta Streamer does not respect hoodie.datasource.write.drop.partition.columns config
> -------------------------------------------------------------------------------------
>
>                 Key: HUDI-4008
>                 URL: https://issues.apache.org/jira/browse/HUDI-4008
>             Project: Apache Hudi
>          Issue Type: Bug
>    Affects Versions: 0.10.1
>         Environment: AWS EMR 6.5 / HUDI v0.10.1
>            Reporter: Istvan Darvas
>            Priority: Major
>             Fix For: 0.11.0
>
>
> Hi Guys!
>  
> I have set this parameter in DeltaStreamer
>     hoodie.datasource.write.drop.partition.columns=true
> but parquet files which were writen by DeltaStreamer contain the partition culumns.
>  
> I Also have to say, SparkAPI respects this parameter. So what I wrote with spark.write that was OK
>  
> Darvi
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)