You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/19 10:37:44 UTC

[GitHub] [hudi] lowmmrfeeder commented on issue #5189: [SUPPORT] Multiple chaining of hudi tables via incremental source results in duplicate partition meta column

lowmmrfeeder commented on issue #5189:
URL: https://github.com/apache/hudi/issues/5189#issuecomment-1102487837

   @harsh1231 I am not sure of this, we aren't using columnname `_hoodie_partition_path` anywhere explicitly. 
   My guess is deltastreamer adds this column `_hoodie_partition_path` in 1st transformed table. On chaining a tranformation it tries adding it again 2nd time without removing the original column as we can read it in here https://github.com/apache/hudi/blob/b28f0d6ceb7750075be82b7bd4160a4475801159/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/HoodieIncrSource.java#L176. I haven't gone in depth, so I might be wrong.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org