You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ankur Goenka (Jira)" <ji...@apache.org> on 2021/07/15 18:13:00 UTC

[jira] [Commented] (BEAM-12442) RenameFields disregards renames in nested fields with DataflowRunner

    [ https://issues.apache.org/jira/browse/BEAM-12442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381511#comment-17381511 ] 

Ankur Goenka commented on BEAM-12442:
-------------------------------------

I see that the PR is merged.

I am moving this to 2.33

Please let me know if this is a blocker for 2.32 ASAP

> RenameFields disregards renames in nested fields with DataflowRunner
> --------------------------------------------------------------------
>
>                 Key: BEAM-12442
>                 URL: https://issues.apache.org/jira/browse/BEAM-12442
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>    Affects Versions: 2.26.0
>            Reporter: Matthew Ouyang
>            Assignee: Reuven Lax
>            Priority: P2
>             Fix For: 2.32.0
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Summary - When applying a `RenameFields` followed by BigQueryUtils.toTableRow(Row), renames on nested fields were not being applied when using DataflowRunner.  DirectRunner appeared to be fine.  This led to a failed BigQueryIO.Write.
> Expected Behaviour - (field0_1.field1_0, nestedStringField) -> field0_1.nestedStringField and successful BQ insert
> Actual Behaviour - (field0_1.field1_0, nestedStringField) -> field0_1.field1_0 and failed BQ insert because field0_1.field1_0 was not in the target BQ table
> Thread from Users mailing list - https://lists.apache.org/thread.html/rd33a6f2bd8454cf650d70795bcdbbb873f988a557133d3bdbfc56cfc%40%3Cuser.beam.apache.org%3E



--
This message was sent by Atlassian Jira
(v8.3.4#803005)