You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Matthew Ouyang <ma...@gmail.com> on 2021/06/03 19:28:02 UTC

Merging two rows

I know there is a method to merge two Beam Schemas into a new Schema.  (
https://beam.apache.org/releases/javadoc/2.26.0/org/apache/beam/sdk/schemas/SchemaUtils.html#mergeWideningNullable-org.apache.beam.sdk.schemas.Schema-org.apache.beam.sdk.schemas.Schema-
).

Is there a similar method for Beam Rows?

Re: Merging two rows

Posted by Matthew Ouyang <ma...@gmail.com>.

My original intention was to have them flattened.  If both Rows had a field
"a.b", I would have wanted the last one with "win".  I'll pull back my ask
for now because I had a specific usage in mind which now feels a bit clunky
after I thought about it.

On Thu, Jun 3, 2021 at 4:18 PM Reuven Lax <re...@google.com> wrote:

> Do you want them to be flattened, or as two subschemas of a top-level
> schema?
>
> On Thu, Jun 3, 2021 at 12:28 PM Matthew Ouyang <ma...@gmail.com>
> wrote:
>
>> I know there is a method to merge two Beam Schemas into a new Schema.  (
>> https://beam.apache.org/releases/javadoc/2.26.0/org/apache/beam/sdk/schemas/SchemaUtils.html#mergeWideningNullable-org.apache.beam.sdk.schemas.Schema-org.apache.beam.sdk.schemas.Schema-
>> ).
>>
>> Is there a similar method for Beam Rows?
>>
>

Re: Merging two rows

Posted by Reuven Lax <re...@google.com>.

Do you want them to be flattened, or as two subschemas of a top-level
schema?

On Thu, Jun 3, 2021 at 12:28 PM Matthew Ouyang <ma...@gmail.com>
wrote:

> I know there is a method to merge two Beam Schemas into a new Schema.  (
> https://beam.apache.org/releases/javadoc/2.26.0/org/apache/beam/sdk/schemas/SchemaUtils.html#mergeWideningNullable-org.apache.beam.sdk.schemas.Schema-org.apache.beam.sdk.schemas.Schema-
> ).
>
> Is there a similar method for Beam Rows?
>