You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/07/09 01:10:38 UTC
[jira] [Work logged] (BEAM-9502) SchemaCoder assigns random UUID,
causes Dataflow's compatibility check to fail
[ https://issues.apache.org/jira/browse/BEAM-9502?focusedWorklogId=456372&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-456372 ]
ASF GitHub Bot logged work on BEAM-9502:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jul/20 00:42
Start Date: 09/Jul/20 00:42
Worklog Time Spent: 10m
Work Description: apalmercari commented on pull request #11447:
URL: https://github.com/apache/beam/pull/11447#issuecomment-655829440
What changes are required to make it compatible with the dataflow runner update operation.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 456372)
Time Spent: 1h 50m (was: 1h 40m)
> SchemaCoder assigns random UUID, causes Dataflow's compatibility check to fail
> ------------------------------------------------------------------------------
>
> Key: BEAM-9502
> URL: https://issues.apache.org/jira/browse/BEAM-9502
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow, sdk-java-core
> Reporter: Yaron Neuman
> Priority: P3
> Labels: stale-assigned
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> After fe4b7794, _Schema.equals_ comparing only the UUIDs for faster comparison.
> After 0b3b18c6 _SchemaCoder_ forcing random UUID when schema.uuid is null.
> thus, when trying to update (--update) a Dataflow job with row schemas in user-code, the compatibility check will fail because SchemaCoder produce another random UUID.
>
> The user can set the UUID after creating the Schema, but not with Schema.Builder
> and I'm afraid most users, that are not aware to the internal implementation, won't do that.
>
> In my branch, I added _.withUUID_ and _.withRandomUUID_ to _Schema.Builder_
> But I think a better solution will be to calculate the UUID based on the schema itself.
> any thoughts?
> [~reuvenlax]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)