You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/05 00:32:09 UTC
[GitHub] [beam] damccorm opened a new issue, #21625: Data type and conversions are stricter for BQ sinks
damccorm opened a new issue, #21625:
URL: https://github.com/apache/beam/issues/21625
From [https://github.com/apache/beam/pull/17404](https://github.com/apache/beam/pull/17404), it seems like the timestamp conversion has been made stricter, such that the pipeline only accepts timestamps in the form “2022-05-09T18:04:59Z”.
Here are some formats that previously worked, but seem to no longer be accepted:
“2022-05-09 18:04:59”
“2022-05-09T18:04:59”
“2022-05-09T18:04:59.739-07:00”
Also from the same pull request, it seems to no longer accept integers in fields marked as floats
Unexpected value :0, type: class java.lang.Integer. Table field name: a, type: FLOAT64
Are these the desired behaviors? It’s different from the behavior I’ve observed when using the Streaming Inserts method.
Imported from Jira [BEAM-14528](https://issues.apache.org/jira/browse/BEAM-14528). Original Jira may contain additional context.
Reported by: kkgcp.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] reuvenlax commented on issue #21625: Data type and conversions are stricter for BQ sinks
Posted by GitBox <gi...@apache.org>.
reuvenlax commented on issue #21625:
URL: https://github.com/apache/beam/issues/21625#issuecomment-1156781222
@yirutang I believe your fixes for this are already merged, correct?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21625: Data type and conversions are stricter for BQ sinks
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21625:
URL: https://github.com/apache/beam/issues/21625#issuecomment-1155268116
The integer issue is also filed as #21693 which was fixed by #17779. This seems like an important quick fix to accept standard date formats. @reuvenlax @yirutang
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] kennknowles commented on issue #21625: Data type and conversions are stricter for BQ sinks
Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21625:
URL: https://github.com/apache/beam/issues/21625#issuecomment-1155269297
Is this a regression for existing pipelines, or is it a failure of the upgrade path to the new BQ APIs?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pabloem closed issue #21625: Data type and conversions are stricter for BQ sinks
Posted by GitBox <gi...@apache.org>.
pabloem closed issue #21625: Data type and conversions are stricter for BQ sinks
URL: https://github.com/apache/beam/issues/21625
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21625: Data type and conversions are stricter for BQ sinks
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21625:
URL: https://github.com/apache/beam/issues/21625#issuecomment-1146713748
Unable to assign user @yirutang. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] reuvenlax commented on issue #21625: Data type and conversions are stricter for BQ sinks
Posted by GitBox <gi...@apache.org>.
reuvenlax commented on issue #21625:
URL: https://github.com/apache/beam/issues/21625#issuecomment-1156782696
AFAICT this was fixed by https://github.com/apache/beam/pull/17778, which has already been merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org