You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "riteshghorse (via GitHub)" <gi...@apache.org> on 2023/05/24 15:27:13 UTC
[GitHub] [beam] riteshghorse opened a new issue, #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
riteshghorse opened a new issue, #26865:
URL: https://github.com/apache/beam/issues/26865
### What happened?
BigqueryIO Test in Go SDK fails with error:
```
java.lang.IllegalArgumentException: Triggering frequency or number of file shards can be specified only when writing an
unbounded PCollection via FILE_LOADS or STORAGE_API_WRITES, but: the collection was BOUNDED and the method was
STORAGE_WRITE_API
```
https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow_PR/34/consoleText
### Issue Failure
Failure: Test is continually failing
### Issue Priority
Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)
### Issue Components
- [ ] Component: Python SDK
- [ ] Component: Java SDK
- [X] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Samza Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] lostluck commented on issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
Posted by "lostluck (via GitHub)" <gi...@apache.org>.
lostluck commented on issue #26865:
URL: https://github.com/apache/beam/issues/26865#issuecomment-1561681378
The Go SDK's xlang BigQuery doesn't set that (intentionally), which means the defaults on the schemaIO BigQuery write is bad by default. This is an error on the Java side.
At present, the only write option is the create disposition.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] riteshghorse commented on issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
Posted by "riteshghorse (via GitHub)" <gi...@apache.org>.
riteshghorse commented on issue #26865:
URL: https://github.com/apache/beam/issues/26865#issuecomment-1562870672
Thanks Ahmed!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] riteshghorse commented on issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
Posted by "riteshghorse (via GitHub)" <gi...@apache.org>.
riteshghorse commented on issue #26865:
URL: https://github.com/apache/beam/issues/26865#issuecomment-1561837632
@ahmedabu98 can you take a look?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] riteshghorse closed issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
Posted by "riteshghorse (via GitHub)" <gi...@apache.org>.
riteshghorse closed issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
URL: https://github.com/apache/beam/issues/26865
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] ahmedabu98 commented on issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
Posted by "ahmedabu98 (via GitHub)" <gi...@apache.org>.
ahmedabu98 commented on issue #26865:
URL: https://github.com/apache/beam/issues/26865#issuecomment-1561958731
Can you point me to the test that is failing? Jenkins is down again and I can't see the results
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] ahmedabu98 commented on issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
Posted by "ahmedabu98 (via GitHub)" <gi...@apache.org>.
ahmedabu98 commented on issue #26865:
URL: https://github.com/apache/beam/issues/26865#issuecomment-1561965095
Triggering frequency should only be set with streaming pipelines, but the SchemaIO sets it indiscriminately: https://github.com/apache/beam/blob/05c5b1b5bb7b722bedb5945968bdd1d91873d29a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySchemaIOProvider.java#L195-L202
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] riteshghorse commented on issue #26865: [Failing Test]: beam_PostCommit_XVR_GoUsingJava_Dataflow_PR
Posted by "riteshghorse (via GitHub)" <gi...@apache.org>.
riteshghorse commented on issue #26865:
URL: https://github.com/apache/beam/issues/26865#issuecomment-1561371228
@lostluck @chamikaramj
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org