You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/10 17:12:59 UTC

[GitHub] [beam] lostluck commented on pull request #16818: [BEAM-13806] Add x-lang BigQuery IO integration test to Go SDK.

lostluck commented on PR #16818:
URL: https://github.com/apache/beam/pull/16818#issuecomment-1152571797

   Is this the error @robertwb ran into? Missing ProjectID?
   
   ```
   :39:18 --- FAIL: TestBigQueryIO_BasicWriteRead (418.27s)
   00:39:18 panic: 	tried cross-language for beam:transform:org.apache.beam:schemaio_bigquery_read:v1 against localhost:37821 and failed
   00:39:18 	expanding external transform
   00:39:18 	expanding transform with ExpansionRequest: components:{environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_bigquery_read:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$3fc24beb-ef0b-4fd0-b491-64340b33ca1e\x12k\x03\x01\x04\x00f\x04\x01\rbSELECT * FROM `apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1654844426145960792`"} environment_id:"go"} namespace:"fPIRkaLpTJ"
   00:39:18 expansion failed
   00:39:18 	caused by:
   00:39:18 org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaRetrievalException: Exception while trying to retrieve schema of query
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQueryQuerySourceDef.getBeamSchema(BigQueryQuerySourceDef.java:179)
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.expand(BigQueryIO.java:1222)
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.expand(BigQueryIO.java:743)
   00:39:18 	at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
   00:39:18 	at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:482)
   00:39:18 	at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:44)
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$1.expand(BigQuerySchemaIOProvider.java:183)
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQuerySchemaIOProvider$BigQuerySchemaIO$1.expand(BigQuerySchemaIOProvider.java:165)
   00:39:18 	at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
   00:39:18 	at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
   00:39:18 	at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:396)
   00:39:18 	at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:515)
   00:39:18 	at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:595)
   00:39:18 	at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:220)
   00:39:18 	at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
   00:39:18 	at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:340)
   00:39:18 	at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
   00:39:18 	at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
   00:39:18 	at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
   00:39:18 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   00:39:18 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   00:39:18 	at java.lang.Thread.run(Thread.java:748)
   00:39:18 Caused by: java.lang.NullPointerException: Required parameter projectId must be specified.
   00:39:18 	at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:907)
   00:39:18 	at com.google.api.client.util.Preconditions.checkNotNull(Preconditions.java:138)
   00:39:18 	at com.google.api.services.bigquery.Bigquery$Jobs$Insert.<init>(Bigquery.java:1737)
   00:39:18 	at com.google.api.services.bigquery.Bigquery$Jobs.insert(Bigquery.java:1687)
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:473)
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQueryQueryHelper.dryRunQueryIfNeeded(BigQueryQueryHelper.java:73)
   00:39:18 	at org.apache.beam.sdk.io.gcp.bigquery.BigQueryQuerySourceDef.getBeamSchema(BigQueryQuerySourceDef.java:168)
   00:39:18 	... 21 more
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org