You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2020/11/09 21:53:00 UTC
[jira] [Updated] (BEAM-11159) Use official GCP client in
TestPubsub/TestPubsubSignal
[ https://issues.apache.org/jira/browse/BEAM-11159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brian Hulette updated BEAM-11159:
---------------------------------
Summary: Use official GCP client in TestPubsub/TestPubsubSignal (was: Consider using official GCP client in TestPubsub)
> Use official GCP client in TestPubsub/TestPubsubSignal
> ------------------------------------------------------
>
> Key: BEAM-11159
> URL: https://issues.apache.org/jira/browse/BEAM-11159
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql, sdk-java-core
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> TestPubsub currently uses Beam's custom PubSub client, which occasionally leads to flaky failures due to requests that timed out or could be retried, e.g.:
> {code}
> 1) failNotFound_matchingDCSchema_sendsMessages(com.google.cloud.dataflow.sqllauncher.PubsubWriteIT)
> io.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: Deadline expired before operation could complete.
> at io.grpc.stub.ClientCalls.toStatusRuntimeException(ClientCalls.java:240)
> at io.grpc.stub.ClientCalls.getUnchecked(ClientCalls.java:221)
> at io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:140)
> at com.google.pubsub.v1.SubscriberGrpc$SubscriberBlockingStub.createSubscription(SubscriberGrpc.java:1674)
> at org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient.createSubscription(PubsubGrpcClient.java:352)
> at org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.createRandomSubscription(PubsubClient.java:429)
> at org.apache.beam.sdk.io.gcp.pubsub.TestPubsub.initializePubsub(TestPubsub.java:123)
> at org.apache.beam.sdk.io.gcp.pubsub.TestPubsub.access$200(TestPubsub.java:57)
> at org.apache.beam.sdk.io.gcp.pubsub.TestPubsub$1.evaluate(TestPubsub.java:102)
> at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:266)
> at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:305)
> {code}
> We should look into using the GCP client instead which should have better tuned timeouts and retry policies by default.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)