You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by GitBox <gi...@apache.org> on 2020/03/10 19:20:05 UTC

[GitHub] [beam] suztomo opened a new pull request #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

suztomo opened a new pull request #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095
 
 
   Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1.
   
   The old version 1.83.0 is not compatible with the latest `google-cloud-pubsub:1.103.0` ([diagnosis](https://gist.github.com/suztomo/6fbe1a30692bf2205553e6179b34fd12)).
   
   # Linkage Checker Result
   No difference in Linkage Checker output ([log](https://gist.github.com/suztomo/3178f298bd315e2cc3897b5528a961b8)).
   
   ------------------------
   
   Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
   
    - [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`).
    - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
    - [ ] Update `CHANGES.md` with noteworthy changes.
    - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier).
   
   Post-Commit Tests Status (on master branch)
   ------------------------------------------------------------------------------------------------
   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/)
   Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java11/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java11/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/)
   Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Python35_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python35_VR_Flink/lastCompletedBuild/) | --- | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/lastCompletedBuild/)
   XLang | --- | --- | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_XVR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_XVR_Flink/lastCompletedBuild/) | --- | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_XVR_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_XVR_Spark/lastCompletedBuild/)
   
   Pre-Commit Tests Status (on master branch)
   ------------------------------------------------------------------------------------------------
   
   --- |Java | Python | Go | Website
   --- | --- | --- | --- | ---
   Non-portable | [![Build Status](https://builds.apache.org/job/beam_PreCommit_Java_Cron/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PreCommit_Java_Cron/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PreCommit_Python_Cron/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PreCommit_Python_Cron/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PreCommit_PythonLint_Cron/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PreCommit_PythonLint_Cron/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PreCommit_Go_Cron/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PreCommit_Go_Cron/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PreCommit_Website_Cron/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PreCommit_Website_Cron/lastCompletedBuild/) 
   Portable | --- | [![Build Status](https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/lastCompletedBuild/) | --- | ---
   
   See [.test-infra/jenkins/README](https://github.com/apache/beam/blob/master/.test-infra/jenkins/README.md) for trigger phrase, status and link of all Jenkins jobs.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597268990
 
 
   Run SQL Postcommit

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597389463
 
 
   Run Java PreCommit

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597268901
 
 
   Run Spark ValidatesRunner

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597268741
 
 
   Run BigQueryIO Streaming Performance Test Java

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] lukecwik merged pull request #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
lukecwik merged pull request #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597268664
 
 
   Run Java HadoopFormatIO Performance Test

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597268821
 
 
   Run Dataflow ValidatesRunner

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597270665
 
 
   @aaltay Thank you.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597431279
 
 
   R: @lukecwik 
   22 successful checks!
   
   @aaltay Thank you.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597268466
 
 
   Run Java PostCommit

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597305282
 
 
   Run Java PreCommit

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597305065
 
 
   Java Precommit failed:
   
   ```
   org.apache.beam.sdk.io.mongodb.MongoDbIOTest.testReadWithAggregate
   
   java.lang.AssertionError: Count/Flatten.PCollections.out: 
   Expected: <300L>
        but: was <91L>
   ```
   
   The same error happened in another PR (which is irrelevant to Mongo): https://builds.apache.org/job/beam_PreCommit_Java_Phrase/1831/ . Therefore, it's a transient error.
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [beam] suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1

Posted by GitBox <gi...@apache.org>.
suztomo commented on issue #11095: [BEAM-8681] Upgrading grpc-google-cloud-pubsub-v1 to 1.85.1
URL: https://github.com/apache/beam/pull/11095#issuecomment-597386018
 
 
   Read time out in [Java Precommit](https://builds.apache.org/job/beam_PreCommit_Java_Phrase/1845/console)
   
   ```
   16:48:28 Could not determine the dependencies of task ':sdks:java:io:file-based-io-tests:analyzeTestClassesDependencies'.
   16:48:28 > Could not resolve all dependencies for configuration ':sdks:java:io:file-based-io-tests:testCompile'.
   16:48:28    > Could not resolve net.minidev:json-smart:[1.3.1,2.3].
   16:48:28      Required by:
   16:48:28          project :sdks:java:io:file-based-io-tests > org.apache.hadoop:hadoop-client:2.8.5 > org.apache.hadoop:hadoop-common:2.8.5 > org.apache.hadoop:hadoop-auth:2.8.5 > com.nimbusds:nimbus-jose-jwt:4.41.1
   16:48:28       > Could not resolve net.minidev:json-smart:2.3-SNAPSHOT.
   16:48:28          > Unable to load Maven meta-data from https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/2.3-SNAPSHOT/maven-metadata.xml.
   16:48:28             > Could not get resource 'https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/2.3-SNAPSHOT/maven-metadata.xml'.
   16:48:28                > Could not GET 'https://oss.sonatype.org/content/repositories/staging/net/minidev/json-smart/2.3-SNAPSHOT/maven-metadata.xml'.
   16:48:28                   > Read timed out
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services