You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/05/06 12:06:45 UTC
Build failed in Jenkins: beam_Dependency_Check #197
See <https://builds.apache.org/job/beam_Dependency_Check/197/display/redirect?page=changes>
Changes:
[ttanay100] withNumFileShards must be used when using withTriggeringFrequency
[juta.staes] [BEAM-6769] write bytes to bigquery in python 2
[ehudm] [BEAM-7062] Fix pydoc for @retry.with_exponential_backoff
[ehudm] Make utility functions private ...
[robertwb] Allow inference of CombiningValueState coders.
[robert] Avoid depending on context formating in hooks_test
[robertwb] [BEAM-7157] Allow creation of BinaryCombineFn from lambdas.
[valentyn] Adds a possibility to pass a project that hosts Cloud Spanner instance
[iemejia] [BEAM-5311] Delete docker build images
[ehudm] Python Datastore IO using google-cloud-datastore
[ajamato] Update dataflow container version to beam-master-20190426
[daniel.o.programmer] [BEAM-7087] Updating Go SDK errors in base beam directory
[daniel.o.programmer] [BEAM-7087] Moving "errors" package to its own subdirectory.
[iemejia] [BEAM-6526] Add ReadFiles and ParseFiles transforms for AvroIO
[relax] Ensure that all nested schemas are given ids, and fix bug where nullable
[thw] [BEAM-7112] Timer race with state cleanup - take two
[robertwb] fixup
[mxm] [BEAM-7170] Fix exception when retrieving ExpansionServer port after
[aromanenko.dev] [BEAM-6850] Use HadoopFormatIOIT for perfomance/integration testing
[chamikara] Updates Dataflow runner to support external ParDos.
[kedin] [BEAM-7072][SQL][Nexmark] Disable Query5
[daniel.o.programmer] [BEAM-7087] Updating Go SDK errors (Part 1)
[daniel.o.programmer] [BEAM-7178] Adding simple package comment to Go "errors" package.
[juta.staes] [BEAM-6621][BEAM-6624] add direct runner and dataflow runner it test
[ajamato] [BEAM-4374] Emit SampledByteCount distribution tuple system metric from
[pabloem] Support the newest version of httplib2 (#8263)
[github] Add clarifying comment for MonitoringInfoLabel usage.
[lcwik] [BEAM-3344] Changes for serialize/deserialize PipelineOptions via
[amaliujia] [BEAM-7166] Add more checks on join condition.
[kcweaver] [BEAM-7176] don't reuse Spark context in tests (causes OOM)
[25622840+adude3141] [BEAM-6859] align teardown with setup calls also for empty streaming
[25622840+adude3141] [BEAM-7193] ParDoLifecycleTest: remove duplicated inner class
[github] Revert "[BEAM-5709] Changing sleeps to CountdownLatch in test"
[chamikara] Bumps down the httplib2 version since it conflicts with
[ehudm] Add pip check invocations to all tox environments.
[iemejia] [BEAM-6526] Remove unneeded methods in AvroIO ReadFiles and ParseFiles
[iemejia] [BEAM-6526] Refactor AvroIO Read/Parse to use FileIO +
[iemejia] [BEAM-6526] Add populateDisplayData on AvroIO.ReadFiles
[iemejia] [BEAM-7196] Add Display Data to FileIO Match/MatchAll
[lcwik] [BEAM-6669] Set Dataflow KMS key name (#8296)
[migryz] FnApiMonitoringInfoToCounterUpdateTranformer with User counters
[leo.unc] Use TFRecord to store intermediate cache results using PCollection's
[migryz] Downgrade logging level to avoid log spam
[kcweaver] [BEAM-7201] Go README: update task name
[lcwik] [BEAM-7179] Correct file extension (#8434)
[pabloem] Fixing fileio tests for windows
[iemejia] [BEAM-6605] Deprecate TextIO.readAll and TextIO.ReadAll transform
[iemejia] [BEAM-6605] Refactor TextIO.Read and its Tests to use FileIO + ReadFiles
[iemejia] [BEAM-6606] Deprecate AvroIO ReadAll and ParseAll transforms
[iemejia] [BEAM-7205] Remove MongoDb withKeepAlive configuration
[mxm] [BEAM-7171] Ensure bundle finalization during Flink checkpoint
[mxm] [website] Link design document on cross-language and legacy IO
[aromanenko.dev] [BEAM-6850] Add metrics collectioning to HadoopFormatIOIT
[iemejia] [BEAM-7211] Implement HasDefaultTracker interface in ByteKeyRange
[yoshiki.obata] [BEAM-7137] encode header to bytes when writing to file at
[ehudm] Update Dataflow BEAM_CONTAINER_VERSION
[yifanzou] [BEAM-7213] fix beam_PostRelease_NightlySnapshot
[relax] Fix non-determistic row access
[daniel.o.programmer] [BEAM-7154] Updating Go SDK errors (Part 2)
[bhulette] Move schema assignment onto Create builder
[yifanzou] [BEAM-7202] fix inventory jobs
[github] Adding documentation to DirectRunner functions. (#8464)
[angoenka] Update beam_fn_api.proto to specify allowed split points. (#8476)
[aromanenko.dev] [BEAM-6247] Remove deprecated module “hadoop-input-format”
[mxm] [BEAM-7192] Fix partitioning of buffered elements during checkpointing
[github] Update setup.py for pyarrow
[robert] fix format string errors with errors package.
[robert] Update Go protos.
[heejong] [BEAM-7102] Adding `jar_packages` experiment option for Python SDK
[iemejia] Refine Spark ValidatesRunner exclusions
[pabloem] [BEAM-2939] Initial SyntheticSDF as Source and add an Synthetic pipeline
[kcweaver] [BEAM-6966] Spark portable runner: translate READ
[iemejia] [BEAM-7227] Instantiate PipelineRunner from options to support other
[iemejia] Categorize missing unbounded NeedsRunner tests in sdks/java/core
------------------------------------------
[...truncated 10.23 KB...]
- com.google.cloud:google-cloud-core:1.61.0
- com.google.cloud:google-cloud-core-grpc:1.61.0
- com.google.cloud.dataflow:google-cloud-dataflow-java-proto-library-all:0.5.160304
- com.google.cloud:google-cloud-spanner:1.6.0
- com.google.http-client:google-http-client:1.27.0
- com.google.http-client:google-http-client-jackson:1.27.0
- com.google.http-client:google-http-client-jackson2:1.27.0
- io.grpc:grpc-all:1.17.1
- com.google.api.grpc:grpc-google-cloud-bigtable-v2:0.44.0
- com.google.api.grpc:grpc-google-cloud-datacatalog-v1beta1:0.1.0-alpha
- com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.43.0
- com.google.guava:guava-testlib:20.0
- org.apache.hadoop:hadoop-client:2.7.3
- org.apache.hadoop:hadoop-common:2.7.3
- org.apache.hadoop:hadoop-hdfs:2.7.3
- org.apache.hadoop:hadoop-mapreduce-client-core:2.7.3
- org.apache.hadoop:hadoop-minicluster:2.7.3
- org.hamcrest:hamcrest-core:2.1
- org.hamcrest:hamcrest-library:2.1
- org.fusesource.hawtbuf:hawtbuf:1.11
- org.apache.httpcomponents:httpasyncclient:4.1.4
- com.fasterxml.jackson.core:jackson-annotations:2.9.8
- com.fasterxml.jackson.core:jackson-core:2.9.8
- com.fasterxml.jackson.core:jackson-databind:2.9.8
- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:2.9.8
- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:2.9.8
- com.fasterxml.jackson.datatype:jackson-datatype-joda:2.9.8
- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:2.9.8
- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.9.8
- javax.xml.bind:jaxb-api:2.2.12
- net.jcip:jcip-annotations:1.0
- joda-time:joda-time:2.10.1
- com.jayway.jsonpath:json-path:2.4.0
- com.google.code.findbugs:jsr305:3.0.2
- com.pholser:junit-quickcheck-core:0.8
- org.apache.kafka:kafka-clients:1.0.0
- org.apache.kafka:kafka_2.11:1.0.0
- org.apache.kudu:kudu-client:1.9.0
- org.apache.logging.log4j:log4j-api:2.6.2
- org.apache.logging.log4j:log4j-core:2.6.2
- org.apache.apex:malhar-library:3.4.0
- org.mockito:mockito-core:1.10.19
- org.fusesource.mqtt-client:mqtt-client:1.15
- io.netty:netty-handler:4.1.30.Final
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin:0.4.0
- org.sonarqube:org.sonarqube.gradle.plugin:2.7
- org.postgresql:postgresql:42.2.2
- org.powermock:powermock-mockito-release-full:1.6.4
- com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.44.0
- com.google.api.grpc:proto-google-cloud-datacatalog-v1beta1:0.1.0-alpha
- com.google.api.grpc:proto-google-cloud-datastore-v1:0.44.0
- com.google.api.grpc:proto-google-cloud-pubsub-v1:1.43.0
- com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.6.0
- org.apache.samza:samza-api:1.1.0
- org.apache.samza:samza-core_2.11:1.1.0
- org.apache.samza:samza-kafka_2.11:1.1.0
- org.apache.samza:samza-kv-inmemory_2.11:1.1.0
- org.apache.samza:samza-kv-rocksdb_2.11:1.1.0
- org.apache.samza:samza-kv_2.11:1.1.0
- org.apache.samza:samza-yarn_2.11:1.1.0
- org.slf4j:slf4j-simple:1.7.25
- org.xerial.snappy:snappy-java:1.1.4
- org.apache.spark:spark-core_2.11:2.4.2
- org.apache.spark:spark-network-common_2.11:2.4.2
- org.apache.spark:spark-streaming_2.11:2.4.2
- org.codehaus.woodstox:stax2-api:3.1.4
- com.tdunning:t-digest:3.2
- org.apache.tika:tika-core:1.20
- org.apache.tika:tika-parsers:1.20
- com.google.cloud.bigdataoss:util:1.9.16
- org.codehaus.woodstox:woodstox-core-asl:4.4.1
- org.tukaani:xz:1.8
- com.github.luben:zstd-jni:1.3.8-3
The following dependencies have later release versions:
- com.rabbitmq:amqp-client [4.9.3 -> 5.7.0]
- org.assertj:assertj-core [3.11.1 -> 3.12.2]
- com.google.auto.service:auto-service [1.0-rc2 -> 1.0-rc5]
- com.google.auto.value:auto-value [1.6.3 -> 1.6.5]
- com.google.auto.value:auto-value-annotations [1.6.3 -> 1.6.5]
- org.apache.calcite.avatica:avatica-core [1.13.0 -> 1.14.0]
- biz.aQute:bndlib [1.43.0 -> 2.0.0.20130123-133441]
- org.apache.cassandra:cassandra-all [3.11.3 -> 3.11.4]
- org.testcontainers:clickhouse [1.10.5 -> 1.11.2]
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.1.52]
- com.github.ben-manes.versions:com.github.ben-manes.versions.gradle.plugin [0.17.0 -> 0.21.0]
- com.gradle.build-scan:com.gradle.build-scan.gradle.plugin [2.1 -> 2.3]
- commons-cli:commons-cli [1.2 -> 1.4]
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.0.12]
- com.typesafe:config [1.3.0 -> 1.3.4]
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.1.0]
- org.apache.derby:derby [10.14.2.0 -> 10.15.1.3]
- org.apache.derby:derbyclient [10.14.2.0 -> 10.15.1.3]
- org.apache.derby:derbynet [10.14.2.0 -> 10.15.1.3]
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.14.6]
- org.elasticsearch:elasticsearch [2.4.1 -> 7.0.1]
- org.elasticsearch:elasticsearch [5.0.0 -> 7.0.1]
- org.elasticsearch:elasticsearch [5.6.3 -> 7.0.1]
- org.elasticsearch:elasticsearch [6.4.0 -> 7.0.1]
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.0.1]
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.0.1]
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.0.1]
- com.google.errorprone:error_prone_annotations [2.0.15 -> 2.3.3]
- com.google.errorprone:error_prone_annotations [2.1.2 -> 2.3.3]
- com.alibaba:fastjson [1.2.49 -> 1.2.58]
- org.apache.flink:flink-clients_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-clients_2.11 [1.6.2 -> 1.8.0]
- org.apache.flink:flink-clients_2.11 [1.7.1 -> 1.8.0]
- org.apache.flink:flink-core [1.5.6 -> 1.8.0]
- org.apache.flink:flink-core [1.6.2 -> 1.8.0]
- org.apache.flink:flink-core [1.7.1 -> 1.8.0]
- org.apache.flink:flink-java [1.5.6 -> 1.8.0]
- org.apache.flink:flink-java [1.6.2 -> 1.8.0]
- org.apache.flink:flink-java [1.7.1 -> 1.8.0]
- org.apache.flink:flink-metrics-core [1.5.6 -> 1.8.0]
- org.apache.flink:flink-metrics-core [1.6.2 -> 1.8.0]
- org.apache.flink:flink-metrics-core [1.7.1 -> 1.8.0]
- org.apache.flink:flink-runtime_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-runtime_2.11 [1.6.2 -> 1.8.0]
- org.apache.flink:flink-runtime_2.11 [1.7.1 -> 1.8.0]
- org.apache.flink:flink-streaming-java_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-streaming-java_2.11 [1.6.2 -> 1.8.0]
- org.apache.flink:flink-streaming-java_2.11 [1.7.1 -> 1.8.0]
- org.apache.flink:flink-test-utils_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-test-utils_2.11 [1.6.2 -> 1.8.0]
- org.apache.flink:flink-test-utils_2.11 [1.7.1 -> 1.8.0]
- org.elasticsearch.test:framework [5.6.3 -> 7.0.1]
- org.elasticsearch.test:framework [6.4.0 -> 7.0.1]
- com.google.auth:google-auth-library-credentials [0.10.0 -> 0.15.0]
- com.google.auth:google-auth-library-credentials [0.12.0 -> 0.15.0]
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.0-alpha-4]
- io.grpc:grpc-auth [1.13.1 -> 1.20.0]
- io.grpc:grpc-auth [1.17.1 -> 1.20.0]
- io.grpc:grpc-context [1.13.1 -> 1.20.0]
- io.grpc:grpc-core [1.13.1 -> 1.20.0]
- io.grpc:grpc-core [1.17.1 -> 1.20.0]
- io.grpc:grpc-netty [1.13.1 -> 1.20.0]
- io.grpc:grpc-netty [1.17.1 -> 1.20.0]
- io.grpc:grpc-protobuf [1.13.1 -> 1.20.0]
- io.grpc:grpc-stub [1.13.1 -> 1.20.0]
- io.grpc:grpc-stub [1.17.1 -> 1.20.0]
- io.grpc:grpc-testing [1.13.1 -> 1.20.0]
- com.google.code.gson:gson [2.7 -> 2.8.5]
- com.google.guava:guava [20.0 -> 27.1-jre]
- org.apache.hbase:hbase-common [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-hadoop-compat [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-hadoop2-compat [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-server [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-shaded-client [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-shaded-server [1.2.6 -> 2.0.0-alpha2]
- org.apache.hive:hive-cli [2.1.0 -> 3.1.1]
- org.apache.hive:hive-common [2.1.0 -> 3.1.1]
- org.apache.hive:hive-exec [2.1.0 -> 3.1.1]
- org.apache.hive.hcatalog:hive-hcatalog-core [2.1.0 -> 3.1.1]
- org.apache.httpcomponents:httpclient [4.5.6 -> 4.5.8]
- org.apache.httpcomponents:httpcore [4.4.10 -> 4.4.11]
- org.apache.httpcomponents:httpcore-nio [4.4.10 -> 4.4.11]
- org.codehaus.janino:janino [3.0.11 -> 3.0.12]
- net.java.dev.javacc:javacc [4.0 -> 7.0.4]
- javax.servlet:javax.servlet-api [3.1.0 -> 4.0.1]
- org.slf4j:jcl-over-slf4j [1.7.25 -> 1.8.0-beta4]
- redis.clients:jedis [3.0.1 -> 3.1.0-m1]
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 9.4.18.v20190429]
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 9.4.18.v20190429]
- jline:jline [2.14.6 -> 3.0.0.M1]
- net.java.dev.jna:jna [4.1.0 -> 5.3.1]
- junit:junit [4.13-beta-1 -> 4.13-beta-3]
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.31]
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.31]
- com.esotericsoftware:kryo [4.0.2 -> 5.0.0-RC4]
- com.esotericsoftware.kryo:kryo [2.21 -> 2.24.0]
- io.dropwizard.metrics:metrics-core [3.1.2 -> 4.1.0]
- org.mongodb:mongo-java-driver [3.9.1 -> 3.11.0-beta2]
- net.researchgate.release:net.researchgate.release.gradle.plugin [2.6.0 -> 2.8.0]
- io.netty:netty-all [4.1.17.Final -> 5.0.0.Alpha2]
- io.netty:netty-all [4.1.30.Final -> 5.0.0.Alpha2]
- io.netty:netty-tcnative-boringssl-static [2.0.17.Final -> 2.0.25.Final]
- io.netty:netty-tcnative-boringssl-static [2.0.8.Final -> 2.0.25.Final]
- io.netty:netty-transport-native-epoll [4.1.25.Final -> 5.0.0.Alpha2]
- io.netty:netty-transport-native-epoll [4.1.30.Final -> 5.0.0.Alpha2]
- io.opencensus:opencensus-api [0.12.3 -> 0.21.0]
- io.opencensus:opencensus-contrib-grpc-metrics [0.12.3 -> 0.21.0]
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 -> 1.3.31]
- org.apache.parquet:parquet-avro [1.10.0 -> 1.10.1]
- org.apache.parquet:parquet-common [1.10.0 -> 1.10.1]
- org.apache.parquet:parquet-hadoop [1.10.0 -> 1.10.1]
- com.google.api.grpc:proto-google-common-protos [1.12.0 -> 1.16.0]
- com.google.protobuf:protobuf-java [3.6.0 -> 3.8.0-rc-1]
- com.google.protobuf:protobuf-java-util [3.6.0 -> 3.8.0-rc-1]
- com.google.protobuf:protoc [3.6.0 -> 3.8.0-rc-1]
- io.grpc:protoc-gen-grpc-java [1.13.1 -> 1.20.0]
- org.apache.qpid:proton-j [0.13.1 -> 0.33.0]
- org.apache.qpid:qpid-broker [0.28 -> 7.1.2]
- org.apache.qpid:qpid-broker-core [0.28 -> 7.1.2]
- com.carrotsearch.randomizedtesting:randomizedtesting-runner [2.3.2 -> 2.7.2]
- com.carrotsearch.randomizedtesting:randomizedtesting-runner [2.5.0 -> 2.7.2]
- com.carrotsearch.randomizedtesting:randomizedtesting-runner [2.5.2 -> 2.7.2]
- io.findify:s3mock_2.12 [0.2.4 -> 0.2.5]
- org.scala-lang:scala-library [2.11.8 -> 2.13.0-RC1]
- org.scala-lang:scala-library [2.12.7 -> 2.13.0-RC1]
- org.slf4j:slf4j-api [1.7.25 -> 1.8.0-beta4]
- org.slf4j:slf4j-jdk14 [1.7.25 -> 1.8.0-beta4]
- org.apache.solr:solr-core [5.5.4 -> 8.0.0]
- org.apache.solr:solr-solrj [5.5.4 -> 8.0.0]
- org.apache.solr:solr-test-framework [5.5.4 -> 8.0.0]
- com.github.spotbugs:spotbugs-annotations [3.1.11 -> 4.0.0-beta1]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.1.6.RELEASE]
- sqlline:sqlline [1.4.0 -> 1.7.0]
- com.clearspring.analytics:stream [2.9.5 -> 2.9.6]
- org.elasticsearch.client:transport [5.0.0 -> 7.0.1]
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.0.1]
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.0.1]
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.0.1]
- org.apache.zookeeper:zookeeper [3.4.11 -> 3.5.4-beta]
Generated report file build/dependencyUpdates/report.txt
> Task :beam-sdks-python:dependencyUpdates FAILED
# Virtualenv for the rest of the script to run setup
/usr/bin/virtualenv sdks/python
./scripts/run_dependency_check.sh: line 24: /usr/bin/virtualenv: No such file or directory
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'> line: 362
* What went wrong:
Execution failed for task ':beam-sdks-python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 28s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/xii73hstrmczu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Beam Dependency Check Report (2019-05-20)
Posted by Apache Jenkins Server <je...@builds.apache.org>.
ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html'
does not exist
Jenkins build is back to normal : beam_Dependency_Check #203
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_Dependency_Check/203/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_Dependency_Check #202
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_Dependency_Check/202/display/redirect?page=changes>
Changes:
[robinyqiu] Use a singleton PIPELINE_OPTION_PARAMETER in DoFnSignature.Parameter
[jiangkai] upgrade avatica to 1.14.0
[heejong] [BEAM-7220] add JavaReadViaImpulse substitution to Java expansion
[kcweaver] [BEAM-6959] Go SDK: support integration tests on Flink
[michal.walenia] [BEAM-7028] Change ParDo load test according to the proposal, add a
[juta.staes] [BEAM-7181][BEAM-7243] add streaming it tests python 3.6
[je.ik] [BEAM-7269] remove StateSpec from hashCode of SimpleStateTag
[ankurgoenka] Updating python containers to beam-master-20190509
[25622840+adude3141] [BEAM-4046] decouple gradle project names and maven artifact ids
[25622840+adude3141] [BEAM-4046] add project mappings and enable parsing of legacy commands
[daniel.o.programmer] [BEAM-7154] Updating Go SDK errors (Part 3)
[michal.walenia] [BEAM-6627] Add item and byte counters to HadoopFormatIOIT
[iemejia] [BEAM-7239] Do not close DataSource on Teardown on JdbcIO
[jkai] upgrade to avatica 1.15.0
[kedin] Small doc clean up
[kedin] [SQL] SpotlessApply for minor docs PR #8567
[melissapa] [BEAM-7281] Update Python deps page to current release
[heejong] [BEAM-7253] test_with_jar_packages_invalid_file_name test fails on
[kcweaver] [BEAM-7282] portable Spark: don't fuse already optimized graph
[lcwik] [BEAM-7283] Update aggregated javadoc versions during linking to point
[lcwik] [BEAM-7283] Build javadocs using online links for all dependencies
[altay] [BEAM-562] Add DoFn.setup and DoFn.teardown to Python SDK (#7994)
[tweise] Beam community update blogpost (#8559)
[iemejia] Fix trigger paths filters to execute precommit tests only if needed
[mxm] [BEAM-7126] Remove LengthPrefixCoder from Flink's key Coder
[mxm] [website] Update Flink Runner page for version 1.8
[mxm] Update references Dataflow to Beam in Flink Runner
[mxm] Add Coder components for BufferedElement Coder
[mxm] Remove UnboundedSocketSource from Flink Runner
[mxm] [BEAM-7271] adding UTF8 String coder to Java SDK ModelCoder
[ehudm] [BEAM-7251] Increase timeout for test BQ queries.
[kenn] Fix project dependencies in pom.xml outputs
[jozsi] Add first version of Hazelcast Jet based Java Runner
[ehudm] Add missing javadoc to BigqueryClient.java
[pabloem] [BEAM-6493] : Add cookbook and snippets examples in Kotlin (#8439)
[relax] Merge pull request #8358: Beam Kata for Java and Python SDKs
[ajamato] [BEAM-6138] Update java SDK to report user distribution tuple metrics
[25622840+adude3141] [BEAM-4046] revert test infra to be compatible with pending PRs
[25622840+adude3141] fix syntax errors in groovy files
[kcweaver] run job server on an unused port
[heejong] [BEAM-7103] Adding AvroCoderTranslator for cross-language data transfer
[github] Merge pull request #8425: [BEAM-7174] Add schema modification transforms
[jozo.vilcek] [BEAM-5865] Create optional auto-balancing sharding function for Flink
[jozo.vilcek] [BEAM-5865] Add unit tests and fix bug + changes from review
[jozo.vilcek] [BEAM-5865] Improve FlinkPipelineOptions javadoc
[robertwb] [BEAM-7121] Add deterministic proto coder (#8377)
[frederik.bode] Add Postcommit test suite for Python 3.7
[iemejia] Categorize tests from UsesTestStream to UsesTestStreamWithProcessingTime
[xinyuliu.us] [BEAM-7311] merge internal commits to beam open source trunk to prepare
[huangry] Create PAssert util function for late panes.
[robinyqiu] Simple fix: make use of Reify in Latest to replace duplicate code
[iemejia] [website] Add design doc on portable representation of schemas
[athomas1] Modified KinesisIO to use WatermarkPolicyFactory for watermark
[25622840+adude3141] [BEAM-7302] ensure artifactId set on pom also with unconfigured project
[25622840+adude3141] [BEAM-7287] Change JAVA_HOME to match new Jenkins agents (#8584)
[iemejia] [BEAM-7230] Add javadoc on provided poolable data sources on JdbcIO
[boyuanz] Add retry strategy when TableRow or TableCell is null from BQ response.
[markliu] [BEAM-7339] Make input and checksum configurable for Python WordCountIT
[github] Remove unused attemptNum
[github] [BEAM-6908] Refactor Python performance test groovy file for easy
[aromanenko.dev] [BEAM-7349] Get back to "provided" scope for "kafka_clients"
[github] Fix a typo in setting.gradle
[markliu] [BEAM-7347] Pass dpb_service_zone flag to benchmarks to fix breakage
[markliu] [BEAM-7339] Enable 1Gb input for Python wordcount benchmark
[klk] Updates python SDK GCP client API in sync with the current Google
[github] [BEAM-7275] ParDoLifeCycleTest: collect lifecycle info for DoFn insta…
[hsuryawirawan] Fix the ContainsKv assertion which at times didn't work with some JDKs
[33895511+aromanenko-dev] [BEAM-7359] Fix static analysis issues for HadoopFormatIO (#8616)
[33895511+aromanenko-dev] [BEAM-7360] Fix static analysis issues for HCatalogIO (#8617)
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-14 (beam) in workspace <https://builds.apache.org/job/beam_Dependency_Check/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4896d479ee9ace476d3efd59ba39d094c6609139 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4896d479ee9ace476d3efd59ba39d094c6609139
Commit message: "Merge pull request #8614: Fix the ContainsKv assertion that didn't work with some JDKs"
> git rev-list --no-walk a16a5b71cf8d399070a72b0f062693180d56b5ed # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_Dependency_Check/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Drevision=release :runBeamDependencyCheck
Executing
gradlew --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Drevision=release :runBeamDependencyCheck
Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy
> Task :buildSrc:spotlessGroovyCheck
> Task :buildSrc:spotlessGroovyGradle
> Task :buildSrc:spotlessGroovyGradleCheck
> Task :buildSrc:spotlessCheck
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties FROM-CACHE
> Task :buildSrc:check
> Task :buildSrc:build
Configuration on demand is an incubating feature.
> Configure project :beam-test-infra-metrics
Applying groovy nature
> Task :dependencyUpdates
------------------------------------------------------------
: Project Dependency Updates (report to plain text file)
------------------------------------------------------------
The following dependencies are using the latest release version:
- org.apache.avro:avro:1.8.2
- org.apache.beam:beam-vendor-grpc-1_13_1:0.2
- org.apache.beam:beam-vendor-guava-20_0:0.1
- com.google.errorprone:error_prone_annotations:2.0.15
- com.google.api-client:google-api-client:1.27.0
- com.google.apis:google-api-services-dataflow:v1b3-rev20190322-1.27.0
- com.google.http-client:google-http-client:1.27.0
- com.google.http-client:google-http-client-jackson:1.27.0
- com.google.guava:guava-testlib:20.0
- org.hamcrest:hamcrest-core:2.1
- org.hamcrest:hamcrest-library:2.1
- com.fasterxml.jackson.core:jackson-annotations:2.9.8
- com.fasterxml.jackson.core:jackson-core:2.9.8
- com.fasterxml.jackson.core:jackson-databind:2.9.8
- net.jcip:jcip-annotations:1.0
- joda-time:joda-time:2.10.1
- org.mockito:mockito-core:1.10.19
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin:0.4.0
- org.slf4j:slf4j-api:1.7.25
- org.slf4j:slf4j-jdk14:1.7.25
The following dependencies have later release versions:
- com.google.auto.service:auto-service [1.0-rc2 -> 1.0-rc5]
- com.google.auto.value:auto-value [1.6.3 -> 1.6.5]
- com.google.auto.value:auto-value-annotations [1.6.3 -> 1.6.5]
- com.github.ben-manes.versions:com.github.ben-manes.versions.gradle.plugin [0.17.0 -> 0.21.0]
- com.gradle.build-scan:com.gradle.build-scan.gradle.plugin [2.1 -> 2.3]
- commons-cli:commons-cli [1.2 -> 1.4]
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.1.0]
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.0-beta-1]
- javax.servlet:javax.servlet-api [3.1.0 -> 4.0.1]
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 9.4.18.v20190429]
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 9.4.18.v20190429]
- junit:junit [4.13-beta-1 -> 4.13-beta-3]
- net.researchgate.release:net.researchgate.release.gradle.plugin [2.6.0 -> 2.8.0]
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.7.1]
- com.github.spotbugs:spotbugs-annotations [3.1.11 -> 4.0.0-beta1]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates FAILED
# Virtualenv for the rest of the script to run setup
/usr/bin/virtualenv sdks/python
./scripts/run_dependency_check.sh: line 24: /usr/bin/virtualenv: No such file or directory
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'> line: 388
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 20s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/cahxfhw2y2mk2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_Dependency_Check #201
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_Dependency_Check/201/display/redirect>
------------------------------------------
[...truncated 32.82 KB...]
Collecting protobuf>=3.6.0 (from google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/81/59/c7b0815a78fd641141f24a6ece878293eae6bf1fce40632a6ab9672346aa/protobuf-3.7.1-cp35-cp35m-manylinux1_x86_64.whl
Collecting google-resumable-media>=0.3.1 (from google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/e2/5d/4bc5c28c252a62efe69ed1a1561da92bd5af8eca0cdcdf8e60354fae9b29/google_resumable_media-0.3.2-py2.py3-none-any.whl
Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl
Collecting six>=1.10.0 (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Collecting pytz (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/3d/73/fe30c2daaaa0713420d0382b16fbb761409f532c56bdcc514bf7b6262bb6/pytz-2019.1-py2.py3-none-any.whl
Requirement already satisfied, skipping upgrade: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery) (41.0.1)
Collecting requests<3.0.0dev,>=2.18.0 (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl
Collecting googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Collecting rsa>=3.1.4 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Collecting cachetools>=2.0.0 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/39/2b/d87fc2369242bd743883232c463f28205902b8579cb68dcf5b11eee1652f/cachetools-3.1.0-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.2.1 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/91/f0/b03e00ce9fddf4827c42df1c3ce10c74eadebfb706231e8d6d1c356a4062/pyasn1_modules-0.2.5-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/39/ec/d93dfc69617a028915df914339ef66936ea976ef24fa62940fd86ba0326e/urllib3-1.25.2-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting pyasn1>=0.1.3 (from rsa>=3.1.4->google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Installing collected packages: six, pyasn1, rsa, cachetools, pyasn1-modules, google-auth, pytz, protobuf, idna, urllib3, certifi, chardet, requests, googleapis-common-protos, google-api-core, google-cloud-core, google-resumable-media, google-cloud-bigquery
Successfully installed cachetools-3.1.0 certifi-2019.3.9 chardet-3.0.4 google-api-core-1.11.0 google-auth-1.6.3 google-cloud-bigquery-1.12.0 google-cloud-core-1.0.0 google-resumable-media-0.3.2 googleapis-common-protos-1.5.10 idna-2.8 protobuf-3.7.1 pyasn1-0.4.5 pyasn1-modules-0.2.5 pytz-2019.1 requests-2.22.0 rsa-4.0 six-1.12.0 urllib3-1.25.2
pip install --upgrade google-cloud-bigtable
Collecting google-cloud-bigtable
Downloading https://files.pythonhosted.org/packages/b8/d3/a4670ef8d546bee30c2fc284bd211c7ce3861ae6b4df4d5d7b6382180941/google_cloud_bigtable-0.33.0-py2.py3-none-any.whl (230kB)
Requirement already satisfied, skipping upgrade: google-api-core[grpc]<2.0.0dev,>=1.6.0 in ./dependency/check/lib/python3.5/site-packages (from google-cloud-bigtable) (1.11.0)
Collecting grpc-google-iam-v1<0.12dev,>=0.11.4 (from google-cloud-bigtable)
Requirement already satisfied, skipping upgrade: google-cloud-core<2.0dev,>=1.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-cloud-bigtable) (1.0.0)
Requirement already satisfied, skipping upgrade: six>=1.10.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (1.12.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (3.7.1)
Requirement already satisfied, skipping upgrade: googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (1.5.10)
Requirement already satisfied, skipping upgrade: requests<3.0.0dev,>=2.18.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2.22.0)
Requirement already satisfied, skipping upgrade: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (41.0.1)
Requirement already satisfied, skipping upgrade: google-auth<2.0dev,>=0.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (1.6.3)
Requirement already satisfied, skipping upgrade: pytz in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2019.1)
Collecting grpcio>=1.8.2; extra == "grpc" (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable)
Using cached https://files.pythonhosted.org/packages/87/1d/df17052784a9e19668b9ef7cb778d31ba984e4a2057be2895d1709505dff/grpcio-1.20.1-cp35-cp35m-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: idna<2.9,>=2.5 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2.8)
Requirement already satisfied, skipping upgrade: certifi>=2017.4.17 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2019.3.9)
Requirement already satisfied, skipping upgrade: chardet<3.1.0,>=3.0.2 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (3.0.4)
Requirement already satisfied, skipping upgrade: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (1.25.2)
Requirement already satisfied, skipping upgrade: cachetools>=2.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (3.1.0)
Requirement already satisfied, skipping upgrade: pyasn1-modules>=0.2.1 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (0.2.5)
Requirement already satisfied, skipping upgrade: rsa>=3.1.4 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (4.0)
Requirement already satisfied, skipping upgrade: pyasn1<0.5.0,>=0.4.1 in ./dependency/check/lib/python3.5/site-packages (from pyasn1-modules>=0.2.1->google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (0.4.5)
Installing collected packages: grpcio, grpc-google-iam-v1, google-cloud-bigtable
Successfully installed google-cloud-bigtable-0.33.0 grpc-google-iam-v1-0.11.4 grpcio-1.20.1
pip install --upgrade google-cloud-core
Requirement already up-to-date: google-cloud-core in ./dependency/check/lib/python3.5/site-packages (1.0.0)
Requirement already satisfied, skipping upgrade: google-api-core<2.0.0dev,>=1.11.0 in ./dependency/check/lib/python3.5/site-packages (from google-cloud-core) (1.11.0)
Requirement already satisfied, skipping upgrade: google-auth<2.0dev,>=0.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.6.3)
Requirement already satisfied, skipping upgrade: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (41.0.1)
Requirement already satisfied, skipping upgrade: pytz in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2019.1)
Requirement already satisfied, skipping upgrade: requests<3.0.0dev,>=2.18.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2.22.0)
Requirement already satisfied, skipping upgrade: six>=1.10.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.12.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (3.7.1)
Requirement already satisfied, skipping upgrade: googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.5.10)
Requirement already satisfied, skipping upgrade: rsa>=3.1.4 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (4.0)
Requirement already satisfied, skipping upgrade: cachetools>=2.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (3.1.0)
Requirement already satisfied, skipping upgrade: pyasn1-modules>=0.2.1 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (0.2.5)
Requirement already satisfied, skipping upgrade: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.25.2)
Requirement already satisfied, skipping upgrade: idna<2.9,>=2.5 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2.8)
Requirement already satisfied, skipping upgrade: chardet<3.1.0,>=3.0.2 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (3.0.4)
Requirement already satisfied, skipping upgrade: certifi>=2017.4.17 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2019.3.9)
Requirement already satisfied, skipping upgrade: pyasn1>=0.1.3 in ./dependency/check/lib/python3.5/site-packages (from rsa>=3.1.4->google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (0.4.5)
rm -f build/dependencyUpdates/beam-dependency-check-report.txt
# Insall packages and run the unit tests of the report generator and the jira manager
pip install mock jira pyyaml
Collecting mock
Downloading https://files.pythonhosted.org/packages/05/d2/f94e68be6b17f46d2c353564da56e6fb89ef09faeeff3313a046cb810ca9/mock-3.0.5-py2.py3-none-any.whl
Collecting jira
Downloading https://files.pythonhosted.org/packages/cb/c2/4203b6cad72d115b0ad62ae7028567b538c8933745f665d0eee5082baf67/jira-2.0.0-py2.py3-none-any.whl (57kB)
Collecting pyyaml
Downloading https://files.pythonhosted.org/packages/9f/2c/9417b5c774792634834e730932745bc09a7d36754ca00acf1ccd1ac2594d/PyYAML-5.1.tar.gz (274kB)
Requirement already satisfied: six in ./dependency/check/lib/python3.5/site-packages (from mock) (1.12.0)
Collecting defusedxml (from jira)
Downloading https://files.pythonhosted.org/packages/06/74/9b387472866358ebc08732de3da6dc48e44b0aacd2ddaa5cb85ab7e986a2/defusedxml-0.6.0-py2.py3-none-any.whl
Collecting oauthlib[signedtoken]>=1.0.0 (from jira)
Downloading https://files.pythonhosted.org/packages/16/95/699466b05b72b94a41f662dc9edf87fda4289e3602ecd42d27fcaddf7b56/oauthlib-3.0.1-py2.py3-none-any.whl (142kB)
Requirement already satisfied: setuptools>=20.10.1 in ./dependency/check/lib/python3.5/site-packages (from jira) (41.0.1)
Collecting pbr>=3.0.0 (from jira)
Using cached https://files.pythonhosted.org/packages/07/3e/22d1d35a4b51706ca3590c54359aeb5fa7ea60df46180143a3ea13d45f29/pbr-5.2.0-py2.py3-none-any.whl
Collecting requests-oauthlib>=0.6.1 (from jira)
Downloading https://files.pythonhosted.org/packages/c2/e2/9fd03d55ffb70fe51f587f20bcf407a6927eb121de86928b34d162f0b1ac/requests_oauthlib-1.2.0-py2.py3-none-any.whl
Requirement already satisfied: requests>=2.10.0 in ./dependency/check/lib/python3.5/site-packages (from jira) (2.22.0)
Collecting requests-toolbelt (from jira)
Downloading https://files.pythonhosted.org/packages/60/ef/7681134338fc097acef8d9b2f8abe0458e4d87559c689a8c306d0957ece5/requests_toolbelt-0.9.1-py2.py3-none-any.whl (54kB)
Collecting cryptography; extra == "signedtoken" (from oauthlib[signedtoken]>=1.0.0->jira)
Downloading https://files.pythonhosted.org/packages/5b/12/b0409a94dad366d98a8eee2a77678c7a73aafd8c0e4b835abea634ea3896/cryptography-2.6.1-cp34-abi3-manylinux1_x86_64.whl (2.3MB)
Collecting pyjwt>=1.0.0; extra == "signedtoken" (from oauthlib[signedtoken]>=1.0.0->jira)
Downloading https://files.pythonhosted.org/packages/87/8b/6a9f14b5f781697e51259d81657e6048fd31a113229cf346880bb7545565/PyJWT-1.7.1-py2.py3-none-any.whl
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (1.25.2)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (3.0.4)
Requirement already satisfied: certifi>=2017.4.17 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (2019.3.9)
Requirement already satisfied: idna<2.9,>=2.5 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (2.8)
Collecting asn1crypto>=0.21.0 (from cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira)
Using cached https://files.pythonhosted.org/packages/ea/cd/35485615f45f30a510576f1a56d1e0a7ad7bd8ab5ed7cdc600ef7cd06222/asn1crypto-0.24.0-py2.py3-none-any.whl
Collecting cffi!=1.11.3,>=1.8 (from cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira)
Downloading https://files.pythonhosted.org/packages/62/76/135eeffe0089e6724bdd65c1bf9f1654db9b47783e65b8d9f1454c540d8b/cffi-1.12.3-cp35-cp35m-manylinux1_x86_64.whl (429kB)
Collecting pycparser (from cffi!=1.11.3,>=1.8->cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira)
Building wheels for collected packages: pyyaml
Building wheel for pyyaml (setup.py): started
Building wheel for pyyaml (setup.py): finished with status 'done'
Stored in directory: /home/jenkins/.cache/pip/wheels/ad/56/bc/1522f864feb2a358ea6f1a92b4798d69ac783a28e80567a18b
Successfully built pyyaml
Installing collected packages: mock, defusedxml, asn1crypto, pycparser, cffi, cryptography, pyjwt, oauthlib, pbr, requests-oauthlib, requests-toolbelt, jira, pyyaml
Successfully installed asn1crypto-0.24.0 cffi-1.12.3 cryptography-2.6.1 defusedxml-0.6.0 jira-2.0.0 mock-3.0.5 oauthlib-3.0.1 pbr-5.2.0 pycparser-2.19 pyjwt-1.7.1 pyyaml-5.1 requests-oauthlib-1.2.0 requests-toolbelt-0.9.1
cd $WORKSPACE/src/.test-infra/jenkins
python -m dependency_check.dependency_check_report_generator_test
INFO:root:
Start processing: - group1:artifact1 [Release1-123 -> Release2-456]
.INFO:root:
Start processing: - group1:artifact1 [0.rc1.0 -> 0.rc2.0]
.INFO:root:Clean Up Starts
.INFO:root:
Start processing: - group1:artifact1 (1.0.0, 2.0.0)
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/.test-infra/jenkins/dependency_check/dependency_check_report_generator.py",> line 107, in prioritize_dependencies
dep_name, curr_ver, latest_ver = extract_single_dep(dep)
File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/.test-infra/jenkins/dependency_check/dependency_check_report_generator.py",> line 76, in extract_single_dep
raise InvalidFormatError("Failed to extract the dependency information: {}".format(dep))
dependency_check.dependency_check_report_generator.InvalidFormatError: Failed to extract the dependency information: - group1:artifact1 (1.0.0, 2.0.0)
INFO:root:
Start processing: - group2:artifact2 [1.0.0 -> 2.0.0]
.INFO:root:
Start processing: - group1:artifact1 [1.0.0 -> 3.0.0]
INFO:root:
Start processing: - group2:artifact2 [1.0.0 -> 1.3.0]
INFO:root:
Start processing: - group3:artifact3 [1.0.0 -> 1.1.0]
INFO:root:
Start processing: - group4:artifact4 [1.0.0 -> 1.1.0]
.
----------------------------------------------------------------------
Ran 5 tests in 0.038s
OK
Test : test_dep_with_nondigit_major_versions
Test : test_dep_with_nondigit_minor_versions
Test : test_empty_dep_input
Test : test_invalid_dep_input
Test : test_normal_dep_input
python -m jira_utils.jira_manager_test
INFO:root:Start handling the JIRA issues for Python dependency: dep0 1.0.0
INFO:root:Creating a new JIRA issue to track dep0 upgrade process
INFO:root:Found owners of dep0: owner0, owner1 , owner2,
INFO:root:Created a new issue <MagicMock name='JiraClient().create_issue().key' id='140346867378328'> of dep0 1.0.0
.INFO:root:Start handling the JIRA issues for Java dependency: group0:artifact0 1.0.0
INFO:root:Found the parent issue BEAM-1000. Continuous to create or update the sub-task for group0:artifact0
INFO:root:Creating a new JIRA issue to track group0:artifact0 upgrade process
INFO:root:Found owners of group0:artifact0: owner0
INFO:root:Created a new issue <MagicMock name='JiraClient().create_issue().key' id='140346867556816'> of group0:artifact0 1.0.0
.INFO:root:Start handling the JIRA issues for Java dependency: group0:artifact0 1.0.0
INFO:root:The parent issue BEAM-1000 is not opening. Attempt reopening the issue
INFO:root:Found the parent issue BEAM-1000. Continuous to create or update the sub-task for group0:artifact0
INFO:root:Creating a new JIRA issue to track group0:artifact0 upgrade process
INFO:root:Found owners of group0:artifact0: owner0
INFO:root:Created a new issue <MagicMock name='JiraClient().create_issue().key' id='140346867439040'> of group0:artifact0 1.0.0
.INFO:root:Start handling the JIRA issues for Python dependency: dep0 1.0.0
INFO:root:Updating JIRA issue BEAM-1000 to track dep0 upgrade process
WARNING:root:Could not find owners for dep0
INFO:root:Reopened the issue BEAM-1000 for dep0 1.0.0
.INFO:root:Start handling the JIRA issues for Python dependency: dep0 1.3
INFO:root:Updating JIRA issue BEAM-1000 to track dep0 upgrade process
WARNING:root:Could not find owners for dep0
INFO:root:Reopened the issue BEAM-1000 for dep0 1.3
.INFO:root:Start handling the JIRA issues for Python dependency: dep0 1.0.0
INFO:root:Updating JIRA issue BEAM-1000 to track dep0 upgrade process
WARNING:root:Could not find owners for dep0
INFO:root:Updated the existing issue BEAM-1000 of dep0 1.0.0
.
----------------------------------------------------------------------
Ran 6 tests in 0.040s
OK
Test : test_run_with_creating_new_issue
Test : test_run_with_creating_new_subtask
Test : test_run_with_reopening_existing_parent_issue
Test : test_run_with_reopening_issue_with_fixversions
Test : test_run_with_reopening_issue_with_new_release_available
Test : test_run_with_updating_existing_task
python -m dependency_check.version_comparer_test
.....
----------------------------------------------------------------------
Ran 5 tests in 0.000s
OK
Test : test_compare_major_verison_true
Test : test_compare_minor_version_false
Test : test_compare_minor_version_true
Test : test_compare_non_semantic_version_true
Test : test_compare_same_version_false
echo "<html><body>" > $WORKSPACE/src/build/dependencyUpdates/beam-dependency-check-report.html
python -m dependency_check/dependency_check_report_generator Python
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python>: No module named dependency_check/dependency_check_report_generator
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_Dependency_Check #200
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_Dependency_Check/200/display/redirect>
------------------------------------------
[...truncated 29.02 KB...]
Publishing build scan...
https://gradle.com/s/wiwzc6bhbjb5m
Build step 'Invoke Gradle script' changed build result to SUCCESS
[beam_Dependency_Check] $ /bin/bash -xe /tmp/jenkins7708912131877523172.sh
+ cd src
+ bash .test-infra/jenkins/dependency_check/generate_report.sh
REPORT_DESCRIPTION="
<h4> A dependency update is high priority if it satisfies one of following criteria: </h4>
<ul>
<li> It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; </li>
</ul>
<ul>
<li> It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; </li>
</ul>
<ul>
<li> The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. </li>
</ul>
<h4> In Beam, we make a best-effort attempt at keeping all dependencies up-to-date.
In the future, issues will be filed and tracked for these automatically,
but in the meantime you can search for existing issues or open a new one.
</h4>
<h4> For more information: <a href=\"https://beam.apache.org/contribute/dependencies/\"> Beam Dependency Guide </a></h4>"
# Virtualenv for the rest of the script to run setup
virtualenv dependency/check
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python>
Installing setuptools, pip, wheel...
done.
. dependency/check/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly
deactivate () {
unset -f pydoc >/dev/null 2>&1
# reset old environment variables
# ! [ -z ${VAR+_} ] returns true if VAR is declared at all
if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
PATH="$_OLD_VIRTUAL_PATH"
export PATH
unset _OLD_VIRTUAL_PATH
fi
if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
export PYTHONHOME
unset _OLD_VIRTUAL_PYTHONHOME
fi
# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands. Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
hash -r 2>/dev/null
fi
if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
PS1="$_OLD_VIRTUAL_PS1"
export PS1
unset _OLD_VIRTUAL_PS1
fi
unset VIRTUAL_ENV
if [ ! "${1-}" = "nondestructive" ] ; then
# Self destruct!
unset -f deactivate
fi
}
# unset irrelevant variables
deactivate nondestructive
VIRTUAL_ENV="<https://builds.apache.org/job/beam_Dependency_Check/ws/src/dependency/check">
export VIRTUAL_ENV
_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH
# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
_OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
unset PYTHONHOME
fi
if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
_OLD_VIRTUAL_PS1="${PS1-}"
if [ "x" != x ] ; then
PS1="${PS1-}"
else
PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
fi
export PS1
fi
basename "$VIRTUAL_ENV"
# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true
pydoc () {
python -m pydoc "$@"
}
# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands. Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
hash -r 2>/dev/null
fi
pip install --upgrade google-cloud-bigquery
Collecting google-cloud-bigquery
Downloading https://files.pythonhosted.org/packages/7b/66/cc5a5e8679afc3f1f44489c856fe04507aa1ab9f330086e1810cee8fe19c/google_cloud_bigquery-1.12.0-py2.py3-none-any.whl (130kB)
Collecting google-resumable-media>=0.3.1 (from google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/e2/5d/4bc5c28c252a62efe69ed1a1561da92bd5af8eca0cdcdf8e60354fae9b29/google_resumable_media-0.3.2-py2.py3-none-any.whl
Collecting google-api-core<2.0.0dev,>=1.6.0 (from google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/32/df/1af46c943d13332e0f113b8d1478d9d466a39db5a2c9edf1e533b720421a/google_api_core-1.11.0-py2.py3-none-any.whl
Collecting google-cloud-core<2.0dev,>=1.0.0 (from google-cloud-bigquery)
Downloading https://files.pythonhosted.org/packages/34/ba/251d9b6a1695d25d9f081a3db537b0dfb15edaf2037b423e4a98280df7f9/google_cloud_core-1.0.0-py2.py3-none-any.whl
Collecting protobuf>=3.6.0 (from google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/81/59/c7b0815a78fd641141f24a6ece878293eae6bf1fce40632a6ab9672346aa/protobuf-3.7.1-cp35-cp35m-manylinux1_x86_64.whl
Collecting six (from google-resumable-media>=0.3.1->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Requirement already satisfied, skipping upgrade: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery) (41.0.1)
Collecting pytz (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/3d/73/fe30c2daaaa0713420d0382b16fbb761409f532c56bdcc514bf7b6262bb6/pytz-2019.1-py2.py3-none-any.whl
Collecting requests<3.0.0dev,>=2.18.0 (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl
Collecting googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/39/ec/d93dfc69617a028915df914339ef66936ea976ef24fa62940fd86ba0326e/urllib3-1.25.2-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.2.1 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/91/f0/b03e00ce9fddf4827c42df1c3ce10c74eadebfb706231e8d6d1c356a4062/pyasn1_modules-0.2.5-py2.py3-none-any.whl
Collecting rsa>=3.1.4 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Collecting cachetools>=2.0.0 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/39/2b/d87fc2369242bd743883232c463f28205902b8579cb68dcf5b11eee1652f/cachetools-3.1.0-py2.py3-none-any.whl
Collecting pyasn1<0.5.0,>=0.4.1 (from pyasn1-modules>=0.2.1->google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google-cloud-bigquery)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Installing collected packages: six, google-resumable-media, protobuf, pytz, idna, urllib3, chardet, certifi, requests, googleapis-common-protos, pyasn1, pyasn1-modules, rsa, cachetools, google-auth, google-api-core, google-cloud-core, google-cloud-bigquery
Successfully installed cachetools-3.1.0 certifi-2019.3.9 chardet-3.0.4 google-api-core-1.11.0 google-auth-1.6.3 google-cloud-bigquery-1.12.0 google-cloud-core-1.0.0 google-resumable-media-0.3.2 googleapis-common-protos-1.5.10 idna-2.8 protobuf-3.7.1 pyasn1-0.4.5 pyasn1-modules-0.2.5 pytz-2019.1 requests-2.22.0 rsa-4.0 six-1.12.0 urllib3-1.25.2
pip install --upgrade google-cloud-bigtable
Collecting google-cloud-bigtable
Downloading https://files.pythonhosted.org/packages/b8/d3/a4670ef8d546bee30c2fc284bd211c7ce3861ae6b4df4d5d7b6382180941/google_cloud_bigtable-0.33.0-py2.py3-none-any.whl (230kB)
Collecting grpc-google-iam-v1<0.12dev,>=0.11.4 (from google-cloud-bigtable)
Requirement already satisfied, skipping upgrade: google-api-core[grpc]<2.0.0dev,>=1.6.0 in ./dependency/check/lib/python3.5/site-packages (from google-cloud-bigtable) (1.11.0)
Requirement already satisfied, skipping upgrade: google-cloud-core<2.0dev,>=1.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-cloud-bigtable) (1.0.0)
Collecting grpcio<2.0.0dev,>=1.0.0 (from grpc-google-iam-v1<0.12dev,>=0.11.4->google-cloud-bigtable)
Using cached https://files.pythonhosted.org/packages/87/1d/df17052784a9e19668b9ef7cb778d31ba984e4a2057be2895d1709505dff/grpcio-1.20.1-cp35-cp35m-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: googleapis-common-protos[grpc]<2.0.0dev,>=1.5.2 in ./dependency/check/lib/python3.5/site-packages (from grpc-google-iam-v1<0.12dev,>=0.11.4->google-cloud-bigtable) (1.5.10)
Requirement already satisfied, skipping upgrade: requests<3.0.0dev,>=2.18.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2.22.0)
Requirement already satisfied, skipping upgrade: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (41.0.1)
Requirement already satisfied, skipping upgrade: protobuf>=3.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (3.7.1)
Requirement already satisfied, skipping upgrade: google-auth<2.0dev,>=0.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (1.6.3)
Requirement already satisfied, skipping upgrade: pytz in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2019.1)
Requirement already satisfied, skipping upgrade: six>=1.10.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (1.12.0)
Requirement already satisfied, skipping upgrade: certifi>=2017.4.17 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2019.3.9)
Requirement already satisfied, skipping upgrade: idna<2.9,>=2.5 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (2.8)
Requirement already satisfied, skipping upgrade: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (1.25.2)
Requirement already satisfied, skipping upgrade: chardet<3.1.0,>=3.0.2 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (3.0.4)
Requirement already satisfied, skipping upgrade: pyasn1-modules>=0.2.1 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (0.2.5)
Requirement already satisfied, skipping upgrade: cachetools>=2.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (3.1.0)
Requirement already satisfied, skipping upgrade: rsa>=3.1.4 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (4.0)
Requirement already satisfied, skipping upgrade: pyasn1<0.5.0,>=0.4.1 in ./dependency/check/lib/python3.5/site-packages (from pyasn1-modules>=0.2.1->google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-bigtable) (0.4.5)
Installing collected packages: grpcio, grpc-google-iam-v1, google-cloud-bigtable
Successfully installed google-cloud-bigtable-0.33.0 grpc-google-iam-v1-0.11.4 grpcio-1.20.1
pip install --upgrade google-cloud-core
Requirement already up-to-date: google-cloud-core in ./dependency/check/lib/python3.5/site-packages (1.0.0)
Requirement already satisfied, skipping upgrade: google-api-core<2.0.0dev,>=1.11.0 in ./dependency/check/lib/python3.5/site-packages (from google-cloud-core) (1.11.0)
Requirement already satisfied, skipping upgrade: requests<3.0.0dev,>=2.18.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2.22.0)
Requirement already satisfied, skipping upgrade: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (41.0.1)
Requirement already satisfied, skipping upgrade: six>=1.10.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.12.0)
Requirement already satisfied, skipping upgrade: google-auth<2.0dev,>=0.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.6.3)
Requirement already satisfied, skipping upgrade: protobuf>=3.4.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (3.7.1)
Requirement already satisfied, skipping upgrade: googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.5.10)
Requirement already satisfied, skipping upgrade: pytz in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2019.1)
Requirement already satisfied, skipping upgrade: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (1.25.2)
Requirement already satisfied, skipping upgrade: idna<2.9,>=2.5 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2.8)
Requirement already satisfied, skipping upgrade: certifi>=2017.4.17 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (2019.3.9)
Requirement already satisfied, skipping upgrade: chardet<3.1.0,>=3.0.2 in ./dependency/check/lib/python3.5/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (3.0.4)
Requirement already satisfied, skipping upgrade: cachetools>=2.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (3.1.0)
Requirement already satisfied, skipping upgrade: pyasn1-modules>=0.2.1 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (0.2.5)
Requirement already satisfied, skipping upgrade: rsa>=3.1.4 in ./dependency/check/lib/python3.5/site-packages (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (4.0)
Requirement already satisfied, skipping upgrade: pyasn1<0.5.0,>=0.4.1 in ./dependency/check/lib/python3.5/site-packages (from pyasn1-modules>=0.2.1->google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.11.0->google-cloud-core) (0.4.5)
rm -f build/dependencyUpdates/beam-dependency-check-report.txt
# Insall packages and run the unit tests of the report generator and the jira manager
pip install mock jira pyyaml
Collecting mock
Downloading https://files.pythonhosted.org/packages/05/d2/f94e68be6b17f46d2c353564da56e6fb89ef09faeeff3313a046cb810ca9/mock-3.0.5-py2.py3-none-any.whl
Collecting jira
Downloading https://files.pythonhosted.org/packages/cb/c2/4203b6cad72d115b0ad62ae7028567b538c8933745f665d0eee5082baf67/jira-2.0.0-py2.py3-none-any.whl (57kB)
Collecting pyyaml
Downloading https://files.pythonhosted.org/packages/9f/2c/9417b5c774792634834e730932745bc09a7d36754ca00acf1ccd1ac2594d/PyYAML-5.1.tar.gz (274kB)
Requirement already satisfied: six in ./dependency/check/lib/python3.5/site-packages (from mock) (1.12.0)
Requirement already satisfied: requests>=2.10.0 in ./dependency/check/lib/python3.5/site-packages (from jira) (2.22.0)
Collecting pbr>=3.0.0 (from jira)
Using cached https://files.pythonhosted.org/packages/07/3e/22d1d35a4b51706ca3590c54359aeb5fa7ea60df46180143a3ea13d45f29/pbr-5.2.0-py2.py3-none-any.whl
Collecting oauthlib[signedtoken]>=1.0.0 (from jira)
Downloading https://files.pythonhosted.org/packages/16/95/699466b05b72b94a41f662dc9edf87fda4289e3602ecd42d27fcaddf7b56/oauthlib-3.0.1-py2.py3-none-any.whl (142kB)
Requirement already satisfied: setuptools>=20.10.1 in ./dependency/check/lib/python3.5/site-packages (from jira) (41.0.1)
Collecting requests-oauthlib>=0.6.1 (from jira)
Downloading https://files.pythonhosted.org/packages/c2/e2/9fd03d55ffb70fe51f587f20bcf407a6927eb121de86928b34d162f0b1ac/requests_oauthlib-1.2.0-py2.py3-none-any.whl
Collecting requests-toolbelt (from jira)
Downloading https://files.pythonhosted.org/packages/60/ef/7681134338fc097acef8d9b2f8abe0458e4d87559c689a8c306d0957ece5/requests_toolbelt-0.9.1-py2.py3-none-any.whl (54kB)
Collecting defusedxml (from jira)
Downloading https://files.pythonhosted.org/packages/06/74/9b387472866358ebc08732de3da6dc48e44b0aacd2ddaa5cb85ab7e986a2/defusedxml-0.6.0-py2.py3-none-any.whl
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (1.25.2)
Requirement already satisfied: certifi>=2017.4.17 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (2019.3.9)
Requirement already satisfied: idna<2.9,>=2.5 in ./dependency/check/lib/python3.5/site-packages (from requests>=2.10.0->jira) (2.8)
Collecting cryptography; extra == "signedtoken" (from oauthlib[signedtoken]>=1.0.0->jira)
Downloading https://files.pythonhosted.org/packages/5b/12/b0409a94dad366d98a8eee2a77678c7a73aafd8c0e4b835abea634ea3896/cryptography-2.6.1-cp34-abi3-manylinux1_x86_64.whl (2.3MB)
Collecting pyjwt>=1.0.0; extra == "signedtoken" (from oauthlib[signedtoken]>=1.0.0->jira)
Downloading https://files.pythonhosted.org/packages/87/8b/6a9f14b5f781697e51259d81657e6048fd31a113229cf346880bb7545565/PyJWT-1.7.1-py2.py3-none-any.whl
Collecting cffi!=1.11.3,>=1.8 (from cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira)
Downloading https://files.pythonhosted.org/packages/62/76/135eeffe0089e6724bdd65c1bf9f1654db9b47783e65b8d9f1454c540d8b/cffi-1.12.3-cp35-cp35m-manylinux1_x86_64.whl (429kB)
Collecting asn1crypto>=0.21.0 (from cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira)
Using cached https://files.pythonhosted.org/packages/ea/cd/35485615f45f30a510576f1a56d1e0a7ad7bd8ab5ed7cdc600ef7cd06222/asn1crypto-0.24.0-py2.py3-none-any.whl
Collecting pycparser (from cffi!=1.11.3,>=1.8->cryptography; extra == "signedtoken"->oauthlib[signedtoken]>=1.0.0->jira)
Building wheels for collected packages: pyyaml
Building wheel for pyyaml (setup.py): started
Building wheel for pyyaml (setup.py): finished with status 'done'
Stored in directory: /home/jenkins/.cache/pip/wheels/ad/56/bc/1522f864feb2a358ea6f1a92b4798d69ac783a28e80567a18b
Successfully built pyyaml
Installing collected packages: mock, pbr, pycparser, cffi, asn1crypto, cryptography, pyjwt, oauthlib, requests-oauthlib, requests-toolbelt, defusedxml, jira, pyyaml
Successfully installed asn1crypto-0.24.0 cffi-1.12.3 cryptography-2.6.1 defusedxml-0.6.0 jira-2.0.0 mock-3.0.5 oauthlib-3.0.1 pbr-5.2.0 pycparser-2.19 pyjwt-1.7.1 pyyaml-5.1 requests-oauthlib-1.2.0 requests-toolbelt-0.9.1
cd $WORKSPACE/src/.test-infra/jenkins
python -m dependency_check.dependency_check_report_generator_test
Traceback (most recent call last):
File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/.test-infra/jenkins/dependency_check/dependency_check_report_generator_test.py",> line 26, in <module>
from dependency_check_report_generator import prioritize_dependencies
ImportError: No module named 'dependency_check_report_generator'
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_Dependency_Check #199
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_Dependency_Check/199/display/redirect>
------------------------------------------
[...truncated 10.85 KB...]
PATH="$_OLD_VIRTUAL_PATH"
export PATH
unset _OLD_VIRTUAL_PATH
fi
if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
export PYTHONHOME
unset _OLD_VIRTUAL_PYTHONHOME
fi
# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands. Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
hash -r 2>/dev/null
fi
if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
PS1="$_OLD_VIRTUAL_PS1"
export PS1
unset _OLD_VIRTUAL_PS1
fi
unset VIRTUAL_ENV
if [ ! "${1-}" = "nondestructive" ] ; then
# Self destruct!
unset -f deactivate
fi
}
# unset irrelevant variables
deactivate nondestructive
VIRTUAL_ENV="<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python">
export VIRTUAL_ENV
_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH
# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
_OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
unset PYTHONHOME
fi
if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
_OLD_VIRTUAL_PS1="${PS1-}"
if [ "x" != x ] ; then
PS1="${PS1-}"
else
PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
fi
export PS1
fi
basename "$VIRTUAL_ENV"
# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true
pydoc () {
python -m pydoc "$@"
}
# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands. Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
hash -r 2>/dev/null
fi
pip install -e .[gcp,test,docs]
Obtaining file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.14.0.dev0)
Collecting dill<0.2.10,>=0.2.9 (from apache-beam==2.14.0.dev0)
Collecting fastavro<0.22,>=0.21.4 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/6c/52/cb649fe9f3f527a662683abfa76e269f627a79691d594f68605ca359e3ee/fastavro-0.21.23-cp35-cp35m-manylinux1_x86_64.whl
Requirement already satisfied: future<1.0.0,>=0.16.0 in ./sdks/python/lib/python3.5/site-packages (from apache-beam==2.14.0.dev0) (0.16.0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/87/1d/df17052784a9e19668b9ef7cb778d31ba984e4a2057be2895d1709505dff/grpcio-1.20.1-cp35-cp35m-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.14.0.dev0)
Collecting httplib2<=0.12.0,>=0.8 (from apache-beam==2.14.0.dev0)
Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl
Collecting oauth2client<4,>=2.0.1 (from apache-beam==2.14.0.dev0)
Collecting protobuf<4,>=3.5.0.post1 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/81/59/c7b0815a78fd641141f24a6ece878293eae6bf1fce40632a6ab9672346aa/protobuf-3.7.1-cp35-cp35m-manylinux1_x86_64.whl
Collecting pydot<1.3,>=1.2.0 (from apache-beam==2.14.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/3d/73/fe30c2daaaa0713420d0382b16fbb761409f532c56bdcc514bf7b6262bb6/pytz-2019.1-py2.py3-none-any.whl
Collecting pyyaml<4.0.0,>=3.12 (from apache-beam==2.14.0.dev0)
Collecting pyarrow<0.14.0,>=0.11.1 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/0e/ee/71955f715d65afa1fc319b33dfe1976cd09a1a349af7756b232dbae85409/pyarrow-0.13.0-cp35-cp35m-manylinux1_x86_64.whl
Collecting avro-python3<2.0.0,>=1.8.1 (from apache-beam==2.14.0.dev0)
Collecting Sphinx<2.0,>=1.5.2 (from apache-beam==2.14.0.dev0)
Downloading https://files.pythonhosted.org/packages/7d/66/a4af242b4348b729b9d46ce5db23943ce9bca7da9bbe2ece60dc27f26420/Sphinx-1.8.5-py2.py3-none-any.whl (3.1MB)
Collecting cachetools<4,>=3.1.0 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/39/2b/d87fc2369242bd743883232c463f28205902b8579cb68dcf5b11eee1652f/cachetools-3.1.0-py2.py3-none-any.whl
Collecting google-apitools<0.5.29,>=0.5.28 (from apache-beam==2.14.0.dev0)
Collecting google-cloud-datastore<2.0.0,>=1.7.1 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/a5/2c/4b82ba4c3e825246d3f2661b6a4e35c0343524d381d97545cafd2ae910a5/google_cloud_datastore-1.8.0-py2.py3-none-any.whl
Collecting google-cloud-pubsub<0.40.0,>=0.39.0 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/c0/9a/4455b1c1450e9b912855b58ca6eee7a27ff1e9b52e4d98c243d93256f469/google_cloud_pubsub-0.39.1-py2.py3-none-any.whl
Collecting google-cloud-bigquery<1.7.0,>=1.6.0 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/b7/1b/2b95f2fefddbbece38110712c225bfb5649206f4056445653bd5ca4dc86d/google_cloud_bigquery-1.6.1-py2.py3-none-any.whl
Collecting google-cloud-core<0.30.0,>=0.28.1 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/0c/f2/3c225e7a69cb27d283b68bff867722bd066bc1858611180197f711815ea5/google_cloud_core-0.29.1-py2.py3-none-any.whl
Collecting google-cloud-bigtable<0.33.0,>=0.31.1 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/08/77/b468e209dbb0a6f614e6781f06a4894299a4c6167c2c525cc086caa7c075/google_cloud_bigtable-0.32.2-py2.py3-none-any.whl
Collecting nose>=1.3.7 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/15/d8/dd071918c040f50fa1cf80da16423af51ff8ce4a0f2399b7bf8de45ac3d9/nose-1.3.7-py3-none-any.whl
Collecting numpy<2,>=1.14.3 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/f6/f3/cc6c6745347c1e997cc3e58390584a250b8e22b6dfc45414a7d69a3df016/numpy-1.16.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting pandas<0.24,>=0.23.4 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/5d/d4/6e9c56a561f1d27407bf29318ca43f36ccaa289271b805a30034eb3a8ec4/pandas-0.23.4-cp35-cp35m-manylinux1_x86_64.whl
Collecting parameterized<0.7.0,>=0.6.0 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/3a/49/75f6dadb09e2f8ace3cdffe0c99a04f1b98dff41fbf9e768665d8b469e29/parameterized-0.6.3-py2.py3-none-any.whl
Collecting pyhamcrest<2.0,>=1.9 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/9a/d5/d37fd731b7d0e91afcc84577edeccf4638b4f9b82f5ffe2f8b62e2ddc609/PyHamcrest-1.9.0-py2.py3-none-any.whl
Collecting tenacity<6.0,>=5.0.2 (from apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/6a/93/dfcf5b1b46ab29196274b78dcba69fab5e54b6dc303a7eed90a79194d277/tenacity-5.0.4-py2.py3-none-any.whl
Collecting six>=1.5.2 (from grpcio<2,>=1.8->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.14.0.dev0)
Collecting requests>=2.7.0 (from hdfs<3.0.0,>=2.1.0->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl
Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/07/3e/22d1d35a4b51706ca3590c54359aeb5fa7ea60df46180143a3ea13d45f29/pbr-5.2.0-py2.py3-none-any.whl
Collecting pyasn1>=0.1.7 (from oauth2client<4,>=2.0.1->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Collecting rsa>=3.1.4 (from oauth2client<4,>=2.0.1->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.0.5 (from oauth2client<4,>=2.0.1->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/91/f0/b03e00ce9fddf4827c42df1c3ce10c74eadebfb706231e8d6d1c356a4062/pyasn1_modules-0.2.5-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./sdks/python/lib/python3.5/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.14.0.dev0) (41.0.1)
Collecting pyparsing>=2.1.4 (from pydot<1.3,>=1.2.0->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/dd/d9/3ec19e966301a6e25769976999bd7bbe552016f0d32b577dc9d63d2e0c49/pyparsing-2.4.0-py2.py3-none-any.whl
Collecting snowballstemmer>=1.1 (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/d4/6c/8a935e2c7b54a37714656d753e4187ee0631988184ed50c0cf6476858566/snowballstemmer-1.2.1-py2.py3-none-any.whl
Collecting Jinja2>=2.3 (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Collecting packaging (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Downloading https://files.pythonhosted.org/packages/91/32/58bc30e646e55eab8b21abf89e353f59c0cc02c417e42929f4a9546e1b1d/packaging-19.0-py2.py3-none-any.whl
Collecting alabaster<0.8,>=0.7 (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/10/ad/00b090d23a222943eb0eda509720a404f531a439e803f6538f35136cae9e/alabaster-0.7.12-py2.py3-none-any.whl
Collecting Pygments>=2.0 (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/6e/00/c5cb5fc7c047da4af049005d0146b3a961b1a25d9cefbbe24bf0882a11ad/Pygments-2.4.0-py2.py3-none-any.whl
Collecting babel!=2.0,>=1.3 (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/b8/ad/c6f60602d3ee3d92fbed87675b6fb6a6f9a38c223343ababdb44ba201f10/Babel-2.6.0-py2.py3-none-any.whl
Collecting sphinxcontrib-websupport (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Downloading https://files.pythonhosted.org/packages/2a/59/d64bda9b7480a84a3569be4dde267c0f6675b255ba63b4c8e84469940457/sphinxcontrib_websupport-1.1.2-py2.py3-none-any.whl
Collecting imagesize (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/fc/b6/aef66b4c52a6ad6ac18cf6ebc5731ed06d8c9ae4d3b2d9951f261150be67/imagesize-1.1.0-py2.py3-none-any.whl
Collecting docutils>=0.11 (from Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/36/fa/08e9e6e0e3cbd1d362c3bbee8d01d0aedb2155c4ac112b19ef3cae8eed8d/docutils-0.14-py3-none-any.whl
Collecting fasteners>=0.14 (from google-apitools<0.5.29,>=0.5.28->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/14/3a/096c7ad18e102d4f219f5dd15951f9728ca5092a3385d2e8f79a7c1e1017/fasteners-0.14.1-py2.py3-none-any.whl
Collecting google-api-core[grpc]<2.0.0dev,>=1.6.0 (from google-cloud-datastore<2.0.0,>=1.7.1->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/32/df/1af46c943d13332e0f113b8d1478d9d466a39db5a2c9edf1e533b720421a/google_api_core-1.11.0-py2.py3-none-any.whl
Collecting grpc-google-iam-v1<0.12dev,>=0.11.4 (from google-cloud-pubsub<0.40.0,>=0.39.0->apache-beam==2.14.0.dev0)
Collecting google-resumable-media>=0.2.1 (from google-cloud-bigquery<1.7.0,>=1.6.0->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/e2/5d/4bc5c28c252a62efe69ed1a1561da92bd5af8eca0cdcdf8e60354fae9b29/google_resumable_media-0.3.2-py2.py3-none-any.whl
Collecting python-dateutil>=2.5.0 (from pandas<0.24,>=0.23.4->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/39/ec/d93dfc69617a028915df914339ef66936ea976ef24fa62940fd86ba0326e/urllib3-1.25.2-py2.py3-none-any.whl
Collecting MarkupSafe>=0.23 (from Jinja2>=2.3->Sphinx<2.0,>=1.5.2->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/6e/57/d40124076756c19ff2269678de7ae25a14ebbb3f6314eb5ce9477f191350/MarkupSafe-1.1.1-cp35-cp35m-manylinux1_x86_64.whl
Collecting monotonic>=0.1 (from fasteners>=0.14->google-apitools<0.5.29,>=0.5.28->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl
Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-datastore<2.0.0,>=1.7.1->apache-beam==2.14.0.dev0)
Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl
Collecting googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 (from google-api-core[grpc]<2.0.0dev,>=1.6.0->google-cloud-datastore<2.0.0,>=1.7.1->apache-beam==2.14.0.dev0)
ERROR: google-cloud-datastore 1.8.0 has requirement google-cloud-core<2.0dev,>=1.0.0, but you'll have google-cloud-core 0.29.1 which is incompatible.
Installing collected packages: crcmod, dill, fastavro, six, grpcio, docopt, idna, certifi, chardet, urllib3, requests, hdfs, httplib2, pbr, mock, pyasn1, rsa, pyasn1-modules, oauth2client, protobuf, pyparsing, pydot, pytz, pyyaml, numpy, pyarrow, avro-python3, snowballstemmer, MarkupSafe, Jinja2, packaging, alabaster, Pygments, babel, sphinxcontrib-websupport, imagesize, docutils, Sphinx, cachetools, monotonic, fasteners, google-apitools, google-auth, googleapis-common-protos, google-api-core, google-cloud-core, google-cloud-datastore, grpc-google-iam-v1, google-cloud-pubsub, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable, nose, python-dateutil, pandas, parameterized, pyhamcrest, tenacity, apache-beam
Running setup.py develop for apache-beam
Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 Pygments-2.4.0 Sphinx-1.8.5 alabaster-0.7.12 apache-beam avro-python3-1.8.2 babel-2.6.0 cachetools-3.1.0 certifi-2019.3.9 chardet-3.0.4 crcmod-1.7 dill-0.2.9 docopt-0.6.2 docutils-0.14 fastavro-0.21.23 fasteners-0.14.1 google-api-core-1.11.0 google-apitools-0.5.28 google-auth-1.6.3 google-cloud-bigquery-1.6.1 google-cloud-bigtable-0.32.2 google-cloud-core-0.29.1 google-cloud-datastore-1.8.0 google-cloud-pubsub-0.39.1 google-resumable-media-0.3.2 googleapis-common-protos-1.5.10 grpc-google-iam-v1-0.11.4 grpcio-1.20.1 hdfs-2.5.2 httplib2-0.12.0 idna-2.8 imagesize-1.1.0 mock-2.0.0 monotonic-1.5 nose-1.3.7 numpy-1.16.3 oauth2client-3.0.0 packaging-19.0 pandas-0.23.4 parameterized-0.6.3 pbr-5.2.0 protobuf-3.7.1 pyarrow-0.13.0 pyasn1-0.4.5 pyasn1-modules-0.2.5 pydot-1.2.4 pyhamcrest-1.9.0 pyparsing-2.4.0 python-dateutil-2.8.0 pytz-2019.1 pyyaml-3.13 requests-2.22.0 rsa-4.0 six-1.12.0 snowballstemmer-1.2.1 sphinxcontrib-websupport-1.1.2 tenacity-5.0.4 urllib3-1.25.2
mkdir -p $WORKSPACE/src/build/dependencyUpdates
rm -f $WORKSPACE/src/build/dependencyUpdates/python_dependency_report.txt
# List all outdated dependencies and write results in pythonDependencyReport
echo "The following dependencies have later release versions:" > $WORKSPACE/src/build/dependencyUpdates/python_dependency_report.txt
pip list --outdated | sed -n '1,2!p' | while IFS= read -r line
do
echo $line | while IFS=' ' read dep curr_ver new_ver type
do
echo $line
echo " - $dep [$curr_ver -> $new_ver]" >> $WORKSPACE/src/build/dependencyUpdates/python_dependency_report.txt
done
done
future 0.16.0 0.17.1 sdist
google-cloud-bigquery 1.6.1 1.12.0 wheel
google-cloud-bigtable 0.32.2 0.33.0 wheel
google-cloud-core 0.29.1 1.0.0 wheel
google-cloud-pubsub 0.39.1 0.41.0 wheel
httplib2 0.12.0 0.12.3 wheel
mock 2.0.0 3.0.5 wheel
oauth2client 3.0.0 4.1.3 wheel
pandas 0.23.4 0.24.2 wheel
parameterized 0.6.3 0.7.0 wheel
pydot 1.2.4 1.4.1 wheel
PyYAML 3.13 5.1 sdist
Sphinx 1.8.5 2.0.1 wheel
> Task :runBeamDependencyCheck
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 1m 9s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/trx5kiuvhsuqq
Build step 'Invoke Gradle script' changed build result to SUCCESS
[beam_Dependency_Check] $ /bin/bash -xe /tmp/jenkins2934130866657231914.sh
+ cd src
+ bash .test-infra/jenkins/dependency_check/generate_report.sh
REPORT_DESCRIPTION="
<h4> A dependency update is high priority if it satisfies one of following criteria: </h4>
<ul>
<li> It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; </li>
</ul>
<ul>
<li> It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; </li>
</ul>
<ul>
<li> The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. </li>
</ul>
<h4> In Beam, we make a best-effort attempt at keeping all dependencies up-to-date.
In the future, issues will be filed and tracked for these automatically,
but in the meantime you can search for existing issues or open a new one.
</h4>
<h4> For more information: <a href=\"https://beam.apache.org/contribute/dependencies/\"> Beam Dependency Guide </a></h4>"
# Virtualenv for the rest of the script to run setup
/usr/bin/virtualenv dependency/check
.test-infra/jenkins/dependency_check/generate_report.sh: line 42: /usr/bin/virtualenv: No such file or directory
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_Dependency_Check #198
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_Dependency_Check/198/display/redirect?page=changes>
Changes:
[jkp] Loosen up dependency specifications
[samuelw] GrpcWindmillWorker improvements: - Log error statuses returned from
[github] Add upper bounds.
[ehudm] [BEAM-6669] Set Dataflow KMS key name (Python)
[roman] fix splitting into filters and buckets
[roman] tidy up println
[heejong] [BEAM-7143] adding withConsumerConfigUpdates
[michal.walenia] [BEAM-6627] Generify ByteMonitor to accept any type, not just KV<byte[],
[michal.walenia] [BEAM-6627] Add CountMonitor to IOIT metric utils
[heejong] [BEAM-7008] adding UTF8 String coder to Java SDK ModelCoder
[bhulette] Fix EXCEPT DISTINCT behavior
[github] Add Bigtable to supported Beam connectors
[amaliujia] [sql] reject aggreagtion distinct rather than executing distinct as all.
[juta.staes] [BEAM-7066] re-add python 3.6 and 3.7 precommit test suites
[frederik.bode] Fix fastavro on Python 3
[frederik.bode] fixup: Fix fastavro on Python 3
[iemejia] Minor fixes related to NeedsRunner/ValidatesRunner tests
[mxm] [BEAM-5197] Guard access to test timer service by a lock
[25622840+adude3141] [BEAM-7229] ParDoLifecycleTest: remove duplicated test methods
[github] Adding PyDoc to CombiningValueStateSpec (#8477)
[iemejia] Add UsesSchema category to Schema transform tests
[iemejia] Categorize TestStreamsTest tests that use processing time
[pabloem] Skipping fileio tests on windows
[richard.moorhead] [BEAM-7216] reinstate checks for Kafka client methods
[markliu] Fix project path in beam_PerformanceTests_Python35
[relax] Merge pull request #8485: Fixed bug where fieldIdsAccessed order could
[ankurgoenka] Fix py3 "Map modified during iteration"
[echauchot] Add Structured streaming Spark Runner design document
[michal.walenia] [BEAM-7028] Add Combine Java load tests
[pabloem] Fixing fileio tests for windows
[boyuanz] Move test_sdf_synthetic_source to FnApiRunnerTest
[kcweaver] [BEAM-7214] Run Python validates runner tests on Spark
[leo.unc] Revert "Use TFRecord to store intermediate cache results using
[amaliujia] [BEAM-5644] make Planner configurable.
[pabloem] [BEAM-6986] TypeHints Py3 Error: Multiple tests fail with a generator
[25622840+adude3141] [BEAM-7197] ensure DoFn is torn down after exception thrown in lifecycle
[kedin] [SQL] Remove TYPE_ prefix from DataCatalogTableProvider
[kedin] [SQL] Refactor BeamSqlEnv
[kedin] [SQL][Fix] Fix DataCatalog MAP type
[github] [BEAM-7241] Bump the version of apitools.
[github] [BEAM-6892] Adding support for side inputs on table & schema. Also
[github] Adding Python samples to the Timely (and stateful) Processing post.
[kedin] [SQL] Upgrade DataCatalog client to 0.4.0-alpha
[iemejia] [BEAM-7239] Add withDataSourceProviderFn() to JdbcIO
[iemejia] [BEAM-7041] Refactor pool creation to be done via composition
[mxm] [BEAM-7012] Support TestStream in portable Flink Runner
[kcweaver] [BEAM-7134] Spark portable runner: executable stage sinks should have
[github] Update reviewer list for Py3 contributions.
[iemejia] [BEAM-7238] Make sfl4j-simple a runtime only dependency
[iemejia] [BEAM-7238] Make sfl4j-jdk14 a runtime only dependency
[github] [BEAM-7173] Avoiding schema autodetection by default in WriteToBigQuery
[ankurgoenka] Add and disable tests for optimized portable pipeline
[samuelw] Modify StreamingDataflowWorker commit loop to only create a commit
[github] Changes to SDF API to use DoFn Params (#8430)
[amaliujia] [sql] fix non return bug.
[altay] Downgrade missing coder error logs to info logs.
[rezarokni] Add Snippets for 3 new Beam Patterns 2 X FilePatterns 1 X SideInput
[ankurgoenka] Add Python optimized test for Flink
[michal.walenia] [BEAM-7228] Add a Jenkins job running ValidatesRunner tests for Direct
[michal.walenia] [BEAM-7005] Add streaming GBK load test
[ankurgoenka] Moving to 2.14.0-SNAPSHOT on master branch.
[heejong] [BEAM-7257] adding withProducerConfigUpdates
[heejong] [BEAM-7260] UTF8 coder is breaking dataflow tests
[iemejia] [BEAM-7263] Deprecate set/getClientConfiguration in JdbcIO
[iemejia] [BEAM-7265] Update Spark runner to use spark version 2.4.3
[michal.walenia] [BEAM-6627] Add byte and element counting to TextIOIT
[michal.walenia] [BEAM-6627] Add byte and element counting to AvroIOIT
[michal.walenia] [BEAM-6627] Add byte and element counting to ParquetIOIT
[michal.walenia] [BEAM-6627] Add byte and element count metric to XmlIOIT
[michal.walenia] [BEAM-6627] Add byte and element count metric in TFRecordIOIT
[michal.walenia] [BEAM-6627] Add byte and element counter metric to JdbcIOIT
[michal.walenia] [BEAM-6627] Add byte and item count metrics to MongoDBIOIT
[michal.walenia] [BEAM-6627] Add byte and item count metrics to JdbcIOIT
[mxm] [BEAM-7145] Make FlinkRunner compatible with Flink 1.8
[ankurgoenka] [BEAM-7267] Add python3*-dev to verify script
[ankurgoenka] Revert "Merge pull request #8228: [BEAM-7008] adding UTF8 String coder
[ankurgoenka] Revert "Merge pull request #8545 from ihji/BEAM-7260"
[charlesccychen] [BEAM-4858] Increase tolerance on linear regression tests (#8556)
------------------------------------------
[...truncated 10.53 KB...]
- com.google.cloud:google-cloud-core:1.61.0
- com.google.cloud:google-cloud-core-grpc:1.61.0
- com.google.cloud.dataflow:google-cloud-dataflow-java-proto-library-all:0.5.160304
- com.google.cloud:google-cloud-spanner:1.6.0
- com.google.http-client:google-http-client:1.27.0
- com.google.http-client:google-http-client-jackson:1.27.0
- com.google.http-client:google-http-client-jackson2:1.27.0
- io.grpc:grpc-all:1.17.1
- com.google.api.grpc:grpc-google-cloud-bigtable-v2:0.44.0
- com.google.api.grpc:grpc-google-cloud-datacatalog-v1beta1:0.4.0-alpha
- com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.43.0
- com.google.guava:guava-testlib:20.0
- org.apache.hadoop:hadoop-client:2.7.3
- org.apache.hadoop:hadoop-common:2.7.3
- org.apache.hadoop:hadoop-hdfs:2.7.3
- org.apache.hadoop:hadoop-mapreduce-client-core:2.7.3
- org.apache.hadoop:hadoop-minicluster:2.7.3
- org.hamcrest:hamcrest-core:2.1
- org.hamcrest:hamcrest-library:2.1
- org.fusesource.hawtbuf:hawtbuf:1.11
- org.apache.httpcomponents:httpasyncclient:4.1.4
- com.fasterxml.jackson.core:jackson-annotations:2.9.8
- com.fasterxml.jackson.core:jackson-core:2.9.8
- com.fasterxml.jackson.core:jackson-databind:2.9.8
- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:2.9.8
- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:2.9.8
- com.fasterxml.jackson.datatype:jackson-datatype-joda:2.9.8
- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:2.9.8
- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.9.8
- javax.xml.bind:jaxb-api:2.2.12
- net.jcip:jcip-annotations:1.0
- joda-time:joda-time:2.10.1
- com.jayway.jsonpath:json-path:2.4.0
- com.google.code.findbugs:jsr305:3.0.2
- com.pholser:junit-quickcheck-core:0.8
- org.apache.kafka:kafka-clients:1.0.0
- org.apache.kafka:kafka_2.11:1.0.0
- org.apache.kudu:kudu-client:1.9.0
- org.apache.logging.log4j:log4j-api:2.6.2
- org.apache.logging.log4j:log4j-core:2.6.2
- org.apache.apex:malhar-library:3.4.0
- org.mockito:mockito-core:1.10.19
- org.fusesource.mqtt-client:mqtt-client:1.15
- io.netty:netty-handler:4.1.30.Final
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin:0.4.0
- org.postgresql:postgresql:42.2.2
- org.powermock:powermock-mockito-release-full:1.6.4
- com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.44.0
- com.google.api.grpc:proto-google-cloud-datacatalog-v1beta1:0.4.0-alpha
- com.google.api.grpc:proto-google-cloud-datastore-v1:0.44.0
- com.google.api.grpc:proto-google-cloud-pubsub-v1:1.43.0
- com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.6.0
- org.apache.samza:samza-api:1.1.0
- org.apache.samza:samza-core_2.11:1.1.0
- org.apache.samza:samza-kafka_2.11:1.1.0
- org.apache.samza:samza-kv-inmemory_2.11:1.1.0
- org.apache.samza:samza-kv-rocksdb_2.11:1.1.0
- org.apache.samza:samza-kv_2.11:1.1.0
- org.apache.samza:samza-yarn_2.11:1.1.0
- org.slf4j:slf4j-simple:1.7.25
- org.xerial.snappy:snappy-java:1.1.4
- org.apache.spark:spark-core_2.11:2.4.3
- org.apache.spark:spark-network-common_2.11:2.4.3
- org.apache.spark:spark-streaming_2.11:2.4.3
- org.codehaus.woodstox:stax2-api:3.1.4
- com.tdunning:t-digest:3.2
- org.apache.tika:tika-core:1.20
- org.apache.tika:tika-parsers:1.20
- com.google.cloud.bigdataoss:util:1.9.16
- org.codehaus.woodstox:woodstox-core-asl:4.4.1
- org.tukaani:xz:1.8
- com.github.luben:zstd-jni:1.3.8-3
The following dependencies have later release versions:
- com.rabbitmq:amqp-client [4.9.3 -> 5.7.0]
- org.assertj:assertj-core [3.11.1 -> 3.12.2]
- com.google.auto.service:auto-service [1.0-rc2 -> 1.0-rc5]
- com.google.auto.value:auto-value [1.6.3 -> 1.6.5]
- com.google.auto.value:auto-value-annotations [1.6.3 -> 1.6.5]
- org.apache.calcite.avatica:avatica-core [1.13.0 -> 1.15.0]
- biz.aQute:bndlib [1.43.0 -> 2.0.0.20130123-133441]
- org.apache.cassandra:cassandra-all [3.11.3 -> 3.11.4]
- org.testcontainers:clickhouse [1.10.5 -> 1.11.2]
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.1.53]
- com.github.ben-manes.versions:com.github.ben-manes.versions.gradle.plugin [0.17.0 -> 0.21.0]
- com.gradle.build-scan:com.gradle.build-scan.gradle.plugin [2.1 -> 2.3]
- commons-cli:commons-cli [1.2 -> 1.4]
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.0.12]
- com.typesafe:config [1.3.0 -> 1.3.4]
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.1.0]
- org.apache.derby:derby [10.14.2.0 -> 10.15.1.3]
- org.apache.derby:derbyclient [10.14.2.0 -> 10.15.1.3]
- org.apache.derby:derbynet [10.14.2.0 -> 10.15.1.3]
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.14.6]
- org.elasticsearch:elasticsearch [2.4.1 -> 7.0.1]
- org.elasticsearch:elasticsearch [5.0.0 -> 7.0.1]
- org.elasticsearch:elasticsearch [5.6.3 -> 7.0.1]
- org.elasticsearch:elasticsearch [6.4.0 -> 7.0.1]
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.0.1]
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.0.1]
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.0.1]
- com.google.errorprone:error_prone_annotations [2.0.15 -> 2.3.3]
- com.google.errorprone:error_prone_annotations [2.1.2 -> 2.3.3]
- com.alibaba:fastjson [1.2.49 -> 1.2.58]
- org.apache.flink:flink-clients_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-clients_2.11 [1.6.4 -> 1.8.0]
- org.apache.flink:flink-clients_2.11 [1.7.2 -> 1.8.0]
- org.apache.flink:flink-core [1.5.6 -> 1.8.0]
- org.apache.flink:flink-core [1.6.4 -> 1.8.0]
- org.apache.flink:flink-core [1.7.2 -> 1.8.0]
- org.apache.flink:flink-java [1.5.6 -> 1.8.0]
- org.apache.flink:flink-java [1.6.4 -> 1.8.0]
- org.apache.flink:flink-java [1.7.2 -> 1.8.0]
- org.apache.flink:flink-metrics-core [1.5.6 -> 1.8.0]
- org.apache.flink:flink-metrics-core [1.6.4 -> 1.8.0]
- org.apache.flink:flink-metrics-core [1.7.2 -> 1.8.0]
- org.apache.flink:flink-runtime_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-runtime_2.11 [1.6.4 -> 1.8.0]
- org.apache.flink:flink-runtime_2.11 [1.7.2 -> 1.8.0]
- org.apache.flink:flink-streaming-java_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-streaming-java_2.11 [1.6.4 -> 1.8.0]
- org.apache.flink:flink-streaming-java_2.11 [1.7.2 -> 1.8.0]
- org.apache.flink:flink-test-utils_2.11 [1.5.6 -> 1.8.0]
- org.apache.flink:flink-test-utils_2.11 [1.6.4 -> 1.8.0]
- org.apache.flink:flink-test-utils_2.11 [1.7.2 -> 1.8.0]
- org.elasticsearch.test:framework [5.6.3 -> 7.0.1]
- org.elasticsearch.test:framework [6.4.0 -> 7.0.1]
- com.google.auth:google-auth-library-credentials [0.10.0 -> 0.15.0]
- com.google.auth:google-auth-library-credentials [0.12.0 -> 0.15.0]
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.0-beta-1]
- io.grpc:grpc-auth [1.13.1 -> 1.20.0]
- io.grpc:grpc-auth [1.17.1 -> 1.20.0]
- io.grpc:grpc-context [1.13.1 -> 1.20.0]
- io.grpc:grpc-core [1.13.1 -> 1.20.0]
- io.grpc:grpc-core [1.17.1 -> 1.20.0]
- io.grpc:grpc-netty [1.13.1 -> 1.20.0]
- io.grpc:grpc-netty [1.17.1 -> 1.20.0]
- io.grpc:grpc-protobuf [1.13.1 -> 1.20.0]
- io.grpc:grpc-stub [1.13.1 -> 1.20.0]
- io.grpc:grpc-stub [1.17.1 -> 1.20.0]
- io.grpc:grpc-testing [1.13.1 -> 1.20.0]
- com.google.code.gson:gson [2.7 -> 2.8.5]
- com.google.guava:guava [20.0 -> 27.1-jre]
- org.apache.hbase:hbase-common [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-hadoop-compat [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-hadoop2-compat [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-server [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-shaded-client [1.2.6 -> 2.1.4]
- org.apache.hbase:hbase-shaded-server [1.2.6 -> 2.0.0-alpha2]
- org.apache.hive:hive-cli [2.1.0 -> 3.1.1]
- org.apache.hive:hive-common [2.1.0 -> 3.1.1]
- org.apache.hive:hive-exec [2.1.0 -> 3.1.1]
- org.apache.hive.hcatalog:hive-hcatalog-core [2.1.0 -> 3.1.1]
- org.apache.httpcomponents:httpclient [4.5.6 -> 4.5.8]
- org.apache.httpcomponents:httpcore [4.4.10 -> 4.4.11]
- org.apache.httpcomponents:httpcore-nio [4.4.10 -> 4.4.11]
- org.codehaus.janino:janino [3.0.11 -> 3.0.12]
- net.java.dev.javacc:javacc [4.0 -> 7.0.4]
- javax.servlet:javax.servlet-api [3.1.0 -> 4.0.1]
- org.slf4j:jcl-over-slf4j [1.7.25 -> 1.8.0-beta4]
- redis.clients:jedis [3.0.1 -> 3.1.0-m1]
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 9.4.18.v20190429]
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 9.4.18.v20190429]
- jline:jline [2.14.6 -> 3.0.0.M1]
- net.java.dev.jna:jna [4.1.0 -> 5.3.1]
- junit:junit [4.13-beta-1 -> 4.13-beta-3]
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.31]
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.31]
- com.esotericsoftware:kryo [4.0.2 -> 5.0.0-RC4]
- com.esotericsoftware.kryo:kryo [2.21 -> 2.24.0]
- io.dropwizard.metrics:metrics-core [3.1.2 -> 4.1.0]
- org.mongodb:mongo-java-driver [3.9.1 -> 3.11.0-beta3]
- net.researchgate.release:net.researchgate.release.gradle.plugin [2.6.0 -> 2.8.0]
- io.netty:netty-all [4.1.17.Final -> 5.0.0.Alpha2]
- io.netty:netty-all [4.1.30.Final -> 5.0.0.Alpha2]
- io.netty:netty-tcnative-boringssl-static [2.0.17.Final -> 2.0.25.Final]
- io.netty:netty-tcnative-boringssl-static [2.0.8.Final -> 2.0.25.Final]
- io.netty:netty-transport-native-epoll [4.1.25.Final -> 5.0.0.Alpha2]
- io.netty:netty-transport-native-epoll [4.1.30.Final -> 5.0.0.Alpha2]
- io.opencensus:opencensus-api [0.12.3 -> 0.21.0]
- io.opencensus:opencensus-contrib-grpc-metrics [0.12.3 -> 0.21.0]
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 -> 1.3.31]
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.7.1]
- org.apache.parquet:parquet-avro [1.10.0 -> 1.10.1]
- org.apache.parquet:parquet-common [1.10.0 -> 1.10.1]
- org.apache.parquet:parquet-hadoop [1.10.0 -> 1.10.1]
- com.google.api.grpc:proto-google-common-protos [1.12.0 -> 1.16.0]
- com.google.protobuf:protobuf-java [3.6.0 -> 3.8.0-rc-1]
- com.google.protobuf:protobuf-java-util [3.6.0 -> 3.8.0-rc-1]
- com.google.protobuf:protoc [3.6.0 -> 3.8.0-rc-1]
- io.grpc:protoc-gen-grpc-java [1.13.1 -> 1.20.0]
- org.apache.qpid:proton-j [0.13.1 -> 0.33.0]
- org.apache.qpid:qpid-broker [0.28 -> 7.1.2]
- org.apache.qpid:qpid-broker-core [0.28 -> 7.1.2]
- com.carrotsearch.randomizedtesting:randomizedtesting-runner [2.3.2 -> 2.7.3]
- com.carrotsearch.randomizedtesting:randomizedtesting-runner [2.5.0 -> 2.7.3]
- com.carrotsearch.randomizedtesting:randomizedtesting-runner [2.5.2 -> 2.7.3]
- io.findify:s3mock_2.12 [0.2.4 -> 0.2.5]
- org.scala-lang:scala-library [2.11.8 -> 2.13.0-RC1]
- org.scala-lang:scala-library [2.12.7 -> 2.13.0-RC1]
- org.slf4j:slf4j-api [1.7.25 -> 1.8.0-beta4]
- org.slf4j:slf4j-jdk14 [1.7.25 -> 1.8.0-beta4]
- org.apache.solr:solr-core [5.5.4 -> 8.1.0]
- org.apache.solr:solr-solrj [5.5.4 -> 8.1.0]
- org.apache.solr:solr-test-framework [5.5.4 -> 8.1.0]
- com.github.spotbugs:spotbugs-annotations [3.1.11 -> 4.0.0-beta1]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.1.7.RELEASE]
- sqlline:sqlline [1.4.0 -> 1.7.0]
- com.clearspring.analytics:stream [2.9.5 -> 2.9.6]
- org.elasticsearch.client:transport [5.0.0 -> 7.0.1]
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.0.1]
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.0.1]
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.0.1]
- org.apache.zookeeper:zookeeper [3.4.11 -> 3.5.4-beta]
Generated report file build/dependencyUpdates/report.txt
> Task :beam-sdks-python:dependencyUpdates FAILED
# Virtualenv for the rest of the script to run setup
/usr/bin/virtualenv sdks/python
./scripts/run_dependency_check.sh: line 24: /usr/bin/virtualenv: No such file or directory
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'> line: 388
* What went wrong:
Execution failed for task ':beam-sdks-python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 37s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/hoo5crhpbsgq6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Beam Dependency Check Report (2019-05-13)
Posted by Apache Jenkins Server <je...@builds.apache.org>.
ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html'
does not exist