You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/24 18:31:19 UTC
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36
#136
See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/136/display/redirect?page=changes>
Changes:
[zyichi] Fix erros in py sdk io utils and add unit tests
[gunnar.schulze] [BEAM-7572] ApproximateUnique.Globally and ApproximateUnique.PerKey
[lukasz.gajowy] [BEAM-7307] Fix load tests failures due to mistakes in PR 8881
------------------------------------------
[...truncated 15.90 KB...]
--beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it
--beam_it_timeout=1200
--beam_it_module=sdks/python/test-suites/dataflow/py36
--beam_sdk=python
--k8s_get_wait_interval=10
--bigquery_table=beam_performance.wordcount_py36_pkb_results
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE
--beam_prebuilt
--dpb_service_zone=fake_zone
--project=apache-beam-testing
--official
--dpb_log_level=INFO
--beam_location=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src>
--beam_runner=TestDataflowRunner
--k8s_get_retry_count=36
--benchmarks=beam_integration_benchmark
--beam_python_sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz
2019-06-24 18:31:06,788 a8f594c7 MainThread INFO Setting --max_concurrent_threads=200.
2019-06-24 18:31:06,810 a8f594c7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2019-06-24 18:31:06,831 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2019-06-24 18:31:06,834 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2019-06-24 18:31:06,834 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2019-06-24 18:31:06,841 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Running: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan
2019-06-24 18:31:17,623 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Ran: {<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan} ReturnCode:1
STDOUT: Initialized native services in: /home/jenkins/.gradle/native
Removing 0 daemon stop events from registry
Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details
Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/5.2.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xss10240k -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-5.2.1-all/bviwmvmbexq6idcscbicws5me/gradle-5.2.1/lib/gradle-launcher-5.2.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 5.2.1
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 0.78 secs.
The client will now receive all logging from the daemon (pid: 8293). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-8293.out.log
Starting build in new daemon [memory: 24.4 GB]
Using 16 worker leases.
Starting Build
Using local directory build cache for build ':buildSrc' (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
> Configure project :buildSrc
Evaluating project ':buildSrc' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/build.gradle'.>
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Selected primary task 'build' from project :
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/java',> not found
Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files.
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.047 secs.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileGroovy FROM-CACHE
Build cache key for task ':buildSrc:compileGroovy' is 8a7c9ae67ae63d6687cac98f536a861a
Task ':buildSrc:compileGroovy' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@50ba1135: {executionTime=2628, hostName=apache-beam-jenkins-13, operatingSystem=Linux, buildInvocationId=7ckv3bp6kbgslbalges2pjwhgm, creationTime=1560986869311, identity=:compileGroovy, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java/src/buildSrc}
Unpacked trees for task ':buildSrc:compileGroovy' from cache.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.224 secs.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:pluginDescriptors
Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710
Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task
Task ':buildSrc:pluginDescriptors' is not up-to-date because:
No history is available.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.021 secs.
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:processResources
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816
Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task
Task ':buildSrc:processResources' is not up-to-date because:
No history is available.
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.032 secs.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:classes
Skipping task ':buildSrc:classes' as it has no actions.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:jar
Build cache key for task ':buildSrc:jar' is 50818b48dc0ad46ca18e3c5f2a5b2c5f
Caching disabled for task ':buildSrc:jar': Caching has not been enabled for the task
Task ':buildSrc:jar' is not up-to-date because:
No history is available.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.219 secs.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:assemble
Skipping task ':buildSrc:assemble' as it has no actions.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovy
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Caching disabled for task ':buildSrc:spotlessGroovy': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovy' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovy'.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 1.858 secs.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyCheck
Skipping task ':buildSrc:spotlessGroovyCheck' as it has no actions.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradle
Caching disabled for task ':buildSrc:spotlessGroovyGradle': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovyGradle' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovyGradle'.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.044 secs.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradleCheck
Skipping task ':buildSrc:spotlessGroovyGradleCheck' as it has no actions.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:spotlessCheck
Skipping task ':buildSrc:spotlessCheck' as it has no actions.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.0 secs.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:pluginUnderTestMetadata
Build cache key for task ':buildSrc:pluginUnderTestMetadata' is 22dcf73f949f06ae392c8946d12d76a4
Caching disabled for task ':buildSrc:pluginUnderTestMetadata': Caching has not been enabled for the task
Task ':buildSrc:pluginUnderTestMetadata' is not up-to-date because:
No history is available.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.228 secs.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:compileTestJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/java',> not found
Skipping task ':buildSrc:compileTestJava' as it has no source files and no previous output files.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.002 secs.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:compileTestGroovy NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Skipping task ':buildSrc:compileTestGroovy' as it has no source files and no previous output files.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.001 secs.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:processTestResources NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/resources',> not found
Skipping task ':buildSrc:processTestResources' as it has no source files and no previous output files.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.001 secs.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:testClasses UP-TO-DATE
Skipping task ':buildSrc:testClasses' as it has no actions.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.0 secs.
:buildSrc:test (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:test NO-SOURCE
Skipping task ':buildSrc:test' as it has no source files and no previous output files.
:buildSrc:test (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.002 secs.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:validateTaskProperties FROM-CACHE
Build cache key for task ':buildSrc:validateTaskProperties' is 782135718446b937b9134dd382ca2e74
Task ':buildSrc:validateTaskProperties' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@31c70fe0: {executionTime=209, hostName=apache-beam-jenkins-13, operatingSystem=Linux, buildInvocationId=7ckv3bp6kbgslbalges2pjwhgm, creationTime=1560986872126, identity=:validateTaskProperties, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java/src/buildSrc}
Unpacked trees for task ':buildSrc:validateTaskProperties' from cache.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.01 secs.
:buildSrc:check (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:check
Skipping task ':buildSrc:check' as it has no actions.
:buildSrc:check (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.0 secs.
:buildSrc:build (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) started.
> Task :buildSrc:build
Skipping task ':buildSrc:build' as it has no actions.
:buildSrc:build (Thread[Execution worker for ':buildSrc' Thread 6,5,main]) completed. Took 0.0 secs.
Settings evaluated using settings file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/settings.gradle'.>
Using local directory build cache for the root build (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
Projects loaded. Root project using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Included projects: [root project 'beam', project ':beam-test-infra-metrics', project ':beam-test-tools', project ':examples', project ':model', project ':release', project ':runners', project ':sdks', project ':vendor', project ':website', project ':examples:java', project ':examples:kotlin', project ':model:fn-execution', project ':model:job-management', project ':model:pipeline', project ':runners:apex', project ':runners:core-construction-java', project ':runners:core-java', project ':runners:direct-java', project ':runners:extensions-java', project ':runners:flink', project ':runners:gearpump', project ':runners:google-cloud-dataflow-java', project ':runners:java-fn-execution', project ':runners:jet-experimental', project ':runners:local-java', project ':runners:reference', project ':runners:samza', project ':runners:spark', project ':sdks:go', project ':sdks:java', project ':sdks:python', project ':vendor:bytebuddy-1_9_3', project ':vendor:grpc-1_13_1', project ':vendor:guava-20_0', project ':vendor:sdks-java-extensions-protobuf', project ':runners:extensions-java:metrics', project ':runners:flink:1.5', project ':runners:flink:1.6', project ':runners:flink:1.7', project ':runners:flink:1.8', project ':runners:google-cloud-dataflow-java:examples', project ':runners:google-cloud-dataflow-java:examples-streaming', project ':runners:google-cloud-dataflow-java:worker', project ':runners:reference:java', project ':runners:samza:job-server', project ':runners:spark:job-server', project ':sdks:go:container', project ':sdks:go:examples', project ':sdks:go:test', project ':sdks:java:bom', project ':sdks:java:build-tools', project ':sdks:java:container', project ':sdks:java:core', project ':sdks:java:extensions', project ':sdks:java:fn-execution', project ':sdks:java:harness', project ':sdks:java:io', project ':sdks:java:javadoc', project ':sdks:java:maven-archetypes', project ':sdks:java:testing', project ':sdks:python:apache_beam', project ':sdks:python:container', project ':sdks:python:test-suites', project ':runners:flink:1.5:job-server', project ':runners:flink:1.5:job-server-container', project ':runners:flink:1.6:job-server', project ':runners:flink:1.6:job-server-container', project ':runners:flink:1.7:job-server', project ':runners:flink:1.7:job-server-container', project ':runners:flink:1.8:job-server', project ':runners:flink:1.8:job-server-container', project ':runners:google-cloud-dataflow-java:worker:legacy-worker', project ':runners:google-cloud-dataflow-java:worker:windmill', project ':sdks:java:extensions:euphoria', project ':sdks:java:extensions:google-cloud-platform-core', project ':sdks:java:extensions:jackson', project ':sdks:java:extensions:join-library', project ':sdks:java:extensions:kryo', project ':sdks:java:extensions:protobuf', project ':sdks:java:extensions:sketching', project ':sdks:java:extensions:sorter', project ':sdks:java:extensions:sql', project ':sdks:java:io:amazon-web-services', project ':sdks:java:io:amqp', project ':sdks:java:io:cassandra', project ':sdks:java:io:clickhouse', project ':sdks:java:io:common', project ':sdks:java:io:elasticsearch', project ':sdks:java:io:elasticsearch-tests', project ':sdks:java:io:file-based-io-tests', project ':sdks:java:io:google-cloud-platform', project ':sdks:java:io:hadoop-common', project ':sdks:java:io:hadoop-file-system', project ':sdks:java:io:hadoop-format', project ':sdks:java:io:hbase', project ':sdks:java:io:hcatalog', project ':sdks:java:io:jdbc', project ':sdks:java:io:jms', project ':sdks:java:io:kafka', project ':sdks:java:io:kinesis', project ':sdks:java:io:kudu', project ':sdks:java:io:mongodb', project ':sdks:java:io:mqtt', project ':sdks:java:io:parquet', project ':sdks:java:io:rabbitmq', project ':sdks:java:io:redis', project ':sdks:java:io:solr', project ':sdks:java:io:synthetic', project ':sdks:java:io:tika', project ':sdks:java:io:xml', project ':sdks:java:maven-archetypes:examples', project ':sdks:java:maven-archetypes:starter', project ':sdks:java:testing:load-tests', project ':sdks:java:testing:nexmark', project ':sdks:java:testing:test-utils', project ':sdks:python:apache_beam:testing', project ':sdks:python:container:py3', project ':sdks:python:test-suites:dataflow', project ':sdks:python:test-suites:direct', project ':sdks:python:test-suites:portable', project ':sdks:python:test-suites:tox', project ':sdks:java:extensions:sql:datacatalog', project ':sdks:java:extensions:sql:hcatalog', project ':sdks:java:extensions:sql:jdbc', project ':sdks:java:extensions:sql:shell', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-2', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-5', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-6', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-common', project ':sdks:python:apache_beam:testing:load_tests', project ':sdks:python:test-suites:dataflow:py35', project ':sdks:python:test-suites:dataflow:py36', project ':sdks:python:test-suites:dataflow:py37', project ':sdks:python:test-suites:direct:py35', project ':sdks:python:test-suites:direct:py36', project ':sdks:python:test-suites:direct:py37', project ':sdks:python:test-suites:portable:py35', project ':sdks:python:test-suites:tox:py35', project ':sdks:python:test-suites:tox:py36', project ':sdks:python:test-suites:tox:py37']
Configuration on demand is an incubating feature.
> Configure project :
Evaluating root project 'beam' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Offline dependencies root configured at 'offline-repository'
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
Publishing build scan...
https://gradle.com/s/ppygf7sllze5m
STDERR:
FAILURE: Build failed with an exception.
* What went wrong:
Project 'sdks/python/test-suites/dataflow/py36' not found in root project 'beam'.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 9s
2019-06-24 18:31:17,625 a8f594c7 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-24 18:31:17,626 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-06-24 18:31:17,628 a8f594c7 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 903, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-24 18:31:17,628 a8f594c7 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-06-24 18:31:17,628 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-06-24 18:31:17,628 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/a8f594c7/pkb.log>
2019-06-24 18:31:17,628 a8f594c7 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/a8f594c7/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_WordCountIT_Py36 #140
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/140/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36
#139
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/139/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-7606] Fix JDBC time conversion tests
[robertwb] Update portable schema representation and java SchemaTranslation (#8853)
------------------------------------------
[...truncated 15.88 KB...]
--beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it
--beam_it_timeout=1200
--beam_it_module=sdks/python/test-suites/dataflow/py36
--beam_sdk=python
--k8s_get_wait_interval=10
--bigquery_table=beam_performance.wordcount_py36_pkb_results
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE
--beam_prebuilt
--dpb_service_zone=fake_zone
--project=apache-beam-testing
--official
--dpb_log_level=INFO
--beam_location=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src>
--beam_runner=TestDataflowRunner
--k8s_get_retry_count=36
--benchmarks=beam_integration_benchmark
--beam_python_sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz
2019-06-25 12:44:06,008 2b7e2283 MainThread INFO Setting --max_concurrent_threads=200.
2019-06-25 12:44:06,029 2b7e2283 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2019-06-25 12:44:06,052 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2019-06-25 12:44:06,054 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2019-06-25 12:44:06,055 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2019-06-25 12:44:06,064 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Running: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan
2019-06-25 12:44:16,408 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Ran: {<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan} ReturnCode:1
STDOUT: Initialized native services in: /home/jenkins/.gradle/native
Removing 0 daemon stop events from registry
Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details
Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/5.2.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xss10240k -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-5.2.1-all/bviwmvmbexq6idcscbicws5me/gradle-5.2.1/lib/gradle-launcher-5.2.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 5.2.1
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 0.792 secs.
The client will now receive all logging from the daemon (pid: 11228). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-11228.out.log
Starting build in new daemon [memory: 24.4 GB]
Using 16 worker leases.
Starting Build
Using local directory build cache for build ':buildSrc' (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
> Configure project :buildSrc
Evaluating project ':buildSrc' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/build.gradle'.>
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Selected primary task 'build' from project :
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/java',> not found
Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files.
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.036 secs.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileGroovy FROM-CACHE
Build cache key for task ':buildSrc:compileGroovy' is 8a7c9ae67ae63d6687cac98f536a861a
Task ':buildSrc:compileGroovy' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@433f64a4: {executionTime=3732, hostName=apache-beam-jenkins-8, operatingSystem=Linux, buildInvocationId=7gsvpnzzlfgnhfylbcnuhakvxm, creationTime=1560983424407, identity=:compileGroovy, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src/buildSrc}
Unpacked trees for task ':buildSrc:compileGroovy' from cache.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.152 secs.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:pluginDescriptors
Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710
Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task
Task ':buildSrc:pluginDescriptors' is not up-to-date because:
No history is available.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.019 secs.
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:processResources
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816
Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task
Task ':buildSrc:processResources' is not up-to-date because:
No history is available.
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.025 secs.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:classes
Skipping task ':buildSrc:classes' as it has no actions.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:jar
Build cache key for task ':buildSrc:jar' is 50818b48dc0ad46ca18e3c5f2a5b2c5f
Caching disabled for task ':buildSrc:jar': Caching has not been enabled for the task
Task ':buildSrc:jar' is not up-to-date because:
No history is available.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.198 secs.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:assemble
Skipping task ':buildSrc:assemble' as it has no actions.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovy
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Caching disabled for task ':buildSrc:spotlessGroovy': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovy' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovy'.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 1.823 secs.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyCheck
Skipping task ':buildSrc:spotlessGroovyCheck' as it has no actions.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradle
Caching disabled for task ':buildSrc:spotlessGroovyGradle': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovyGradle' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovyGradle'.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.041 secs.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradleCheck
Skipping task ':buildSrc:spotlessGroovyGradleCheck' as it has no actions.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc' Thread 12,5,main]) started.
> Task :buildSrc:spotlessCheck
Skipping task ':buildSrc:spotlessCheck' as it has no actions.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc' Thread 12,5,main]) completed. Took 0.0 secs.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:pluginUnderTestMetadata
Build cache key for task ':buildSrc:pluginUnderTestMetadata' is 22dcf73f949f06ae392c8946d12d76a4
Caching disabled for task ':buildSrc:pluginUnderTestMetadata': Caching has not been enabled for the task
Task ':buildSrc:pluginUnderTestMetadata' is not up-to-date because:
No history is available.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.207 secs.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:compileTestJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/java',> not found
Skipping task ':buildSrc:compileTestJava' as it has no source files and no previous output files.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.002 secs.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:compileTestGroovy NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Skipping task ':buildSrc:compileTestGroovy' as it has no source files and no previous output files.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.002 secs.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:processTestResources NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/resources',> not found
Skipping task ':buildSrc:processTestResources' as it has no source files and no previous output files.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.001 secs.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:testClasses UP-TO-DATE
Skipping task ':buildSrc:testClasses' as it has no actions.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.0 secs.
:buildSrc:test (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:test NO-SOURCE
Skipping task ':buildSrc:test' as it has no source files and no previous output files.
:buildSrc:test (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.002 secs.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:validateTaskProperties FROM-CACHE
Build cache key for task ':buildSrc:validateTaskProperties' is 782135718446b937b9134dd382ca2e74
Task ':buildSrc:validateTaskProperties' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@76c2e647: {executionTime=322, hostName=apache-beam-jenkins-8, operatingSystem=Linux, buildInvocationId=7gsvpnzzlfgnhfylbcnuhakvxm, creationTime=1560983427813, identity=:validateTaskProperties, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src/buildSrc}
Unpacked trees for task ':buildSrc:validateTaskProperties' from cache.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.01 secs.
:buildSrc:check (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:check
Skipping task ':buildSrc:check' as it has no actions.
:buildSrc:check (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.0 secs.
:buildSrc:build (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) started.
> Task :buildSrc:build
Skipping task ':buildSrc:build' as it has no actions.
:buildSrc:build (Thread[Execution worker for ':buildSrc' Thread 14,5,main]) completed. Took 0.0 secs.
Settings evaluated using settings file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/settings.gradle'.>
Using local directory build cache for the root build (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
Projects loaded. Root project using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Included projects: [root project 'beam', project ':beam-test-infra-metrics', project ':beam-test-tools', project ':examples', project ':model', project ':release', project ':runners', project ':sdks', project ':vendor', project ':website', project ':examples:java', project ':examples:kotlin', project ':model:fn-execution', project ':model:job-management', project ':model:pipeline', project ':runners:apex', project ':runners:core-construction-java', project ':runners:core-java', project ':runners:direct-java', project ':runners:extensions-java', project ':runners:flink', project ':runners:gearpump', project ':runners:google-cloud-dataflow-java', project ':runners:java-fn-execution', project ':runners:jet-experimental', project ':runners:local-java', project ':runners:reference', project ':runners:samza', project ':runners:spark', project ':sdks:go', project ':sdks:java', project ':sdks:python', project ':vendor:bytebuddy-1_9_3', project ':vendor:grpc-1_13_1', project ':vendor:guava-20_0', project ':vendor:sdks-java-extensions-protobuf', project ':runners:extensions-java:metrics', project ':runners:flink:1.5', project ':runners:flink:1.6', project ':runners:flink:1.7', project ':runners:flink:1.8', project ':runners:google-cloud-dataflow-java:examples', project ':runners:google-cloud-dataflow-java:examples-streaming', project ':runners:google-cloud-dataflow-java:worker', project ':runners:reference:java', project ':runners:samza:job-server', project ':runners:spark:job-server', project ':sdks:go:container', project ':sdks:go:examples', project ':sdks:go:test', project ':sdks:java:bom', project ':sdks:java:build-tools', project ':sdks:java:container', project ':sdks:java:core', project ':sdks:java:extensions', project ':sdks:java:fn-execution', project ':sdks:java:harness', project ':sdks:java:io', project ':sdks:java:javadoc', project ':sdks:java:maven-archetypes', project ':sdks:java:testing', project ':sdks:python:apache_beam', project ':sdks:python:container', project ':sdks:python:test-suites', project ':runners:flink:1.5:job-server', project ':runners:flink:1.5:job-server-container', project ':runners:flink:1.6:job-server', project ':runners:flink:1.6:job-server-container', project ':runners:flink:1.7:job-server', project ':runners:flink:1.7:job-server-container', project ':runners:flink:1.8:job-server', project ':runners:flink:1.8:job-server-container', project ':runners:google-cloud-dataflow-java:worker:legacy-worker', project ':runners:google-cloud-dataflow-java:worker:windmill', project ':sdks:java:extensions:euphoria', project ':sdks:java:extensions:google-cloud-platform-core', project ':sdks:java:extensions:jackson', project ':sdks:java:extensions:join-library', project ':sdks:java:extensions:kryo', project ':sdks:java:extensions:protobuf', project ':sdks:java:extensions:sketching', project ':sdks:java:extensions:sorter', project ':sdks:java:extensions:sql', project ':sdks:java:io:amazon-web-services', project ':sdks:java:io:amqp', project ':sdks:java:io:cassandra', project ':sdks:java:io:clickhouse', project ':sdks:java:io:common', project ':sdks:java:io:elasticsearch', project ':sdks:java:io:elasticsearch-tests', project ':sdks:java:io:file-based-io-tests', project ':sdks:java:io:google-cloud-platform', project ':sdks:java:io:hadoop-common', project ':sdks:java:io:hadoop-file-system', project ':sdks:java:io:hadoop-format', project ':sdks:java:io:hbase', project ':sdks:java:io:hcatalog', project ':sdks:java:io:jdbc', project ':sdks:java:io:jms', project ':sdks:java:io:kafka', project ':sdks:java:io:kinesis', project ':sdks:java:io:kudu', project ':sdks:java:io:mongodb', project ':sdks:java:io:mqtt', project ':sdks:java:io:parquet', project ':sdks:java:io:rabbitmq', project ':sdks:java:io:redis', project ':sdks:java:io:solr', project ':sdks:java:io:synthetic', project ':sdks:java:io:tika', project ':sdks:java:io:xml', project ':sdks:java:maven-archetypes:examples', project ':sdks:java:maven-archetypes:starter', project ':sdks:java:testing:load-tests', project ':sdks:java:testing:nexmark', project ':sdks:java:testing:test-utils', project ':sdks:python:apache_beam:testing', project ':sdks:python:container:py3', project ':sdks:python:test-suites:dataflow', project ':sdks:python:test-suites:direct', project ':sdks:python:test-suites:portable', project ':sdks:python:test-suites:tox', project ':sdks:java:extensions:sql:datacatalog', project ':sdks:java:extensions:sql:hcatalog', project ':sdks:java:extensions:sql:jdbc', project ':sdks:java:extensions:sql:shell', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-2', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-5', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-6', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-common', project ':sdks:python:apache_beam:testing:load_tests', project ':sdks:python:test-suites:dataflow:py35', project ':sdks:python:test-suites:dataflow:py36', project ':sdks:python:test-suites:dataflow:py37', project ':sdks:python:test-suites:direct:py35', project ':sdks:python:test-suites:direct:py36', project ':sdks:python:test-suites:direct:py37', project ':sdks:python:test-suites:portable:py35', project ':sdks:python:test-suites:tox:py35', project ':sdks:python:test-suites:tox:py36', project ':sdks:python:test-suites:tox:py37']
Configuration on demand is an incubating feature.
> Configure project :
Evaluating root project 'beam' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Offline dependencies root configured at 'offline-repository'
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
Publishing build scan...
https://gradle.com/s/bprgrf356uuae
STDERR:
FAILURE: Build failed with an exception.
* What went wrong:
Project 'sdks/python/test-suites/dataflow/py36' not found in root project 'beam'.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 9s
2019-06-25 12:44:16,410 2b7e2283 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-25 12:44:16,411 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-06-25 12:44:16,413 2b7e2283 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 903, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-25 12:44:16,413 2b7e2283 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-06-25 12:44:16,414 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-06-25 12:44:16,414 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/2b7e2283/pkb.log>
2019-06-25 12:44:16,414 2b7e2283 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/2b7e2283/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36
#138
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/138/display/redirect?page=changes>
Changes:
[dcavazos] Add Python snippet for ParDo transform
[aaltay] BEAM-7141: add key value timer callback (#8739)
------------------------------------------
[...truncated 15.85 KB...]
--beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it
--beam_it_timeout=1200
--beam_it_module=sdks/python/test-suites/dataflow/py36
--beam_sdk=python
--k8s_get_wait_interval=10
--bigquery_table=beam_performance.wordcount_py36_pkb_results
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE
--beam_prebuilt
--dpb_service_zone=fake_zone
--project=apache-beam-testing
--official
--dpb_log_level=INFO
--beam_location=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src>
--beam_runner=TestDataflowRunner
--k8s_get_retry_count=36
--benchmarks=beam_integration_benchmark
--beam_python_sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz
2019-06-25 06:27:24,898 a6e0c0ef MainThread INFO Setting --max_concurrent_threads=200.
2019-06-25 06:27:24,919 a6e0c0ef MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2019-06-25 06:27:24,944 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2019-06-25 06:27:24,946 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2019-06-25 06:27:24,947 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2019-06-25 06:27:24,957 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Running: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan
2019-06-25 06:27:36,713 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Ran: {<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan} ReturnCode:1
STDOUT: Initialized native services in: /home/jenkins/.gradle/native
Removing 0 daemon stop events from registry
Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details
Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/5.2.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xss10240k -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-5.2.1-all/bviwmvmbexq6idcscbicws5me/gradle-5.2.1/lib/gradle-launcher-5.2.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 5.2.1
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 0.908 secs.
The client will now receive all logging from the daemon (pid: 31404). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-31404.out.log
Starting build in new daemon [memory: 24.4 GB]
Using 16 worker leases.
Starting Build
Using local directory build cache for build ':buildSrc' (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
> Configure project :buildSrc
Evaluating project ':buildSrc' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/build.gradle'.>
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Selected primary task 'build' from project :
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/java',> not found
Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files.
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.046 secs.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileGroovy FROM-CACHE
Build cache key for task ':buildSrc:compileGroovy' is 8a7c9ae67ae63d6687cac98f536a861a
Task ':buildSrc:compileGroovy' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@2b733bde: {executionTime=3175, hostName=apache-beam-jenkins-9, operatingSystem=Linux, buildInvocationId=nu73dakjrzacjgntodewxxx5wy, creationTime=1560991458834, identity=:compileGroovy, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src/buildSrc}
Unpacked trees for task ':buildSrc:compileGroovy' from cache.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.155 secs.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:pluginDescriptors
Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710
Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task
Task ':buildSrc:pluginDescriptors' is not up-to-date because:
No history is available.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.026 secs.
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:processResources
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816
Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task
Task ':buildSrc:processResources' is not up-to-date because:
No history is available.
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.034 secs.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:classes
Skipping task ':buildSrc:classes' as it has no actions.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:jar
Build cache key for task ':buildSrc:jar' is 50818b48dc0ad46ca18e3c5f2a5b2c5f
Caching disabled for task ':buildSrc:jar': Caching has not been enabled for the task
Task ':buildSrc:jar' is not up-to-date because:
No history is available.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.226 secs.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:assemble
Skipping task ':buildSrc:assemble' as it has no actions.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovy
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Caching disabled for task ':buildSrc:spotlessGroovy': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovy' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovy'.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 1.991 secs.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyCheck
Skipping task ':buildSrc:spotlessGroovyCheck' as it has no actions.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradle
Caching disabled for task ':buildSrc:spotlessGroovyGradle': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovyGradle' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovyGradle'.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.049 secs.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradleCheck
Skipping task ':buildSrc:spotlessGroovyGradleCheck' as it has no actions.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessCheck
Skipping task ':buildSrc:spotlessCheck' as it has no actions.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:pluginUnderTestMetadata
Build cache key for task ':buildSrc:pluginUnderTestMetadata' is 22dcf73f949f06ae392c8946d12d76a4
Caching disabled for task ':buildSrc:pluginUnderTestMetadata': Caching has not been enabled for the task
Task ':buildSrc:pluginUnderTestMetadata' is not up-to-date because:
No history is available.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.239 secs.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileTestJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/java',> not found
Skipping task ':buildSrc:compileTestJava' as it has no source files and no previous output files.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.004 secs.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileTestGroovy NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Skipping task ':buildSrc:compileTestGroovy' as it has no source files and no previous output files.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.003 secs.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:processTestResources NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/resources',> not found
Skipping task ':buildSrc:processTestResources' as it has no source files and no previous output files.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.001 secs.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:testClasses UP-TO-DATE
Skipping task ':buildSrc:testClasses' as it has no actions.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:test (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:test NO-SOURCE
Skipping task ':buildSrc:test' as it has no source files and no previous output files.
:buildSrc:test (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.004 secs.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:validateTaskProperties FROM-CACHE
Build cache key for task ':buildSrc:validateTaskProperties' is 782135718446b937b9134dd382ca2e74
Task ':buildSrc:validateTaskProperties' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@57ef7aba: {executionTime=232, hostName=apache-beam-jenkins-9, operatingSystem=Linux, buildInvocationId=nu73dakjrzacjgntodewxxx5wy, creationTime=1560991462302, identity=:validateTaskProperties, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src/buildSrc}
Unpacked trees for task ':buildSrc:validateTaskProperties' from cache.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.015 secs.
:buildSrc:check (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:check
Skipping task ':buildSrc:check' as it has no actions.
:buildSrc:check (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:build (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:build
Skipping task ':buildSrc:build' as it has no actions.
:buildSrc:build (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
Settings evaluated using settings file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/settings.gradle'.>
Using local directory build cache for the root build (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
Projects loaded. Root project using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Included projects: [root project 'beam', project ':beam-test-infra-metrics', project ':beam-test-tools', project ':examples', project ':model', project ':release', project ':runners', project ':sdks', project ':vendor', project ':website', project ':examples:java', project ':examples:kotlin', project ':model:fn-execution', project ':model:job-management', project ':model:pipeline', project ':runners:apex', project ':runners:core-construction-java', project ':runners:core-java', project ':runners:direct-java', project ':runners:extensions-java', project ':runners:flink', project ':runners:gearpump', project ':runners:google-cloud-dataflow-java', project ':runners:java-fn-execution', project ':runners:jet-experimental', project ':runners:local-java', project ':runners:reference', project ':runners:samza', project ':runners:spark', project ':sdks:go', project ':sdks:java', project ':sdks:python', project ':vendor:bytebuddy-1_9_3', project ':vendor:grpc-1_13_1', project ':vendor:guava-20_0', project ':vendor:sdks-java-extensions-protobuf', project ':runners:extensions-java:metrics', project ':runners:flink:1.5', project ':runners:flink:1.6', project ':runners:flink:1.7', project ':runners:flink:1.8', project ':runners:google-cloud-dataflow-java:examples', project ':runners:google-cloud-dataflow-java:examples-streaming', project ':runners:google-cloud-dataflow-java:worker', project ':runners:reference:java', project ':runners:samza:job-server', project ':runners:spark:job-server', project ':sdks:go:container', project ':sdks:go:examples', project ':sdks:go:test', project ':sdks:java:bom', project ':sdks:java:build-tools', project ':sdks:java:container', project ':sdks:java:core', project ':sdks:java:extensions', project ':sdks:java:fn-execution', project ':sdks:java:harness', project ':sdks:java:io', project ':sdks:java:javadoc', project ':sdks:java:maven-archetypes', project ':sdks:java:testing', project ':sdks:python:apache_beam', project ':sdks:python:container', project ':sdks:python:test-suites', project ':runners:flink:1.5:job-server', project ':runners:flink:1.5:job-server-container', project ':runners:flink:1.6:job-server', project ':runners:flink:1.6:job-server-container', project ':runners:flink:1.7:job-server', project ':runners:flink:1.7:job-server-container', project ':runners:flink:1.8:job-server', project ':runners:flink:1.8:job-server-container', project ':runners:google-cloud-dataflow-java:worker:legacy-worker', project ':runners:google-cloud-dataflow-java:worker:windmill', project ':sdks:java:extensions:euphoria', project ':sdks:java:extensions:google-cloud-platform-core', project ':sdks:java:extensions:jackson', project ':sdks:java:extensions:join-library', project ':sdks:java:extensions:kryo', project ':sdks:java:extensions:protobuf', project ':sdks:java:extensions:sketching', project ':sdks:java:extensions:sorter', project ':sdks:java:extensions:sql', project ':sdks:java:io:amazon-web-services', project ':sdks:java:io:amqp', project ':sdks:java:io:cassandra', project ':sdks:java:io:clickhouse', project ':sdks:java:io:common', project ':sdks:java:io:elasticsearch', project ':sdks:java:io:elasticsearch-tests', project ':sdks:java:io:file-based-io-tests', project ':sdks:java:io:google-cloud-platform', project ':sdks:java:io:hadoop-common', project ':sdks:java:io:hadoop-file-system', project ':sdks:java:io:hadoop-format', project ':sdks:java:io:hbase', project ':sdks:java:io:hcatalog', project ':sdks:java:io:jdbc', project ':sdks:java:io:jms', project ':sdks:java:io:kafka', project ':sdks:java:io:kinesis', project ':sdks:java:io:kudu', project ':sdks:java:io:mongodb', project ':sdks:java:io:mqtt', project ':sdks:java:io:parquet', project ':sdks:java:io:rabbitmq', project ':sdks:java:io:redis', project ':sdks:java:io:solr', project ':sdks:java:io:synthetic', project ':sdks:java:io:tika', project ':sdks:java:io:xml', project ':sdks:java:maven-archetypes:examples', project ':sdks:java:maven-archetypes:starter', project ':sdks:java:testing:load-tests', project ':sdks:java:testing:nexmark', project ':sdks:java:testing:test-utils', project ':sdks:python:apache_beam:testing', project ':sdks:python:container:py3', project ':sdks:python:test-suites:dataflow', project ':sdks:python:test-suites:direct', project ':sdks:python:test-suites:portable', project ':sdks:python:test-suites:tox', project ':sdks:java:extensions:sql:datacatalog', project ':sdks:java:extensions:sql:hcatalog', project ':sdks:java:extensions:sql:jdbc', project ':sdks:java:extensions:sql:shell', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-2', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-5', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-6', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-common', project ':sdks:python:apache_beam:testing:load_tests', project ':sdks:python:test-suites:dataflow:py35', project ':sdks:python:test-suites:dataflow:py36', project ':sdks:python:test-suites:dataflow:py37', project ':sdks:python:test-suites:direct:py35', project ':sdks:python:test-suites:direct:py36', project ':sdks:python:test-suites:direct:py37', project ':sdks:python:test-suites:portable:py35', project ':sdks:python:test-suites:tox:py35', project ':sdks:python:test-suites:tox:py36', project ':sdks:python:test-suites:tox:py37']
Configuration on demand is an incubating feature.
> Configure project :
Evaluating root project 'beam' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Offline dependencies root configured at 'offline-repository'
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
Publishing build scan...
https://gradle.com/s/hdpjppawxveze
STDERR:
FAILURE: Build failed with an exception.
* What went wrong:
Project 'sdks/python/test-suites/dataflow/py36' not found in root project 'beam'.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 10s
2019-06-25 06:27:36,715 a6e0c0ef MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-25 06:27:36,716 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-06-25 06:27:36,718 a6e0c0ef MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 903, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-25 06:27:36,718 a6e0c0ef MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-06-25 06:27:36,719 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-06-25 06:27:36,719 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/a6e0c0ef/pkb.log>
2019-06-25 06:27:36,719 a6e0c0ef MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/a6e0c0ef/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36
#137
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/137/display/redirect?page=changes>
Changes:
[markliu] [BEAM-7598] Do not build Python tar file in run_integration_test.sh
------------------------------------------
[...truncated 15.86 KB...]
--beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it
--beam_it_timeout=1200
--beam_it_module=sdks/python/test-suites/dataflow/py36
--beam_sdk=python
--k8s_get_wait_interval=10
--bigquery_table=beam_performance.wordcount_py36_pkb_results
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE
--beam_prebuilt
--dpb_service_zone=fake_zone
--project=apache-beam-testing
--official
--dpb_log_level=INFO
--beam_location=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src>
--beam_runner=TestDataflowRunner
--k8s_get_retry_count=36
--benchmarks=beam_integration_benchmark
--beam_python_sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz
2019-06-25 00:27:26,278 15ff411c MainThread INFO Setting --max_concurrent_threads=200.
2019-06-25 00:27:26,300 15ff411c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2019-06-25 00:27:26,326 15ff411c MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2019-06-25 00:27:26,328 15ff411c MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2019-06-25 00:27:26,329 15ff411c MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2019-06-25 00:27:26,339 15ff411c MainThread beam_integration_benchmark(1/1) INFO Running: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan
2019-06-25 00:27:38,509 15ff411c MainThread beam_integration_benchmark(1/1) INFO Ran: {<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/gradlew> sdks/python/test-suites/dataflow/py36:integrationTest -Dtests=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it -Dattr=IT -DpipelineOptions="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" "--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710" "--num_workers=10" "--autoscaling_algorithm=NONE" "--runner=TestDataflowRunner" "--sdk_location=test-suites/dataflow/py36/build/apache-beam.tar.gz" --info --scan} ReturnCode:1
STDOUT: Initialized native services in: /home/jenkins/.gradle/native
Removing 0 daemon stop events from registry
Starting a Gradle Daemon (subsequent builds will be faster)
Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/5.2.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xss10240k -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-5.2.1-all/bviwmvmbexq6idcscbicws5me/gradle-5.2.1/lib/gradle-launcher-5.2.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 5.2.1
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 0.928 secs.
The client will now receive all logging from the daemon (pid: 28472). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-28472.out.log
Starting build in new daemon [memory: 24.4 GB]
Using 16 worker leases.
Starting Build
Using local directory build cache for build ':buildSrc' (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
> Configure project :buildSrc
Evaluating project ':buildSrc' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/build.gradle'.>
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Selected primary task 'build' from project :
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/java',> not found
Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files.
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.052 secs.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileGroovy FROM-CACHE
Build cache key for task ':buildSrc:compileGroovy' is 8a7c9ae67ae63d6687cac98f536a861a
Task ':buildSrc:compileGroovy' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@669686c4: {executionTime=3175, hostName=apache-beam-jenkins-9, operatingSystem=Linux, buildInvocationId=nu73dakjrzacjgntodewxxx5wy, creationTime=1560991458834, identity=:compileGroovy, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src/buildSrc}
Unpacked trees for task ':buildSrc:compileGroovy' from cache.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.176 secs.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:pluginDescriptors
Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710
Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task
Task ':buildSrc:pluginDescriptors' is not up-to-date because:
No history is available.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.025 secs.
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:processResources
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816
Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task
Task ':buildSrc:processResources' is not up-to-date because:
No history is available.
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/main/resources',> not found
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.036 secs.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:classes
Skipping task ':buildSrc:classes' as it has no actions.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.001 secs.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:jar
Build cache key for task ':buildSrc:jar' is 50818b48dc0ad46ca18e3c5f2a5b2c5f
Caching disabled for task ':buildSrc:jar': Caching has not been enabled for the task
Task ':buildSrc:jar' is not up-to-date because:
No history is available.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.236 secs.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:assemble
Skipping task ':buildSrc:assemble' as it has no actions.
:buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovy
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Caching disabled for task ':buildSrc:spotlessGroovy': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovy' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovy'.
:buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 2.051 secs.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyCheck
Skipping task ':buildSrc:spotlessGroovyCheck' as it has no actions.
:buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradle
Caching disabled for task ':buildSrc:spotlessGroovyGradle': Caching has not been enabled for the task
Task ':buildSrc:spotlessGroovyGradle' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovyGradle'.
:buildSrc:spotlessGroovyGradle (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.053 secs.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradleCheck
Skipping task ':buildSrc:spotlessGroovyGradleCheck' as it has no actions.
:buildSrc:spotlessGroovyGradleCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessCheck
Skipping task ':buildSrc:spotlessCheck' as it has no actions.
:buildSrc:spotlessCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:pluginUnderTestMetadata
Build cache key for task ':buildSrc:pluginUnderTestMetadata' is 22dcf73f949f06ae392c8946d12d76a4
Caching disabled for task ':buildSrc:pluginUnderTestMetadata': Caching has not been enabled for the task
Task ':buildSrc:pluginUnderTestMetadata' is not up-to-date because:
No history is available.
:buildSrc:pluginUnderTestMetadata (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.245 secs.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileTestJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/java',> not found
Skipping task ':buildSrc:compileTestJava' as it has no source files and no previous output files.
:buildSrc:compileTestJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.002 secs.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileTestGroovy NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/groovy',> not found
Skipping task ':buildSrc:compileTestGroovy' as it has no source files and no previous output files.
:buildSrc:compileTestGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.003 secs.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:processTestResources NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/buildSrc/src/test/resources',> not found
Skipping task ':buildSrc:processTestResources' as it has no source files and no previous output files.
:buildSrc:processTestResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.001 secs.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:testClasses UP-TO-DATE
Skipping task ':buildSrc:testClasses' as it has no actions.
:buildSrc:testClasses (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:test (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:test NO-SOURCE
Skipping task ':buildSrc:test' as it has no source files and no previous output files.
:buildSrc:test (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.004 secs.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:validateTaskProperties FROM-CACHE
Build cache key for task ':buildSrc:validateTaskProperties' is 782135718446b937b9134dd382ca2e74
Task ':buildSrc:validateTaskProperties' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@437478a9: {executionTime=232, hostName=apache-beam-jenkins-9, operatingSystem=Linux, buildInvocationId=nu73dakjrzacjgntodewxxx5wy, creationTime=1560991462302, identity=:validateTaskProperties, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src/buildSrc}
Unpacked trees for task ':buildSrc:validateTaskProperties' from cache.
:buildSrc:validateTaskProperties (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.013 secs.
:buildSrc:check (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:check
Skipping task ':buildSrc:check' as it has no actions.
:buildSrc:check (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:build (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:build
Skipping task ':buildSrc:build' as it has no actions.
:buildSrc:build (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
Settings evaluated using settings file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/settings.gradle'.>
Using local directory build cache for the root build (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
Projects loaded. Root project using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Included projects: [root project 'beam', project ':beam-test-infra-metrics', project ':beam-test-tools', project ':examples', project ':model', project ':release', project ':runners', project ':sdks', project ':vendor', project ':website', project ':examples:java', project ':examples:kotlin', project ':model:fn-execution', project ':model:job-management', project ':model:pipeline', project ':runners:apex', project ':runners:core-construction-java', project ':runners:core-java', project ':runners:direct-java', project ':runners:extensions-java', project ':runners:flink', project ':runners:gearpump', project ':runners:google-cloud-dataflow-java', project ':runners:java-fn-execution', project ':runners:jet-experimental', project ':runners:local-java', project ':runners:reference', project ':runners:samza', project ':runners:spark', project ':sdks:go', project ':sdks:java', project ':sdks:python', project ':vendor:bytebuddy-1_9_3', project ':vendor:grpc-1_13_1', project ':vendor:guava-20_0', project ':vendor:sdks-java-extensions-protobuf', project ':runners:extensions-java:metrics', project ':runners:flink:1.5', project ':runners:flink:1.6', project ':runners:flink:1.7', project ':runners:flink:1.8', project ':runners:google-cloud-dataflow-java:examples', project ':runners:google-cloud-dataflow-java:examples-streaming', project ':runners:google-cloud-dataflow-java:worker', project ':runners:reference:java', project ':runners:samza:job-server', project ':runners:spark:job-server', project ':sdks:go:container', project ':sdks:go:examples', project ':sdks:go:test', project ':sdks:java:bom', project ':sdks:java:build-tools', project ':sdks:java:container', project ':sdks:java:core', project ':sdks:java:extensions', project ':sdks:java:fn-execution', project ':sdks:java:harness', project ':sdks:java:io', project ':sdks:java:javadoc', project ':sdks:java:maven-archetypes', project ':sdks:java:testing', project ':sdks:python:apache_beam', project ':sdks:python:container', project ':sdks:python:test-suites', project ':runners:flink:1.5:job-server', project ':runners:flink:1.5:job-server-container', project ':runners:flink:1.6:job-server', project ':runners:flink:1.6:job-server-container', project ':runners:flink:1.7:job-server', project ':runners:flink:1.7:job-server-container', project ':runners:flink:1.8:job-server', project ':runners:flink:1.8:job-server-container', project ':runners:google-cloud-dataflow-java:worker:legacy-worker', project ':runners:google-cloud-dataflow-java:worker:windmill', project ':sdks:java:extensions:euphoria', project ':sdks:java:extensions:google-cloud-platform-core', project ':sdks:java:extensions:jackson', project ':sdks:java:extensions:join-library', project ':sdks:java:extensions:kryo', project ':sdks:java:extensions:protobuf', project ':sdks:java:extensions:sketching', project ':sdks:java:extensions:sorter', project ':sdks:java:extensions:sql', project ':sdks:java:io:amazon-web-services', project ':sdks:java:io:amqp', project ':sdks:java:io:cassandra', project ':sdks:java:io:clickhouse', project ':sdks:java:io:common', project ':sdks:java:io:elasticsearch', project ':sdks:java:io:elasticsearch-tests', project ':sdks:java:io:file-based-io-tests', project ':sdks:java:io:google-cloud-platform', project ':sdks:java:io:hadoop-common', project ':sdks:java:io:hadoop-file-system', project ':sdks:java:io:hadoop-format', project ':sdks:java:io:hbase', project ':sdks:java:io:hcatalog', project ':sdks:java:io:jdbc', project ':sdks:java:io:jms', project ':sdks:java:io:kafka', project ':sdks:java:io:kinesis', project ':sdks:java:io:kudu', project ':sdks:java:io:mongodb', project ':sdks:java:io:mqtt', project ':sdks:java:io:parquet', project ':sdks:java:io:rabbitmq', project ':sdks:java:io:redis', project ':sdks:java:io:solr', project ':sdks:java:io:synthetic', project ':sdks:java:io:tika', project ':sdks:java:io:xml', project ':sdks:java:maven-archetypes:examples', project ':sdks:java:maven-archetypes:starter', project ':sdks:java:testing:load-tests', project ':sdks:java:testing:nexmark', project ':sdks:java:testing:test-utils', project ':sdks:python:apache_beam:testing', project ':sdks:python:container:py3', project ':sdks:python:test-suites:dataflow', project ':sdks:python:test-suites:direct', project ':sdks:python:test-suites:portable', project ':sdks:python:test-suites:tox', project ':sdks:java:extensions:sql:datacatalog', project ':sdks:java:extensions:sql:hcatalog', project ':sdks:java:extensions:sql:jdbc', project ':sdks:java:extensions:sql:shell', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-2', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-5', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-6', project ':sdks:java:io:elasticsearch-tests:elasticsearch-tests-common', project ':sdks:python:apache_beam:testing:load_tests', project ':sdks:python:test-suites:dataflow:py35', project ':sdks:python:test-suites:dataflow:py36', project ':sdks:python:test-suites:dataflow:py37', project ':sdks:python:test-suites:direct:py35', project ':sdks:python:test-suites:direct:py36', project ':sdks:python:test-suites:direct:py37', project ':sdks:python:test-suites:portable:py35', project ':sdks:python:test-suites:tox:py35', project ':sdks:python:test-suites:tox:py36', project ':sdks:python:test-suites:tox:py37']
Configuration on demand is an incubating feature.
> Configure project :
Evaluating root project 'beam' using build file '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src/build.gradle'.>
Offline dependencies root configured at 'offline-repository'
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
Publishing build scan...
https://gradle.com/s/nyjrdv22vyjro
STDERR:
FAILURE: Build failed with an exception.
* What went wrong:
Project 'sdks/python/test-suites/dataflow/py36' not found in root project 'beam'.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 10s
2019-06-25 00:27:38,511 15ff411c MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-25 00:27:38,512 15ff411c MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-06-25 00:27:38,513 15ff411c MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 903, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-25 00:27:38,514 15ff411c MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-06-25 00:27:38,514 15ff411c MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-06-25 00:27:38,514 15ff411c MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/15ff411c/pkb.log>
2019-06-25 00:27:38,514 15ff411c MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/runs/15ff411c/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org