You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/12/15 18:25:42 UTC
Build failed in Jenkins: beam_PerformanceTests_Python #678
See <https://builds.apache.org/job/beam_PerformanceTests_Python/678/display/redirect>
------------------------------------------
[...truncated 370.97 KB...]
[INFO]
[INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ beam-sdks-java-io-xml ---
[INFO] Deleting /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml (includes = [**/*.pyc, **/*.egg-info/, **/sdks/python/LICENSE, **/sdks/python/NOTICE, **/sdks/python/README.md], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce) @ beam-sdks-java-io-xml ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-sdks-java-io-xml ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-java-io-xml ---
[INFO]
[INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ beam-sdks-java-io-xml ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.6.2:compile (default-compile) @ beam-sdks-java-io-xml ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/classes
[WARNING] bootstrap class path not set in conjunction with -source 1.7
[INFO] /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/JAXBCoder.java: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/JAXBCoder.java uses or overrides a deprecated API.
[INFO] /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/JAXBCoder.java: Recompile with -Xlint:deprecation for details.
[INFO] /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/XmlSink.java: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/XmlSink.java uses unchecked or unsafe operations.
[INFO] /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/XmlSink.java: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @ beam-sdks-java-io-xml ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.6.2:testCompile (default-testCompile) @ beam-sdks-java-io-xml ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 3 source files to /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/test-classes
[INFO] /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/test/java/org/apache/beam/sdk/io/xml/JAXBCoderTest.java: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/test/java/org/apache/beam/sdk/io/xml/JAXBCoderTest.java uses or overrides a deprecated API.
[INFO] /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/src/test/java/org/apache/beam/sdk/io/xml/JAXBCoderTest.java: Recompile with -Xlint:deprecation for details.
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (default) @ beam-sdks-java-io-xml ---
[INFO]
[INFO] --- maven-surefire-plugin:2.20:test (default-test) @ beam-sdks-java-io-xml ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-io-xml ---
[INFO]
[INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ beam-sdks-java-io-xml ---
[INFO] Building jar: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ beam-sdks-java-io-xml ---
[INFO]
[INFO] --- maven-jar-plugin:3.0.2:test-jar (default-test-jar) @ beam-sdks-java-io-xml ---
[INFO] Building jar: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-tests.jar
[INFO]
[INFO] --- maven-shade-plugin:3.0.0:shade (bundle-and-repackage) @ beam-sdks-java-io-xml ---
[INFO] Excluding org.apache.beam:beam-sdks-java-core:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:3.2.0 from the shaded jar.
[INFO] Excluding com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.8.9 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.8.9 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.8.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.25 from the shaded jar.
[INFO] Excluding net.bytebuddy:byte-buddy:jar:1.6.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.8.2 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.7 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.5 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.4 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.14 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.6 from the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.4 from the shaded jar.
[INFO] Excluding org.codehaus.woodstox:stax2-api:jar:3.1.4 from the shaded jar.
[INFO] Excluding org.codehaus.woodstox:woodstox-core-asl:jar:4.4.1 from the shaded jar.
[INFO] Including com.google.guava:guava:jar:20.0 in the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:3.0.1 from the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT.jar with /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-shaded.jar
[INFO] Replacing original test artifact with shaded test artifact.
[INFO] Replacing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-tests.jar with /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-shaded-tests.jar
[INFO] Dependency-reduced POM written at: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-dependency-plugin:3.0.1:analyze-only (default) @ beam-sdks-java-io-xml ---
[INFO] No dependency problems found
[INFO]
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-sdks-java-io-xml ---
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT.jar to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-io-xml/2.3.0-SNAPSHOT/beam-sdks-java-io-xml-2.3.0-SNAPSHOT.jar
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/dependency-reduced-pom.xml to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-io-xml/2.3.0-SNAPSHOT/beam-sdks-java-io-xml-2.3.0-SNAPSHOT.pom
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-tests.jar to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-io-xml/2.3.0-SNAPSHOT/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-tests.jar
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/io/xml/target/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-tests.jar to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-io-xml/2.3.0-SNAPSHOT/beam-sdks-java-io-xml-2.3.0-SNAPSHOT-tests.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Beam :: SDKs :: Java :: Maven Archetypes 2.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ beam-sdks-java-maven-archetypes-parent ---
[INFO] Deleting /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes (includes = [**/*.pyc, **/*.egg-info/, **/sdks/python/LICENSE, **/sdks/python/NOTICE, **/sdks/python/README.md], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce) @ beam-sdks-java-maven-archetypes-parent ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-sdks-java-maven-archetypes-parent ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-java-maven-archetypes-parent ---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (default) @ beam-sdks-java-maven-archetypes-parent ---
[INFO]
[INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-maven-archetypes-parent ---
[INFO]
[INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ beam-sdks-java-maven-archetypes-parent ---
[INFO]
[INFO] --- maven-shade-plugin:3.0.0:shade (bundle-and-repackage) @ beam-sdks-java-maven-archetypes-parent ---
[INFO] Replacing original artifact with shaded artifact.
[INFO]
[INFO] --- maven-dependency-plugin:3.0.1:analyze-only (default) @ beam-sdks-java-maven-archetypes-parent ---
[INFO] Skipping pom project
[INFO]
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-sdks-java-maven-archetypes-parent ---
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/pom.xml to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-maven-archetypes-parent/2.3.0-SNAPSHOT/beam-sdks-java-maven-archetypes-parent-2.3.0-SNAPSHOT.pom
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter 2.3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] Deleting /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter (includes = [**/*.pyc, **/*.egg-info/, **/sdks/python/LICENSE, **/sdks/python/NOTICE, **/sdks/python/README.md], excludes = [])
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce) @ beam-sdks-java-maven-archetypes-starter ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-sdks-java-maven-archetypes-starter ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-java-maven-archetypes-starter ---
[INFO]
[INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (default) @ beam-sdks-java-maven-archetypes-starter ---
[INFO]
[INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-maven-archetypes-starter ---
[INFO]
[INFO] --- maven-archetype-plugin:2.4:jar (default-jar) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] Building archetype jar: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT
[INFO]
[INFO] --- maven-site-plugin:3.5.1:attach-descriptor (attach-descriptor) @ beam-sdks-java-maven-archetypes-starter ---
[INFO]
[INFO] --- maven-shade-plugin:3.0.0:shade (bundle-and-repackage) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] Excluding org.apache.beam:beam-runners-direct-java:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Excluding org.apache.beam:beam-model-pipeline:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Excluding org.apache.beam:beam-runners-local-java-core:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Excluding org.apache.beam:beam-runners-core-construction-java:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Excluding org.apache.beam:beam-model-job-management:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java-util:jar:3.2.0 from the shaded jar.
[INFO] Excluding com.google.code.gson:gson:jar:2.7 from the shaded jar.
[INFO] Excluding io.grpc:grpc-core:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.errorprone:error_prone_annotations:jar:2.0.15 from the shaded jar.
[INFO] Excluding io.grpc:grpc-context:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.instrumentation:instrumentation-api:jar:0.3.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.beam:beam-runners-core-java:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Including com.google.guava:guava:jar:20.0 in the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.4 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:3.0.1 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.25 from the shaded jar.
[INFO] Excluding org.apache.beam:beam-sdks-java-core:jar:2.3.0-SNAPSHOT from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:3.2.0 from the shaded jar.
[INFO] Excluding com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.8.9 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.8.9 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.8.9 from the shaded jar.
[INFO] Excluding net.bytebuddy:byte-buddy:jar:1.6.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.8.2 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.7 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.5 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.4 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.14 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.6 from the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT.jar with /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT-shaded.jar
[INFO] Replacing original test artifact with shaded test artifact.
[INFO] Replacing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT-tests.jar with /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT-shaded-tests.jar
[INFO]
[INFO] --- maven-dependency-plugin:3.0.1:analyze-only (default) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] No dependency problems found
[INFO]
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT.jar to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-maven-archetypes-starter/2.3.0-SNAPSHOT/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT.jar
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/pom.xml to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-maven-archetypes-starter/2.3.0-SNAPSHOT/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT.pom
[INFO] Installing /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT-tests.jar to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-maven-archetypes-starter/2.3.0-SNAPSHOT/beam-sdks-java-maven-archetypes-starter-2.3.0-SNAPSHOT-tests.jar
[INFO]
[INFO] --- maven-archetype-plugin:2.4:integration-test (default-integration-test) @ beam-sdks-java-maven-archetypes-starter ---
[INFO] Processing Archetype IT project: basic
[INFO] ----------------------------------------------------------------------------
[INFO] Using following parameters for creating project from Archetype: beam-sdks-java-maven-archetypes-starter:2.3.0-SNAPSHOT
[INFO] ----------------------------------------------------------------------------
[INFO] Parameter: groupId, Value: archetype.it
[INFO] Parameter: artifactId, Value: basic
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: package, Value: it.pkg
[INFO] Parameter: packageInPathFormat, Value: it/pkg
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: package, Value: it.pkg
[INFO] Parameter: groupId, Value: archetype.it
[INFO] Parameter: targetPlatform, Value: 1.7
[INFO] Parameter: artifactId, Value: basic
[INFO] project created from Archetype in dir: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/test-classes/projects/basic/project/basic
[INFO] Comparing generated project with reference content: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/java/maven-archetypes/starter/target/test-classes/projects/basic/reference
[INFO] Invoking post-archetype-generation goals: verify
STDERR:
2017-12-15 18:25:38,136 04084347 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2017-12-15 18:25:38,211 04084347 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 585, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 495, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: /tmp/perfkitbenchmarker/runs/04084347/beam/sdks/python/target
2017-12-15 18:25:38,379 04084347 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2017-12-15 18:25:38,381 04084347 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2017-12-15 18:25:38,463 04084347 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------
Name UID Status
---------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------
Success rate: 0.00% (0/1)
2017-12-15 18:25:38,463 04084347 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/04084347/pkb.log
2017-12-15 18:25:38,463 04084347 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/04084347/completion_statuses.json
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user github@nakomis.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user mariagh@google.com
Jenkins build is back to normal : beam_PerformanceTests_Python #680
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/680/display/redirect>
Build failed in Jenkins: beam_PerformanceTests_Python #679
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/679/display/redirect?page=changes>
Changes:
[github] Allow Java Harness to understand Fns the Java Runner produces. (#4214)
[altay] Add grpcio upper bound
[aaltay] [BEAM-3189] Sdk worker multithreading (#4134)
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 049070be4b4e6f1fc16092b7308ed4054e6ef76a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 049070be4b4e6f1fc16092b7308ed4054e6ef76a
Commit message: "[BEAM-3189] Sdk worker multithreading (#4134)"
> git rev-list 02c766a102e3103eeaefb70357df0ac163e80e0b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2671796146418278488.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins19685706634629202.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1623631296153962461.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7138447804781258230.sh
+ pip install --user -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: grpcio<=1.7.3,>=1.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: oauth2client<4.0.0,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: protobuf<=3.3.0,>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: six<1.11,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: google-apitools<=0.5.11,>=0.5.10 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<=1.7.3,>=1.0->apache-beam==2.3.0.dev)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<4.0.0,>=2.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<4.0.0,>=2.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<4.0.0,>=2.0.1->apache-beam==2.3.0.dev)
Requirement already satisfied: setuptools in /usr/lib/python2.7/dist-packages (from protobuf<=3.3.0,>=3.2.0->apache-beam==2.3.0.dev)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: proto-google-cloud-pubsub-v1[grpc]<0.16dev,>=0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: requests<3.0dev,>=2.13.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev)
Installing collected packages: apache-beam
Found existing installation: apache-beam 2.3.0.dev0
Uninstalling apache-beam-2.3.0.dev0:
Successfully uninstalled apache-beam-2.3.0.dev0
Running setup.py develop for apache-beam
Successfully installed apache-beam
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6819119935577484036.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2017-12-16 00:02:03,599 9fdb0d0a MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9fdb0d0a/pkb.log
2017-12-16 00:02:03,599 9fdb0d0a MainThread INFO PerfKitBenchmarker version: v1.12.0-242-g4c647df
2017-12-16 00:02:03,600 9fdb0d0a MainThread INFO Flag values:
--beam_sdk=python
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2017-12-16 00:02:03,825 9fdb0d0a MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-12-16 00:02:03,825 9fdb0d0a MainThread INFO Initializing the edw service decoder
2017-12-16 00:02:03,942 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2017-12-16 00:02:03,945 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2017-12-16 00:02:03,945 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2017-12-16 00:02:14,767 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2017-12-16 00:14:27,066 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2017-12-16 00:14:27,305 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=/tmp/perfkitbenchmarker/runs/9fdb0d0a/beam/sdks/python/target/apache-beam-2.3.0.dev0.tar.gz
2017-12-16 00:24:27,324 9fdb0d0a Thread-4 ERROR IssueCommand timed out after 600 seconds. Killing command "python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=/tmp/perfkitbenchmarker/runs/9fdb0d0a/beam/sdks/python/target/apache-beam-2.3.0.dev0.tar.gz".
2017-12-16 00:24:27,395 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Ran python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=/tmp/perfkitbenchmarker/runs/9fdb0d0a/beam/sdks/python/target/apache-beam-2.3.0.dev0.tar.gz. Got return code (-9).
STDOUT: running nosetests
running egg_info
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
STDERR: /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'python_requires'
warnings.warn(msg)
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... /tmp/perfkitbenchmarker/runs/9fdb0d0a/beam/sdks/python/apache_beam/io/gcp/gcsio.py:122: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
/tmp/perfkitbenchmarker/runs/9fdb0d0a/beam/sdks/python/apache_beam/coders/typecoders.py:134: UserWarning: Using fallback coder for typehint: Any.
warnings.warn('Using fallback coder for typehint: %r.' % typehint)
ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... /tmp/perfkitbenchmarker/runs/9fdb0d0a/beam/sdks/python/apache_beam/coders/typecoders.py:134: UserWarning: Using fallback coder for typehint: <type 'NoneType'>.
warnings.warn('Using fallback coder for typehint: %r.' % typehint)
2017-12-16 00:24:27,396 9fdb0d0a MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 585, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 495, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2017-12-16 00:24:27,603 9fdb0d0a MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2017-12-16 00:24:27,655 9fdb0d0a MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2017-12-16 00:24:27,679 9fdb0d0a MainThread INFO Benchmark run statuses:
---------------------------------------------------------------
Name UID Status
---------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------
Success rate: 0.00% (0/1)
2017-12-16 00:24:27,680 9fdb0d0a MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9fdb0d0a/pkb.log
2017-12-16 00:24:27,680 9fdb0d0a MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/9fdb0d0a/completion_statuses.json
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user github@nakomis.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user mariagh@google.com
Not sending mail to unregistered user aaltay@gmail.com