You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/10/19 18:09:38 UTC
Build failed in Jenkins: beam_PreCommit_GoPortable_Cron #895
See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/895/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-13042] Prevent unexpected blocking in
[ilya.kozyrev] Implement initial server with grpcweb wrapper
[noreply] [BEAM-13068] Add a SQL API in Beam Go SDK (#15746)
------------------------------------------
[...truncated 223.41 KB...]
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in f06db9be8d03
Removing intermediate container f06db9be8d03
---> 6974d0b4389b
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 8d258f4289c4
Removing intermediate container 8d258f4289c4
---> c4524ec9b315
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> 30eb00d44f4b
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 09e07667f9ee
> Task :sdks:java:container:java8:docker
Removing intermediate container 1974eca66d59
---> feac0c55806f
Step 5/18 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> 5df8ed73530f
Step 6/18 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> 1a3027d06aa6
Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> 222a8ceedc2f
Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> a9fcc0f6d83d
Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> 5e1d50bb62a4
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 2301cb44cf04
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
---> 647297cbf081
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> b07a66b3d253
Step 13/18 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
---> d97e2adb7bba
Step 14/18 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> d0bdcbf62728
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 899731dbcc0f
Removing intermediate container 899731dbcc0f
---> 0ca78fc4b1f6
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 6ef5e78daa03
Removing intermediate container 6ef5e78daa03
---> 0be630c9c610
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> a41998366df3
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 9e9bd3f78c77
Removing intermediate container 9e9bd3f78c77
---> a973839ee330
Successfully built a973839ee330
Successfully tagged apache/beam_java8_sdk:2.35.0.dev
> Task :sdks:go:test:ulrValidatesRunner
Obtaining file://<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python>
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
Using cached avro_python3-1.9.2.1-py3-none-any.whl
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp38-cp38-linux_x86_64.whl
Collecting dill<0.3.2,>=0.3.1.1
Using cached dill-0.3.1.1-py3-none-any.whl
Collecting fastavro<2,>=0.21.4
Using cached fastavro-1.4.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.6 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.29.0 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (1.41.0)
Collecting hdfs<3.0.0,>=2.1.0
Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2<0.20.0,>=0.8
Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting numpy<1.21.0,>=1.14.3
Using cached numpy-1.20.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.4 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.12.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (545 kB)
Collecting oauth2client<5,>=2.0.1
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Requirement already satisfied: protobuf<4,>=3.12.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from apache-beam==2.35.0.dev0) (3.18.1)
Collecting pyarrow<6.0.0,>=0.15.1
Using cached pyarrow-5.0.0-cp38-cp38-manylinux2014_x86_64.whl (23.6 MB)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pytz>=2018.3
Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting requests<3.0.0,>=2.24.0
Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting typing-extensions<4,>=3.7.0
Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Collecting orjson<4.0
Using cached orjson-3.6.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (250 kB)
Requirement already satisfied: six>=1.5.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from grpcio<2,>=1.29.0->apache-beam==2.35.0.dev0) (1.16.0)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing<3,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from httplib2<0.20.0,>=0.8->apache-beam==2.35.0.dev0) (2.4.7)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting pyasn1-modules>=0.0.5
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa>=3.1.4
Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.7-py3-none-any.whl (38 kB)
Installing collected packages: urllib3, pyasn1, idna, charset-normalizer, certifi, rsa, requests, pyasn1-modules, numpy, httplib2, docopt, typing-extensions, pytz, python-dateutil, pymongo, pydot, pyarrow, orjson, oauth2client, hdfs, fastavro, dill, crcmod, avro-python3, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.35.0.dev0 avro-python3-1.9.2.1 certifi-2021.10.8 charset-normalizer-2.0.7 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 fastavro-1.4.5 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 numpy-1.20.3 oauth2client-4.1.3 orjson-3.6.4 pyarrow-5.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.2 pymongo-3.12.0 python-dateutil-2.8.2 pytz-2021.3 requests-2.26.0 rsa-4.7.2 typing-extensions-3.10.0.2 urllib3-1.26.7
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=1h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--runner
$ case --runner in
$ RUNNER=portable
$ key=--test_expansion_jar
$ case --test_expansion_jar in
$ TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar>
$ cd <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src>
$ test -d sdks/go/test
$ JOB_PORT=49353
$ ENDPOINT=localhost:56065
No endpoint specified; starting a new portable job server on localhost:56065
$ python3 -m apache_beam.runners.portability.local_job_service_main --port 56065
$ JOBSERVER_PID=12050
$ EXPANSION_PORT=55099
$ TEST_EXPANSION_ADDR=localhost:35431
No test expansion address specified; starting a new test expansion server on localhost:35431
$ java -jar <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.35.0-SNAPSHOT.jar> 35431
$ TEST_EXPANSION_PID=12058
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:35431
Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details
Oct 19, 2021 6:07:19 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
beam:transforms:xlang:test:cgbk: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@14cd1699
INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk, beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix, beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk, beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk, beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq, beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write, beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read, beam:external:java:generate_sequence:v1]
beam:transforms:xlang:test:flatten: org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@77888435
beam:transforms:xlang:test:prefix: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@73a1e9a9
beam:transforms:xlang:test:multi: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@71d44a3
beam:transforms:xlang:test:gbk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@7b98f307
beam:transforms:xlang:test:comgl: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@4802796d
beam:transforms:xlang:test:compk: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@34123d65
beam:transforms:xlang:count: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@59474f18
beam:transforms:xlang:filter_less_than_eq: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@65fb9ffc
beam:transforms:xlang:test:partition: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@3e694b3f
beam:transforms:xlang:test:parquet_write: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@1bb5a082
beam:transforms:xlang:parquet_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@78691363
beam:transforms:xlang:textio_read: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@41d477ed
beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/883151184@3590fc5b
INFO:apache_beam.runners.portability.local_job_service:Grpc server started at localhost on port 56065
INFO:__main__:Listening for beam jobs on port 56065.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH: <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
INFO:__main__:Listening for beam jobs on port 56065.
> Task :sdks:go:container:docker
INFO:__main__:Listening for beam jobs on port 56065.
INFO:__main__:Listening for beam jobs on port 56065.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 2m 16s
8 actionable tasks: 6 executed, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mnhuxfaesk5ho
$ CONTAINER=apache/beam_go_sdk
$ cd sdks/go
>>> RUNNING portable integration tests with pipeline options: -p 3 -timeout 1h --runner=portable --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test --dataflow_worker_jar= --endpoint=localhost:56065 --test_expansion_addr=localhost:35431
$
./run_validatesrunner_tests.sh: line 399: go: command not found
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 127
$ exit 127
> Task :sdks:go:test:ulrValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'> line: 171
* What went wrong:
Execution failed for task ':sdks:go:test:ulrValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 39s
109 actionable tasks: 79 executed, 25 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/ctinxnjbele7a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PreCommit_GoPortable_Cron
#896
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/896/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org