You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/10/30 01:01:51 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #869
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/869/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using
[Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0
[Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build
[noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657)
------------------------------------------
[...truncated 94.05 KB...]
+ go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:go:dockerRun
+ tee /output/licenses/list.csv
+ go-licenses csv github.com/apache/beam/sdks/go/container
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:go:createLicenses
> Task :sdks:go:container:copyGolangLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
+ chmod -R a+w /output/licenses
> Task :sdks:go:container:dockerPrepare
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :runners:spark:3:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:spark:3:classes
> Task :runners:spark:3:jar
> Task :runners:spark:3:job-server:compileJava NO-SOURCE
> Task :runners:spark:3:job-server:classes UP-TO-DATE
> Task :runners:spark:3:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:spark:3:testClasses
> Task :runners:spark:3:testJar
> Task :sdks:go:container:docker
> Task :sdks:python:container:py36:docker
> Task :sdks:java:container:java8:docker
> Task :sdks:python:container:py36:docker
Building dependency tree...
Reading state information...
libyaml-dev is already the newest version (0.2.1-1).
Suggested packages:
distcc | icecc
The following NEW packages will be installed:
ccache libsnappy-dev libsnappy1v5
0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded.
Need to get 203 kB of archives.
After this operation, 514 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB]
Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB]
Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB]
[91mdebconf: delaying package configuration, since apt-utils is not installed
[0mFetched 203 kB in 0s (3031 kB/s)
Selecting previously unselected package ccache.
(Reading database ...
(Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%(Reading database ... 24613 files and directories currently installed.)
Preparing to unpack .../ccache_3.6-1_amd64.deb ...
Unpacking ccache (3.6-1) ...
Selecting previously unselected package libsnappy1v5:amd64.
Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ...
Unpacking libsnappy1v5:amd64 (1.1.7-1) ...
Selecting previously unselected package libsnappy-dev:amd64.
Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ...
Unpacking libsnappy-dev:amd64 (1.1.7-1) ...
Setting up ccache (3.6-1) ...
Updating symlinks in /usr/lib/ccache ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libsnappy-dev:amd64 (1.1.7-1) ...
Processing triggers for libc-bin (2.28-10) ...
Removing intermediate container dbd4a0197fc9
---> 96a899bbf47e
Step 6/27 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
---> c203d039bb8a
Step 7/27 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt
---> Running in e8957d5c5200
Ignoring pandas: markers 'python_version >= "3.7"' don't match your environment
Collecting avro-python3==1.8.2
Downloading avro-python3-1.8.2.tar.gz (36 kB)
Collecting fastavro==1.0.0.post1
Downloading fastavro-1.0.0.post1-cp36-cp36m-manylinux2014_x86_64.whl (1.4 MB)
Collecting crcmod==1.7
Downloading crcmod-1.7.tar.gz (89 kB)
Collecting dill==0.3.1.1
Downloading dill-0.3.1.1.tar.gz (151 kB)
Collecting future==0.18.2
Downloading future-0.18.2.tar.gz (829 kB)
> Task :runners:spark:3:job-server:shadowJar
> Task :sdks:python:container:py36:docker
Collecting grpcio==1.40.0
Downloading grpcio-1.40.0-cp36-cp36m-manylinux2014_x86_64.whl (4.3 MB)
Collecting hdfs==2.5.8
Downloading hdfs-2.5.8.tar.gz (41 kB)
Collecting httplib2==0.19.1
Downloading httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting oauth2client==4.1.3
Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting protobuf==3.17.3
Downloading protobuf-3.17.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting pyarrow==3.0.0
Downloading pyarrow-3.0.0-cp36-cp36m-manylinux2014_x86_64.whl (20.7 MB)
Collecting pydot==1.4.1
Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting pymongo==3.10.1
Downloading pymongo-3.10.1-cp36-cp36m-manylinux2014_x86_64.whl (460 kB)
Collecting pytz==2020.1
Downloading pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting pyyaml==5.4
Downloading PyYAML-5.4-cp36-cp36m-manylinux1_x86_64.whl (640 kB)
Collecting typing-extensions==3.7.4.3
Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting google-auth==1.31.0
Downloading google_auth-1.31.0-py2.py3-none-any.whl (147 kB)
Collecting google-api-core==1.22.2
Downloading google_api_core-1.22.2-py2.py3-none-any.whl (91 kB)
Collecting google-apitools==0.5.31
Downloading google-apitools-0.5.31.tar.gz (173 kB)
Collecting google-cloud-pubsub==1.0.2
Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery==1.26.1
Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB)
Collecting google-cloud-bigtable==1.0.0
Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-core==1.4.1
Downloading google_cloud_core-1.4.1-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-datastore==1.15.3
Downloading google_cloud_datastore-1.15.3-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-dlp==0.13.0
Downloading google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language==1.3.0
Downloading google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-profiler==3.0.4
Downloading google-cloud-profiler-3.0.4.tar.gz (32 kB)
Collecting google-cloud-recommendations-ai==0.2.0
Downloading google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-spanner==1.13.0
Downloading google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting google-cloud-videointelligence==1.13.0
Downloading google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177 kB)
Collecting google-cloud-vision==0.42.0
Downloading google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting google-python-cloud-debugger==2.15
Downloading google_python_cloud_debugger-2.15-cp36-cp36m-manylinux1_x86_64.whl (767 kB)
Collecting grpcio-gcp==0.2.2
Downloading grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting beautifulsoup4==4.9.1
Downloading beautifulsoup4-4.9.1-py3-none-any.whl (115 kB)
Collecting bs4==0.0.1
Downloading bs4-0.0.1.tar.gz (1.1 kB)
Collecting cython==0.29.21
Downloading Cython-0.29.21-cp36-cp36m-manylinux1_x86_64.whl (2.0 MB)
Collecting cachetools==3.1.1
Downloading cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting dataclasses==0.8
Downloading dataclasses-0.8-py3-none-any.whl (19 kB)
Collecting guppy3==3.0.10
Downloading guppy3-3.0.10-cp36-cp36m-manylinux2010_x86_64.whl (597 kB)
Collecting mmh3==2.5.1
Downloading mmh3-2.5.1.tar.gz (9.8 kB)
Collecting orjson==3.6.1
Downloading orjson-3.6.1-cp36-cp36m-manylinux_2_24_x86_64.whl (233 kB)
Collecting python-dateutil==2.8.1
Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting requests==2.24.0
Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting freezegun==0.3.15
Downloading freezegun-0.3.15-py2.py3-none-any.whl (14 kB)
Collecting pillow==7.2.0
Downloading Pillow-7.2.0-cp36-cp36m-manylinux1_x86_64.whl (2.2 MB)
Collecting python-snappy==0.5.4
Downloading python-snappy-0.5.4.tar.gz (21 kB)
Collecting numpy==1.19.5
Downloading numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB)
Collecting scipy==1.4.1
Downloading scipy-1.4.1-cp36-cp36m-manylinux1_x86_64.whl (26.1 MB)
Collecting scikit-learn==0.24.1
Downloading scikit_learn-0.24.1-cp36-cp36m-manylinux2010_x86_64.whl (22.2 MB)
Collecting pandas==1.1.5
Downloading pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5 MB)
Collecting protorpc==0.12.0
Downloading protorpc-0.12.0.tar.gz (117 kB)
Collecting python-gflags==3.1.2
Downloading python-gflags-3.1.2.tar.gz (52 kB)
Collecting tensorflow==2.6.0
Downloading tensorflow-2.6.0-cp36-cp36m-manylinux2010_x86_64.whl (458.3 MB)
> Task :runners:spark:3:job-server:sparkJobServerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 30, 2021 12:37:52 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 36m 32s
216 actionable tasks: 166 executed, 44 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/4ea2rkagttzlg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark3 #882
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/882/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #881
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/881/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13001] fixes Golint issues (#15859)
------------------------------------------
[...truncated 659.72 KB...]
2021/11/02 00:22:02 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go> as /tmp/worker-2-1635812522077212802
2021/11/02 00:22:04 Staged binary artifact with token:
2021/11/02 00:22:04 Submitted job: go0job0201635812522056538318-jenkins-1102002204-c5dde630_0cfe4b9e-06f0-4a7c-a55a-75cb4b66d833
2021/11/02 00:22:04 Job state: STOPPED
2021/11/02 00:22:04 Job state: STARTING
2021/11/02 00:22:04 Job state: RUNNING
2021/11/02 00:22:37 Job state: DONE
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/Impulse.out"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/02 00:22:37 unknown metric type
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x01\x01\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/Impulse.out"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x92A\x92A\x92A" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x9fA\x9fA\x9fA" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xc9 \xc9 \xc9 " labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output"}
2021/11/02 00:22:37 unknown metric type
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"n5"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"n5_keyede7_2"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n4"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\xe8\x07\xa8\x84\x01\x10\x11" labels:{key:"PCOLLECTION" value:"n5_keyede7_2"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"G\xbd\x01\x02\x03" labels:{key:"PCOLLECTION" value:"n5"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x01\x01\x01" labels:{key:"PCOLLECTION" value:"n4"}
2021/11/02 00:22:37 unknown metric type
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Reshuffle/Pair with random key/ParMultiDo(AssignShard).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Split/ParMultiDo(Split).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xfb\x19\xfb\x19\xfb\x19" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Reshuffle/Pair with random key/ParMultiDo(AssignShard).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x9fA\x9fA\x9fA" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xe6\x19\xe6\x19\xe6\x19" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Create/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xf3\x19\xf3\x19\xf3\x19" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Split/ParMultiDo(Split).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x00" labels:{key:"PCOLLECTION" value:"n9_keyede9_3"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x00" labels:{key:"PCOLLECTION" value:"n9"}
2021/11/02 00:22:37 unknown metric type
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n6"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"n8_keyede9_2"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x00" labels:{key:"PCOLLECTION" value:"n7_keyede9_1"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"n8"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x00" labels:{key:"PCOLLECTION" value:"n7"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\xe8\x07\xa8\x84\x01\x10\x11" labels:{key:"PCOLLECTION" value:"n8_keyede9_2"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x01\x01\x01" labels:{key:"PCOLLECTION" value:"n6"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"O\xe9\x01\x02\x03" labels:{key:"PCOLLECTION" value:"n8"}
2021/11/02 00:22:37 unknown metric type
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n10"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x01\x01\x01" labels:{key:"PCOLLECTION" value:"n10"}
2021/11/02 00:22:37 unknown metric type
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"n3"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"n2"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"n3_keyede7_1"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/Remove Kafka Metadata/ParMultiDo(Anonymous).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"G\xbd\x01\x02\x03" labels:{key:"PCOLLECTION" value:"n3"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"U\xd6\x01\x02\x03" labels:{key:"PCOLLECTION" value:"n2"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\xe8\x07\xa8\x84\x01\x10\x11" labels:{key:"PCOLLECTION" value:"n3_keyede7_1"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\xe8\x07\xa0\x1e\x03\x04" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/Remove Kafka Metadata/ParMultiDo(Anonymous).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Reshuffle/Values/Values/Map/ParMultiDo(Anonymous).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/StripIds/ParMultiDo(StripIds).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Read/ParMultiDo(Read).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Reshuffle/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output"}
2021/11/02 00:22:37 unknown metric type
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\xe8\x07" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/Remove Kafka Metadata/ParMultiDo(Anonymous).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xf3\x19\xf3\x19\xf3\x19" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Reshuffle/Values/Values/Map/ParMultiDo(Anonymous).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"E\xb6*NP" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/StripIds/ParMultiDo(StripIds).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"D\xaa*OQ" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Read/ParMultiDo(Read).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xfb\x19\xfb\x19\xfb\x19" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/KafkaIO.Read/KafkaIO.Read.ReadFromKafkaViaUnbounded/Read(KafkaUnboundedSource)/Reshuffle/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous).output"}
2021/11/02 00:22:37 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"F\xf0\x01\x03\x04" labels:{key:"PCOLLECTION" value:"gGXzsuSSONExternal/Remove Kafka Metadata/ParMultiDo(Anonymous).output"}
--- PASS: TestKafkaIO_BasicReadWrite (60.24s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 63.280s
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > coGroupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:230
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > groupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:198
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:275
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:295
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:156
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > multiInputOutputWithSideInputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:178
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
8 tests completed, 6 failed
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combineGloballyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:257
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > partitionTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:314
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > coGroupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:230
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > groupByKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:198
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:275
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:295
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:156
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > multiInputOutputWithSideInputTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:178
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
8 tests completed, 8 failed
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > pythonDependenciesTest FAILED
org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:338
Caused by: org.apache.beam.vendor.grpc.v1p36p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
Caused by: java.net.ConnectException at Errors.java:124
java.lang.NullPointerException at ValidateRunnerXlangTest.java:123
1 test completed, 1 failed
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build completed with 5 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/runners/spark/3/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/runners/spark/3/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/runners/spark/3/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29m 10s
216 actionable tasks: 159 executed, 50 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/hvaxcn2dvig4c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #880
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/880/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11936] Fix errorprone warnings (#15821)
------------------------------------------
[...truncated 136.79 KB...]
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:spark:3:testClasses
> Task :runners:spark:3:testJar
> Task :runners:spark:3:job-server:shadowJar
> Task :runners:spark:3:job-server:sparkJobServerSetup
> Task :sdks:java:io:google-cloud-platform:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:extensions:sql:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:extensions:sql:classes
> Task :sdks:java:extensions:sql:jar
> Task :sdks:java:extensions:sql:zetasql:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:extensions:sql:zetasql:classes
> Task :sdks:java:extensions:sql:zetasql:jar
> Task :sdks:java:extensions:sql:expansion-service:compileJava
Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/src/main/java/org/apache/beam/sdk/extensions/sql/expansion/ExternalSqlTransformRegistrar.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :sdks:java:extensions:sql:expansion-service:classes
> Task :sdks:java:extensions:sql:expansion-service:shadowJar
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 38577
Launching Python expansion service @ 35403
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=2h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--io_expansion_jar
$ case --io_expansion_jar in
$ IO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar>
$ key=--pipeline_opts
$ case --pipeline_opts in
$ PIPELINE_OPTS=--kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar>
$ key=--test_expansion_addr
$ case --test_expansion_addr in
$ TEST_EXPANSION_ADDR=localhost:38577
$ key=--runner
$ case --runner in
$ RUNNER=spark
$ key=--tests
$ case --tests in
$ TESTS=./test/integration/xlang ./test/integration/io/xlang/...
$ key=--endpoint
$ case --endpoint in
$ ENDPOINT=localhost:45545
$ cd <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src>
$ test -d sdks/go/test
$ EXPANSION_PORT=38123
$ IO_EXPANSION_ADDR=localhost:36495
No IO expansion address specified; starting a new IO expansion server on localhost:36495
$ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar> 36495
$ IO_EXPANSION_PID=26468
$ SIMULTANEOUS=1
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:36495
Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details
Nov 01, 2021 6:21:34 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@551bdc27
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58fdd99
beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6b1274d2
beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7bc1a03d
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
> Task :sdks:go:container:docker
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 58s
8 actionable tasks: 6 executed, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fl7s2kyn3t3iu
$ CONTAINER=apache/beam_go_sdk
$ cd sdks/go
>>> RUNNING spark integration tests with pipeline options: -p 1 -timeout 2h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test --dataflow_worker_jar= --endpoint=localhost:45545 --test_expansion_addr=localhost:38577 --io_expansion_addr=localhost:36495 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar>
$
./run_validatesrunner_tests.sh: line 399: go: command not found
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 127
$ exit 127
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:45545 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5100 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py ... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
=========== 10 passed, 5100 deselected, 2 warnings in 109.18 seconds ===========
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:45545 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5100 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5100 deselected in 56.25 seconds =============
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:45545 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5101 deselected / 9 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
================= 9 passed, 5101 deselected in 178.28 seconds ==================
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 26344.
Stopping expansion service pid: 26350.
> Task :runners:spark:3:job-server:sparkJobServerCleanup
Stopping job server pid: 10415.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 35m 21s
216 actionable tasks: 185 executed, 25 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/sxr7hev6r4w2y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #879
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/879/display/redirect>
Changes:
------------------------------------------
[...truncated 481.40 KB...]
Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9886341 sha256=cf94be213a6dc221a98ac0122711ad16c09aafacd96bc30d5096c53a745145c2
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect, google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory /usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3 google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3 typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container 92cae82e86ac
---> 780d2f006a2b
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> ebd5a780ec73
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 1c9191cefd48
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in e2b798d49f96
Removing intermediate container e2b798d49f96
---> 0b2cafe767ca
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 148aac5f9bbf
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in ae6849885c95
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=fd84b5838e248a2b8f3e4d70144e2e125c0159f4ee3c7e6749d740de67c9d7af
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mSkip pulling license for bs4
Found existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container ae6849885c95
---> 3b1c4565570e
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in 30ba84ecec45
Removing intermediate container 30ba84ecec45
---> 7c544034aff7
Step 21/27 : RUN pip freeze --all
---> Running in 923bb472273c
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.28.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.6
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.23
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container 923bb472273c
---> 34205641a5c8
Step 22/27 : RUN pip check
---> Running in 9cf3926c0202
No broken requirements found.
Removing intermediate container 9cf3926c0202
---> ae40ab393e50
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> 20eedb5f48b9
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> c5f2843f0d64
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 1dc4bef9f570
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 65dc92c63841
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in ae8096a51809
Removing intermediate container ae8096a51809
---> 485a8646c52d
Successfully built 485a8646c52d
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Nov 01, 2021 12:12:29 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 33m 37s
216 actionable tasks: 155 executed, 54 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/bkqkfwb4qjh3s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #878
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/878/display/redirect>
Changes:
------------------------------------------
[...truncated 501.32 KB...]
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container a0c13f4b5bfe
---> 3588a01b252f
Step 22/27 : RUN pip check
---> Running in 90833e0013bb
No broken requirements found.
Removing intermediate container 90833e0013bb
---> 88f56427737b
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> 84e58efd9590
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> b01c04523cb8
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 969ecc0ed3c0
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 4be1656fb4b0
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 779bfd7f5c87
Removing intermediate container 779bfd7f5c87
---> 3116eaabfacc
Successfully built 3116eaabfacc
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 34703
Launching Python expansion service @ 34641
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=2h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--io_expansion_jar
$ case --io_expansion_jar in
$ IO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar>
$ key=--pipeline_opts
$ case --pipeline_opts in
$ PIPELINE_OPTS=--kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar>
$ key=--test_expansion_addr
$ case --test_expansion_addr in
$ TEST_EXPANSION_ADDR=localhost:34703
$ key=--runner
$ case --runner in
$ RUNNER=spark
$ key=--tests
$ case --tests in
$ TESTS=./test/integration/xlang ./test/integration/io/xlang/...
$ key=--endpoint
$ case --endpoint in
$ ENDPOINT=localhost:37839
$ cd <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src>
$ test -d sdks/go/test
$ EXPANSION_PORT=43715
$ IO_EXPANSION_ADDR=localhost:38419
No IO expansion address specified; starting a new IO expansion server on localhost:38419
$ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar> 38419
$ IO_EXPANSION_PID=12395
$ SIMULTANEOUS=1
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:38419
Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@551bdc27Nov 01, 2021 6:15:52 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58fdd99
beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6b1274d2
beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7bc1a03d
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
> Task :sdks:go:container:docker
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 40s
8 actionable tasks: 6 executed, 2 up-to-date
Publishing build scan...
https://gradle.com/s/injaplnmtsb5k
$ CONTAINER=apache/beam_go_sdk
$ cd sdks/go
>>> RUNNING spark integration tests with pipeline options: -p 1 -timeout 2h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test --dataflow_worker_jar= --endpoint=localhost:37839 --test_expansion_addr=localhost:34703 --io_expansion_addr=localhost:38419 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar>
$
./run_validatesrunner_tests.sh: line 399: go: command not found
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 127
$ exit 127
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:37839 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5100 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py ... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
=========== 10 passed, 5100 deselected, 2 warnings in 112.85 seconds ===========
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:37839 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5100 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5100 deselected in 61.20 seconds =============
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:37839 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5101 deselected / 9 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
================= 9 passed, 5101 deselected in 189.93 seconds ==================
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 12269.
Stopping expansion service pid: 12273.
> Task :runners:spark:3:job-server:sparkJobServerCleanup
Stopping job server pid: 6668.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 36m 1s
216 actionable tasks: 154 executed, 55 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/y7ssri47a55m2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #877
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/877/display/redirect>
Changes:
------------------------------------------
[...truncated 460.05 KB...]
Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9886345 sha256=4484af00cde35fe70a6d70e448e03fc83a66c772ba99f11e5edd600d6c3e67f5
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect, google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory /usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3 google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3 typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container 2087282a9e25
---> a11b11d538a6
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> 7da0af735032
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> cfeebc510367
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in d489e20dd373
Removing intermediate container d489e20dd373
---> 0236a499ba9d
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> cc2c5add4f74
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 710717a338c9
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=d628c96be3193a17aeb4daf40e14d42bda2005de49b0a4fce12422de2d8eab66
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mSkip pulling license for bs4
Found existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container 710717a338c9
---> a36ba2ab4780
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in c75b37764896
Removing intermediate container c75b37764896
---> f45f61bcb92a
Step 21/27 : RUN pip freeze --all
---> Running in 36241528cea6
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.28.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.6
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.23
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container 36241528cea6
---> b2c457839eb4
Step 22/27 : RUN pip check
---> Running in 828dd60f9463
No broken requirements found.
Removing intermediate container 828dd60f9463
---> b9864d8e6e9e
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> 7f2320bcfdc6
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> 4e05b04dd9f3
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 17cba7fd995b
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> c12a1a0ff344
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in e084263ec7a9
Removing intermediate container e084263ec7a9
---> 2ea0bba28159
Successfully built 2ea0bba28159
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Nov 01, 2021 12:18:34 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38m 38s
216 actionable tasks: 154 executed, 55 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/vgjoommreh7ou
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #876
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/876/display/redirect>
Changes:
------------------------------------------
[...truncated 461.39 KB...]
Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9886268 sha256=e94ab98c37b2548709e49df53d37ad613f941a1379a1ae7b2245274a11e28c5f
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect, google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory /usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3 google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3 typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container c92078f84791
---> bea79618d109
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> a6ef16e8b287
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 445a8fdac381
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 42a84a0be70b
Removing intermediate container 42a84a0be70b
---> 4029e3584cf4
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 48149f7a8f4f
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 539c4b48b214
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=12eb318807743ea78f7dd3405fb34c10e656f22cc0010b055fc706891357ddb4
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mFound existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container 539c4b48b214
---> 467d3f79e99d
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in bb7ff8e60faf
Removing intermediate container bb7ff8e60faf
---> ed87148eed02
Step 21/27 : RUN pip freeze --all
---> Running in 395ead0c1115
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.28.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.6
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.23
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container 395ead0c1115
---> 856acfe2c9b1
Step 22/27 : RUN pip check
---> Running in 14de1ca7577e
No broken requirements found.
Removing intermediate container 14de1ca7577e
---> e3b426beabc2
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> 444885fcbab5
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> 5422bccb9b1d
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> ca627d11a13d
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> e08f9ce99737
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 8dfa299394e7
Removing intermediate container 8dfa299394e7
---> 00fc29ad42f4
Successfully built 00fc29ad42f4
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 31, 2021 6:19:31 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38m 37s
216 actionable tasks: 154 executed, 55 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/ochshs5sjvh24
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_XVR_Spark3 - Build # 875 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_Spark3 - Build # 875 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/875/ to view the results.
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #874
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/874/display/redirect>
Changes:
------------------------------------------
[...truncated 472.79 KB...]
Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9886290 sha256=b714534c7d7aa6855bb7205bd96f69e95802e83827026cdd5cf330a4cc0f0b56
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect, google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory /usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3 google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3 typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container a6e22241f84c
---> 6321b15dbf7f
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> e054e51094e0
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 4bdc0258e300
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in d496989fcde0
Removing intermediate container d496989fcde0
---> 3dd017a1e2d0
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> c43f219e8a3d
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in ead8b2a5dcb9
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=f21a77a9efc49b2e6ac9c8a73868a0b067fe75e22cb4b04322fb8abdd5495a34
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mSkip pulling license for bs4
Found existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container ead8b2a5dcb9
---> 046cb5a4ed78
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in 72900090a95f
Removing intermediate container 72900090a95f
---> 3bc269e3e0bb
Step 21/27 : RUN pip freeze --all
---> Running in df3209b6d9b0
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.28.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.6
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.23
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container df3209b6d9b0
---> 2781bd8d1381
Step 22/27 : RUN pip check
---> Running in 649baab77dcd
No broken requirements found.
Removing intermediate container 649baab77dcd
---> d03ebaccf808
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> 9d19ff72b416
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> 5956bb68ef40
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> c89fd7c96c45
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 7e061a798753
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in c68b6c725ec6
Removing intermediate container c68b6c725ec6
---> e58777e31094
Successfully built e58777e31094
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 31, 2021 6:15:36 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 35m 46s
216 actionable tasks: 154 executed, 55 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/3zj6y2oohwxga
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #873
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/873/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15753 from [BEAM-13080] Add option in Reshuffle to
------------------------------------------
[...truncated 494.78 KB...]
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container b80de4236607
---> 34952c73015b
Step 22/27 : RUN pip check
---> Running in c705b6f6a5e5
No broken requirements found.
Removing intermediate container c705b6f6a5e5
---> a5f47f10b3f3
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> f1e36f57913f
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> 2b532c370791
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 1822cf2e5221
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 35c98a760166
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 1f7beae1d80a
Removing intermediate container 1f7beae1d80a
---> 24b96ac160af
Successfully built 24b96ac160af
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 37427
Launching Python expansion service @ 33981
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=2h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--io_expansion_jar
$ case --io_expansion_jar in
$ IO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar>
$ key=--pipeline_opts
$ case --pipeline_opts in
$ PIPELINE_OPTS=--kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar>
$ key=--test_expansion_addr
$ case --test_expansion_addr in
$ TEST_EXPANSION_ADDR=localhost:37427
$ key=--runner
$ case --runner in
$ RUNNER=spark
$ key=--tests
$ case --tests in
$ TESTS=./test/integration/xlang ./test/integration/io/xlang/...
$ key=--endpoint
$ case --endpoint in
$ ENDPOINT=localhost:34473
$ cd <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src>
$ test -d sdks/go/test
$ EXPANSION_PORT=48105
$ IO_EXPANSION_ADDR=localhost:38079
No IO expansion address specified; starting a new IO expansion server on localhost:38079
$ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar> 38079
$ IO_EXPANSION_PID=8777
$ SIMULTANEOUS=1
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:38079
Starting a Gradle Daemon, 3 busy Daemons could not be reused, use --status for details
Oct 31, 2021 12:13:00 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@551bdc27
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58fdd99
beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6b1274d2
beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7bc1a03d
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
> Task :sdks:go:container:docker
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 25s
8 actionable tasks: 6 executed, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pq22lew4uh6zi
$ CONTAINER=apache/beam_go_sdk
$ cd sdks/go
>>> RUNNING spark integration tests with pipeline options: -p 1 -timeout 2h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test --dataflow_worker_jar= --endpoint=localhost:34473 --test_expansion_addr=localhost:37427 --io_expansion_addr=localhost:38079 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar>
$
./run_validatesrunner_tests.sh: line 399: go: command not found
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 127
$ exit 127
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:34473 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5100 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py ... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
=========== 10 passed, 5100 deselected, 2 warnings in 101.84 seconds ===========
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:34473 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5100 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5100 deselected in 57.25 seconds =============
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:34473 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5110 items / 5101 deselected / 9 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
================= 9 passed, 5101 deselected in 178.84 seconds ==================
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 8699.
Stopping expansion service pid: 8702.
> Task :runners:spark:3:job-server:sparkJobServerCleanup
Stopping job server pid: 24700.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 30m 29s
216 actionable tasks: 155 executed, 54 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/2rgkuqy54chya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #872
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/872/display/redirect>
Changes:
------------------------------------------
[...truncated 464.36 KB...]
Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9885914 sha256=336e8ae353f523beeb2d19dd3b9ad2570fc3ee7e5d448163ef557ed20f594f82
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect, google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory /usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3 google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3 typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container 8ab2ffde82c4
---> 6b45e30af57c
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> 29439546a4d6
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 6356ce1a088d
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 57a951d21e89
Removing intermediate container 57a951d21e89
---> c23542cb20d7
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 2560664d3ae1
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in b7ed8ea165e3
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=8b0a113c173c0000ab7d4bb1e2e221a8d5a044a08b802a33e15e782b0987bfce
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mFound existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container b7ed8ea165e3
---> dde2a34a4e7d
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in e7402c0ef674
Removing intermediate container e7402c0ef674
---> 0b31443fab30
Step 21/27 : RUN pip freeze --all
---> Running in e0a4b3d304b3
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.28.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.6
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.23
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container e0a4b3d304b3
---> 396d2f2fd8c9
Step 22/27 : RUN pip check
---> Running in 4971a1483978
No broken requirements found.
Removing intermediate container 4971a1483978
---> 7b1a27e79bd8
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> f8407ae16915
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> fb952fd31fda
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> e70d4bf6fa39
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 8fb96c36dd6c
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in f378a9b5ef24
Removing intermediate container f378a9b5ef24
---> 41fccf26b445
Successfully built 41fccf26b445
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 30, 2021 6:17:20 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 35m 28s
216 actionable tasks: 163 executed, 47 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/ojpmbikxjfxeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #871
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/871/display/redirect>
Changes:
------------------------------------------
[...truncated 477.44 KB...]
Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9885886 sha256=d1c4090a07f1262f6b74e07f7768cdedb5ddd3bfb0f64dc779322e7468ae8803
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect, google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory /usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSuccessfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3 google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3 typing-inspect-0.7.1
[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container dd0e68863e45
---> fb56134a1054
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> eb0ca238a2fd
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 7a90900a42e3
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in a3eb46599676
Removing intermediate container a3eb46599676
---> b6af7d4916ca
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 5f595860949b
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in cf7446be80aa
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=e89f469b78a7e59249bf701f2166b534f7b7b0ab64750994cd42be65d80828a0
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mFound existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container cf7446be80aa
---> 2c2a0113f73e
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in 50a87cc2c075
Removing intermediate container 50a87cc2c075
---> 58aa2a896f99
Step 21/27 : RUN pip freeze --all
---> Running in d9445ff0ecbe
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.28.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.6
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.23
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container d9445ff0ecbe
---> 7c3ba0a9ffd6
Step 22/27 : RUN pip check
---> Running in 77d128bb6d22
No broken requirements found.
Removing intermediate container 77d128bb6d22
---> ce9621def492
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> b83dffad5214
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> a2f2fd8ff904
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 6900a8a61d74
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> f3ce48e3a563
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in c9d13a1fd344
Removing intermediate container c9d13a1fd344
---> 38f7c36e1cbc
Successfully built 38f7c36e1cbc
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 30, 2021 12:30:57 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 52m 49s
216 actionable tasks: 163 executed, 47 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/emz6wzger34eu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #870
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/870/display/redirect>
Changes:
------------------------------------------
[...truncated 459.22 KB...]
Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-cp36-cp36m-linux_x86_64.whl size=9885934 sha256=25f8cc18d02fc248f3e9335e74ba64e26fe7918ec07c95defd5f26c31031f130
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: mypy-extensions, typing-inspect, google-api-core, libcst, google-cloud-bigquery-storage, apache-beam
Attempting uninstall: google-api-core
Found existing installation: google-api-core 1.22.2
Uninstalling google-api-core-1.22.2:
Removing file or directory /usr/local/lib/python3.6/site-packages/google/api_core/
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2-py3.8-nspkg.pth
Removing file or directory /usr/local/lib/python3.6/site-packages/google_api_core-1.22.2.dist-info/
Successfully uninstalled google-api-core-1.22.2
Successfully installed apache-beam-2.35.0.dev0 google-api-core-1.31.3 google-cloud-bigquery-storage-2.9.1 libcst-0.3.21 mypy-extensions-0.4.3 typing-inspect-0.7.1
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mRemoving intermediate container 26e24dd5ab20
---> b0eebed6f2f6
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> da842b0727a4
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 79b9107c3dcb
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 12d64997669c
Removing intermediate container 12d64997669c
---> 952cc9ede016
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 2e0b95ed459c
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 9386ad249350
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=113bc95315f06dc1e93ed548c8f5191f309e6069182aae49090a18f894465629
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 117 dependencies
[0mSkip pulling license for bs4
Found existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container 9386ad249350
---> 0ea6190b5e26
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in 85a517da1b97
Removing intermediate container 85a517da1b97
---> e3b2e85aa64c
Step 21/27 : RUN pip freeze --all
---> Running in 0048c3dcb28d
absl-py==0.15.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.10.8
chardet==3.0.4
clang==5.0
click==8.0.3
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.31.3
google-api-python-client==2.28.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigquery-storage==2.9.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.40.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.1.0
keras==2.6.0
Keras-Preprocessing==1.1.2
libcst==0.3.21
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.10.0
mypy-extensions==0.4.3
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.2
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.6
protobuf==3.17.3
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.10.23
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.6.0
tensorflow-estimator==2.7.0
termcolor==1.1.0
threadpoolctl==3.0.0
tqdm==4.62.3
typing-extensions==3.7.4.3
typing-inspect==0.7.1
uritemplate==4.1.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.2
wheel==0.37.0
wrapt==1.12.1
zipp==3.6.0
Removing intermediate container 0048c3dcb28d
---> 8138cb3b9651
Step 22/27 : RUN pip check
---> Running in cfe5d6861305
No broken requirements found.
Removing intermediate container cfe5d6861305
---> 936d1ed33c87
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> c6c4a2b898fc
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> 4030d379b8a3
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> e7b0628716ac
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> 85489d833b8d
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 196f3479436f
Removing intermediate container 196f3479436f
---> e9f0fc29de24
Successfully built e9f0fc29de24
Successfully tagged apache/beam_python3.6_sdk:2.35.0.dev
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
Oct 30, 2021 6:13:23 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
./run_validatesrunner_tests.sh: line 399: go: command not found
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 127
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 33m 44s
216 actionable tasks: 154 executed, 55 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/wla3feswo4qru
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org