You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/10/24 14:57:50 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #2295
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/2295/display/redirect?page=changes>
Changes:
[noreply] Migrate examples and maven-archetypes (including Java Quickstart) to
[Moritz Mack] Update remaining pointers to Spark runner to Spark 3 module (addresses
------------------------------------------
[...truncated 1.29 MB...]
Collecting mypy-protobuf==1.18
Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
Collecting distlib==0.3.1
Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB)
Collecting numpy<1.23.0,>=1.14.3
Downloading numpy-1.22.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
Collecting pluggy>=0.12.0
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting py>=1.4.17
Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting packaging>=14
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Downloading virtualenv-20.13.2-py2.py3-none-any.whl (8.7 MB)
Collecting filelock>=3.0.0
Downloading filelock-3.4.2-py3-none-any.whl (9.9 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting six>=1.14.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting grpcio>=1.37.0
Downloading grpcio-1.43.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.1 MB)
Collecting protobuf<4.0dev,>=3.5.0.post1
Downloading protobuf-3.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting pyparsing!=3.0.5,>=2.0.2
Downloading pyparsing-3.0.6-py3-none-any.whl (97 kB)
Collecting platformdirs<3,>=2
Downloading platformdirs-2.4.1-py3-none-any.whl (14 kB)
Installing collected packages: six, pyparsing, platformdirs, filelock, distlib, virtualenv, toml, setuptools, py, protobuf, pluggy, packaging, grpcio, wheel, tox, numpy, mypy-protobuf, grpcio-tools
Attempting uninstall: setuptools
Found existing installation: setuptools 58.1.0
Uninstalling setuptools-58.1.0:
Successfully uninstalled setuptools-58.1.0
Successfully installed distlib-0.3.1 filelock-3.4.2 grpcio-1.43.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 numpy-1.22.2 packaging-21.3 platformdirs-2.4.1 pluggy-1.0.0 protobuf-3.19.1 py-1.11.0 pyparsing-3.0.6 setuptools-60.9.3 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.13.2 wheel-0.37.1
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/bin/python3.10> -m pip install --upgrade pip' command.
> Task :sdks:python:sdist
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/setuptools/dist.py>:505: UserWarning: Normalizing '2.44.0.dev' to '2.44.0.dev0'
warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 12.250064 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:python:container:py310:copyDockerfileDependencies
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:python:container:py310:dockerPrepare
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :sdks:python:installGcpTest
Processing ./build/apache-beam.tar.gz
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: protobuf<4,>3.12.2 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages> (from apache-beam==2.44.0.dev0) (3.19.1)
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp310-cp310-linux_x86_64.whl
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:py310:docker
Sending build context to Docker daemon 16.78MB
Step 1/32 : ARG py_version
Step 2/32 : FROM python:"${py_version}"-bullseye as beam
---> f05c8762fe15
Step 3/32 : MAINTAINER "Apache Beam <de...@beam.apache.org>"
> Task :sdks:python:installGcpTest FAILED
ERROR: Could not find a version that satisfies the requirement cloudpickle~=2.2.0 (from apache-beam[aws,azure,dataframe,gcp,test]) (from versions: 0.1.0, 0.1.1, 0.2.1, 0.2.2, 0.3.0, 0.3.1, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 0.4.4, 0.5.0, 0.5.1, 0.5.2, 0.5.3, 0.5.4, 0.5.5, 0.5.6, 0.6.0, 0.6.1, 0.7.0, 0.8.0, 0.8.1, 1.0.0, 1.1.1, 1.2.0, 1.2.1, 1.2.2, 1.3.0, 1.4.0, 1.4.1, 1.5.0, 1.6.0, 2.0.0)
ERROR: No matching distribution found for cloudpickle~=2.2.0
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/bin/python3.10> -m pip install --upgrade pip' command.
> Task :runners:spark:3:job-server:sparkJobServerCleanup
Stopping job server pid: 3959144.
> Task :sdks:java:container:java8:docker
Sending build context to Docker daemon 209MB
Step 1/21 : ARG java_version
Step 2/21 : FROM openjdk:${java_version}-bullseye
---> b273004037cc
Step 3/21 : MAINTAINER "Apache Beam <de...@beam.apache.org>"
---> Running in 00d11960ebba
Removing intermediate container 00d11960ebba
---> 3f78c34da2e2
Step 4/21 : ARG pull_licenses
---> Running in b0f7400f5bef
Removing intermediate container b0f7400f5bef
---> fb3fff8b2715
Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> cf015cd12726
Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> 59ee05aa91e8
Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> 6338adc9c3ab
Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> 2b2369efdd20
Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> c534295daf0d
Step 10/21 : COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
---> 831a9afc463e
Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 20fd5b80023e
Step 12/21 : COPY target/LICENSE /opt/apache/beam/
---> 0f21164a9c00
Step 13/21 : COPY target/NOTICE /opt/apache/beam/
---> e26c05f1fe30
Step 14/21 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
---> a82321c1d1d0
Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/
---> f0c75bb5cfe9
Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE
---> Running in eaa0ca017ca2
Removing intermediate container eaa0ca017ca2
---> a0ba9adc818c
Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> fd793ee719de
Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in b95a2c29c951
Removing intermediate container b95a2c29c951
---> 171f42a3bc46
Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 6aac722b68e7
Removing intermediate container 6aac722b68e7
---> 75e0ca165b6e
Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/
---> 5247ad5d2f35
Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 61187a9c1137
Removing intermediate container 61187a9c1137
---> c349f402eb96
Successfully built c349f402eb96
Successfully tagged apache/beam_java8_sdk:2.44.0.dev
> Task :sdks:python:container:py310:docker
---> Running in 92fdb1784cc8
Removing intermediate container 92fdb1784cc8
---> 116677bf99a9
Step 4/32 : RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/*
---> Running in ce044b4aa693
Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8184 kB]
Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [193 kB]
Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [14.6 kB]
Fetched 8599 kB in 2s (4582 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
libyaml-dev is already the newest version (0.2.2-1).
Suggested packages:
distcc | icecc
The following NEW packages will be installed:
ccache libsnappy-dev libsnappy1v5
0 upgraded, 3 newly installed, 0 to remove and 7 not upgraded.
Need to get 495 kB of archives.
After this operation, 1425 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian bullseye/main amd64 ccache amd64 4.2-1 [446 kB]
Get:2 http://deb.debian.org/debian bullseye/main amd64 libsnappy1v5 amd64 1.1.8-1 [17.9 kB]
Get:3 http://deb.debian.org/debian bullseye/main amd64 libsnappy-dev amd64 1.1.8-1 [31.1 kB]
[91mdebconf: delaying package configuration, since apt-utils is not installed
[0mFetched 495 kB in 0s (1737 kB/s)
Selecting previously unselected package ccache.
(Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 23422 files and directories currently installed.)
Preparing to unpack .../ccache_4.2-1_amd64.deb ...
Unpacking ccache (4.2-1) ...
Selecting previously unselected package libsnappy1v5:amd64.
Preparing to unpack .../libsnappy1v5_1.1.8-1_amd64.deb ...
Unpacking libsnappy1v5:amd64 (1.1.8-1) ...
Selecting previously unselected package libsnappy-dev:amd64.
Preparing to unpack .../libsnappy-dev_1.1.8-1_amd64.deb ...
Unpacking libsnappy-dev:amd64 (1.1.8-1) ...
Setting up ccache (4.2-1) ...
Updating symlinks in /usr/lib/ccache ...
Setting up libsnappy1v5:amd64 (1.1.8-1) ...
Setting up libsnappy-dev:amd64 (1.1.8-1) ...
Processing triggers for libc-bin (2.31-13+deb11u4) ...
Removing intermediate container ce044b4aa693
---> 47635c702cb5
Step 5/32 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
---> 931e1ce41483
Step 6/32 : RUN pip install --no-deps -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt
---> Running in d1c09f861ecb
[91mERROR: Could not find a version that satisfies the requirement absl-py==1.3.0 (from versions: 0.1.0, 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.1.10, 0.1.11, 0.1.12, 0.1.13, 0.2.0, 0.2.1, 0.2.2, 0.3.0, 0.4.0, 0.4.1, 0.5.0, 0.6.0, 0.6.1, 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0, 0.10.0, 0.11.0, 0.12.0, 0.13.0, 0.14.0, 0.14.1, 0.15.0, 1.0.0)
[0m[91mERROR: No matching distribution found for absl-py==1.3.0
[0mThe command '/bin/sh -c pip install --no-deps -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt' returned a non-zero code: 1
> Task :sdks:python:container:py310:docker FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py310:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1m 36s
242 actionable tasks: 26 executed, 216 up-to-date
Publishing build scan...
https://gradle.com/s/z5sjjr3slkpsg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark3 #2297
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/2297/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #2296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/2296/display/redirect?page=changes>
Changes:
[Andrew Pilloud] Publish Python nexmark metrics to influxdb
[Andrew Pilloud] Exclude nexmark from codecov, it has no tests
[yathu] Bump dataflow java fn container version to beam-master-20221022
[noreply] Ignoring BigQuery partitions with empty files (#23710)
[noreply] Benchmarking RunInference Example (#23554)
[Kiley Sok] Increate timeout for test pipelines
------------------------------------------
[...truncated 863.17 KB...]
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006^\313\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215d7\242\227\362z%\204e\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000HL>\335\002 vendor/gu\0019Lv26_0_jre/com/google\001\0134mon/collect/Bi\tZ\000\006\005Z\014st\000\020\035u$List;L\000\007op\005\273\010t\000,R\267\001-\000M\004\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000v\330M\305sr\000\021\001\342\000.\001\342\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ei\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\360\001b\020xsr\000J>\365\001)f\000.%f\000.5f\020.com.)f\001\013\014mon.-f\000.\001\334%j\001S\001\001(\003\000\000xpw\004\000\000\000\001A\251\000\027\001\005\000\032\001l\000\023\005\222%\021\020Array!\203 x\201\322\035\231\307a\235\003\001\274\024\004sizex\001I\000\001\t@\014sr\0002>\241\000\241A-\226\024.AutoV\241;\000_i\244\004_FAD\034\303\343i\345\363l$\364\205.\004\013dm\233\205*\000\022I\002!\026\030/String!\313\014name\001\246\010 L\000Q\020\001\017\014\022L\000\004a\335\010t\000.\216\034\002\005|a\340a\326\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\226\010t\000\000\001y\004\027sZ\267\005\021\370\rA\000OI\216\034\367\031\n\2336X\271\227\305\".\301\000\014\017xps\001P\004\025?IS\004\000wQS%\374\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001u(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\353\010t\000\023=\3604Boolean;L\000\trow)C\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\272Lions$EmptyMapY6\024\205Z\334\347\265\247\211WA\302\000.\r\3224\315 r\200\325\234\372\356\002\000\001Z\000\005\211\000\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\345\375\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\241\036x\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\265\231wK\331\312\265']\251Z\343\2237J\001\005e\014\014sr\000Ro\001\005\364\004s.\001\313\371\212(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000\034x\237G[\330\210\240{eR \005tokent\000LB\032\002\251,\212\222\006\010ref\305\222\001\241\000T\001N\000;\345r\000Z>\221\000\tQ\212}\005\rQ\005\362\005Q\024$Simple\026\005\020!\255\001\001\t\372\000J\376i\000\031i\0342{#\261\276\3768|%\033\030\013runtim\005w\010t\000\030}m\r\241\005\362\030;xpvr\000\036>\204\000\241\311-~(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "DHfXnqRiGSVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\330\001\350\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xrr5\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*jj\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "DHfXnqRiGSVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*j5\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "DHfXnqRiGSbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.44.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.44.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-CGRxIE9edPHnbxQhM-L5mp8h21H-ySB79uQtSquPV_Q.jar\022@086471204f5e74f1e76f142133e2f99a9f21db51fec9207bf6e42d4aab8f57f4"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-CGRxIE9edPHnbxQhM-L5mp8h21H-ySB79uQtSquPV_Q.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-FBI0Bb27lF3oEBieWAi7SP8X1zBR8k4BJQOVpsoK9a0.jar\022@14123405bdbb945de810189e5808bb48ff17d73051f24e01250395a6ca0af5ad"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-FBI0Bb27lF3oEBieWAi7SP8X1zBR8k4BJQOVpsoK9a0.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-kJ2mc8rBH5-IklhfR1XzNotlIQ_mnVMA-pgaXv2r8Ag.jar\022@909da673cac11f9f8892585f4755f3368b65210fe69d5300fa981a5efdabf008"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-kJ2mc8rBH5-IklhfR1XzNotlIQ_mnVMA-pgaXv2r8Ag.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-B0CAb3QpJET_6VsT3hcC_89VtvhV616H8N2bHAIaqWo.jar\022@0740806f74292444ffe95b13de1702ffcf55b6f855eb5e87f0dd9b1c021aa96a"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-B0CAb3QpJET_6VsT3hcC_89VtvhV616H8N2bHAIaqWo.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-gclqV9lOGqQOKesG-a6TAUTGEYlyIDqpyd4M_k7gtWo.jar\022@81c96a57d94e1aa40e29eb06f9ae930144c6118972203aa9c9de0cfe4ee0b56a"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-gclqV9lOGqQOKesG-a6TAUTGEYlyIDqpyd4M_k7gtWo.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-byzoQxdXengTvA5IlbH9gSIzfhNQElRYltuMJN0vjcc.jar\022@6f2ce84317577a7813bc0e4895b1fd8122337e135012545896db8c24dd2f8dc7"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-byzoQxdXengTvA5IlbH9gSIzfhNQElRYltuMJN0vjcc.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.44.0-SNAPSHOT-cJiNkfu7tty5QOuCrVWY66ol1ToU_NAntKA32lgKxP0.jar\022@70988d91fbbbb6dcb940eb82ad5598ebaa25d53a14fcd027b4a037da580ac4fd"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.44.0-SNAPSHOT-cJiNkfu7tty5QOuCrVWY66ol1ToU_NAntKA32lgKxP0.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/10/24 20:48:50 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> as /tmp/worker-4-1666644530669593414
2022/10/24 20:48:57 Prepared job with id: go-testjdbcio_postgresreadwrite-446_8db8f009-6c7b-4332-8d8e-6c590ea9bac4 and staging token: go-testjdbcio_postgresreadwrite-446_8db8f009-6c7b-4332-8d8e-6c590ea9bac4
2022/10/24 20:48:58 Staged binary artifact with token:
2022/10/24 20:48:58 Submitted job: go0testjdbcio0postgresreadwrite0446-jenkins-1024204858-b722e5b2_e246e130-d268-48bf-aa01-57beebc1fdd0
2022/10/24 20:48:58 Job state: STOPPED
2022/10/24 20:48:58 Job state: STARTING
2022/10/24 20:48:58 Job state: RUNNING
2022/10/24 20:50:30 Job state: DONE
2022/10/24 20:50:30 Warning: 6 errors during metrics processing: [failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"DHfXnqRiGSExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"DHfXnqRiGSExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xfe\x08\xfe\x08\xfe\x08" labels:{key:"PCOLLECTION" value:"DHfXnqRiGSExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xf6\x08\xf6\x08\xf6\x08" labels:{key:"PCOLLECTION" value:"DHfXnqRiGSExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"DHfXnqRiGSExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\x83\t\x83\t\x83\t" labels:{key:"PCOLLECTION" value:"DHfXnqRiGSExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}]
--- PASS: TestJDBCIO_PostgresReadWrite (154.38s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 308.451s
=== RUN TestKafkaIO_BasicReadWrite
--- FAIL: TestKafkaIO_BasicReadWrite (0.02s)
panic: tried cross-language for beam:transform:org.apache.beam:kafka_write:v1 against localhost:38969 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n4" value:{unique_name:"n4" coder_id:"c1@mOUaWODENd" is_bounded:BOUNDED windowing_strategy_id:"w0@mOUaWODENd"}} windowing_strategies:{key:"w0@mOUaWODENd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c2@mOUaWODENd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@mOUaWODENd" value:{spec:{urn:"beam:coder:bytes:v1"}}} coders:{key:"c1@mOUaWODENd" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@mOUaWODENd" component_coder_ids:"c0@mOUaWODENd"}} coders:{key:"c2@mOUaWODENd" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:kafka_write:v1" payload:"\n}\n\x1c\n\x0eProducerConfig\x1a\n*\x08\n\x02\x10\x07\x12\x02\x10\x07\n\x0b\n\x05Topic\x1a\x02\x10\x07\n\x13\n\rKeySerializer\x1a\x02\x10\x07\n\x15\n\x0fValueSerializer\x1a\x02\x10\x07\x12$d97fbd8d-dde2-46d8-babd-f5372b6ab5e6\x12\xda\x01\x04\x00\x00\x00\x00\x01\x11bootstrap.servers\x0flocalhost:36945=xlang_kafkaio_basic_test_2767fe5e-eab9-471a-8552-411e236ce98e9org.apache.kafka.common.serialization.ByteArraySerializer9org.apache.kafka.common.serialization.ByteArraySerializer"} inputs:{key:"i0" value:"n4"} environment_id:"go"} namespace:"mOUaWODENd"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:38969: connect: connection refused" [recovered]
panic: tried cross-language for beam:transform:org.apache.beam:kafka_write:v1 against localhost:38969 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n4" value:{unique_name:"n4" coder_id:"c1@mOUaWODENd" is_bounded:BOUNDED windowing_strategy_id:"w0@mOUaWODENd"}} windowing_strategies:{key:"w0@mOUaWODENd" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c2@mOUaWODENd" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@mOUaWODENd" value:{spec:{urn:"beam:coder:bytes:v1"}}} coders:{key:"c1@mOUaWODENd" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@mOUaWODENd" component_coder_ids:"c0@mOUaWODENd"}} coders:{key:"c2@mOUaWODENd" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:kafka_write:v1" payload:"\n}\n\x1c\n\x0eProducerConfig\x1a\n*\x08\n\x02\x10\x07\x12\x02\x10\x07\n\x0b\n\x05Topic\x1a\x02\x10\x07\n\x13\n\rKeySerializer\x1a\x02\x10\x07\n\x15\n\x0fValueSerializer\x1a\x02\x10\x07\x12$d97fbd8d-dde2-46d8-babd-f5372b6ab5e6\x12\xda\x01\x04\x00\x00\x00\x00\x01\x11bootstrap.servers\x0flocalhost:36945=xlang_kafkaio_basic_test_2767fe5e-eab9-471a-8552-411e236ce98e9org.apache.kafka.common.serialization.ByteArraySerializer9org.apache.kafka.common.serialization.ByteArraySerializer"} inputs:{key:"i0" value:"n4"} environment_id:"go"} namespace:"mOUaWODENd"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:38969: connect: connection refused"
goroutine 10 [running]:
testing.tRunner.func1.2({0xd7ff40, 0xc000572ec0})
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1389 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1392 +0x39f
panic({0xd7ff40, 0xc000572ec0})
/home/jenkins/sdk/go1.18.1/src/runtime/panic.go:838 +0x207
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0000a37c0?, 0xc0000b9c20?}, {0xeb8443, 0x2d}, {0xc0000da6e0?, 0xc0001c0ea0?, 0xcd8140?}, {0xc00037ee20, 0xf}, 0xc00010bc60, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/pkg/beam/xlang.go>:162 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/kafkaio.Write({0xc0000a3560?, 0xc0000b9c20?}, {0xc00037ee20, 0xf}, {0xc00037ede0, 0xf}, {0xc00004f840, 0x3d}, {0xc00010be60?}, {0x0, ...})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/pkg/beam/io/xlang/kafkaio/kafka.go>:278 +0x4ad
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.writeInts({0xc0000a3540?, 0xc0000b9c20?}, {0xc00037ee20, 0xf}, {0xc00037ede0, 0xf}, {0xc00004f840, 0x3d}, {0xc000122000, 0x3e8, ...})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka.go>:48 +0x24b
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.WritePipeline({0xc00037ee20, 0xf}, {0xc00037ede0, 0xf}, {0xc00004f840, 0x3d}, {0xc000122000, 0x3e8, 0x3e8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka.go>:70 +0x157
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.TestKafkaIO_BasicReadWrite(0xc0002c5a00)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go>:61 +0xed
testing.tRunner(0xc0002c5a00, 0xef0498)
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1486 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.192s
FAIL
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:sparkJobServerCleanup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 195
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 47m 1s
263 actionable tasks: 193 executed, 58 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/xvn3okq5mb2pg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org