You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/05/16 08:36:06 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #1650
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/1650/display/redirect>
Changes:
------------------------------------------
[...truncated 562.91 KB...]
Step 14/31 : RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1)
---> Running in de64894d8ba2
No broken requirements found.
Removing intermediate container de64894d8ba2
---> 569bd54f8231
Step 15/31 : RUN pip freeze --all
---> Running in c1fd88509793
absl-py==1.0.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.4.0
beautifulsoup4==4.11.1
bs4==0.0.1
cached-property==1.5.2
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.1.3
cloudpickle==2.0.0
crcmod==1.7
cryptography==37.0.2
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.11
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.1
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.47.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.3
google-cloud-bigquery-storage==2.13.1
google-cloud-bigtable==1.7.1
google-cloud-core==1.7.2
google-cloud-datastore==1.15.4
google-cloud-dlp==3.6.2
google-cloud-language==1.3.1
google-cloud-profiler==3.0.8
google-cloud-pubsub==2.12.0
google-cloud-pubsublite==1.4.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.2
google-cloud-videointelligence==1.16.2
google-cloud-vision==1.0.1
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.2
googleapis-common-protos==1.56.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.4
grpcio==1.46.0
grpcio-gcp==0.2.2
grpcio-status==1.46.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.7.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.3
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==14.0.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.8
overrides==6.1.0
packaging==21.3
pandas==1.3.5
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.20.1
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==7.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.1
PyYAML==6.0
regex==2022.4.24
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.7.3
setuptools==57.5.0
six==1.16.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.36
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.25.0
termcolor==1.1.0
testcontainers==3.5.3
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.64.0
typing-utils==0.1.0
typing_extensions==4.2.0
uritemplate==4.1.1
urllib3==1.26.9
wcwidth==0.2.5
websocket-client==1.3.2
Werkzeug==2.1.2
wheel==0.37.1
wrapt==1.14.1
zipp==3.8.0
Removing intermediate container c1fd88509793
---> 365dbe4c1a76
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> 04ff7b26b733
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 7d8dbffbca92
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 5a0f8b9ad308
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 4ffe61214ff4
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in eb808036d354
Removing intermediate container eb808036d354
---> a022bfda9458
Step 21/31 : FROM beam as third_party_licenses
---> a022bfda9458
Step 22/31 : ARG pull_licenses
---> Running in 171d427f8b60
Removing intermediate container 171d427f8b60
---> c18a73ca3313
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> 3a1066cae045
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 1809f04a96fc
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 113f3394d5cd
Removing intermediate container 113f3394d5cd
---> dcd3d3d9c3f4
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 0a176bf49701
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 55edd053c902
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=41635423b273cfb4d1ca206921b86878283a5214ebdbb2795085646b66b0ed16
Stored in directory: /root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.4
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 22.0.4; however, version 22.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mRemoving intermediate container 55edd053c902
---> a21ce101e3c9
Step 28/31 : FROM beam
---> a022bfda9458
Step 29/31 : ARG pull_licenses
---> Running in 86214f78927c
Removing intermediate container 86214f78927c
---> 15fc05ae661c
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 739bd353e0df
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 18f821bc765f
Removing intermediate container 18f821bc765f
---> b2fd1e2b89b0
Successfully built b2fd1e2b89b0
Successfully tagged apache/beam_python3.7_sdk:2.40.0.dev
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 10m 36s
237 actionable tasks: 153 executed, 73 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/ailr4ddyu6esq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark3 #1653
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/1653/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #1652
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/1652/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13982] Added output of logging for python E2E pytests (#17637)
[noreply] [BEAM-14473] Throw error if using globally windowed, unbounded side
[noreply] [BEAM-14440] Add basic fuzz tests to the coders package (#17587)
[noreply] [BEAM-14035 ] Implement BigQuerySchema Read/Write TransformProvider
[noreply] Add Akvelon to case-studies (#17611)
[noreply] Merge pull request #17520 from BEAM-12356 Close DatasetService leaked
[noreply] Adding eslint and lint configuration to TypeScript SDK (#17676)
------------------------------------------
[...truncated 605.71 KB...]
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*j5\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "EzkhoYmfMkbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.40.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.40.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar\022@79bbed34591f15783869a605b839f02a9c034a3cec699aa5aafe622b13d3afe5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar\022@50b15308fb1be9c2d86747f5046d4541f73398735a642c7ca655ee4432a906a1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar\022@7541eac86c5a4d50a37d323c31c90f61aad9dff9b07fadae764c5a1e2d5a2a7b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar\022@5dd5277501aba1738ff4d0ac7c84e904445871b6c65d51cb8dbbcd5970a1fb70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar\022@62acee297d509cb08ea347308ca45d0611ab8a9fe5b4825983e00f4fad2d50f0"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar\022@761129d7ceae74417a5fa72166eb3e449cd6466ce571cc71d7f6ed95759ac952"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-3sK0GbbO1QiM7sXM1MNMyfWBx7dEJmkLZWULAbiFVEg.jar\022@dec2b419b6ced5088ceec5ccd4c34cc9f581c7b74426690b65650b01b8855448"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-3sK0GbbO1QiM7sXM1MNMyfWBx7dEJmkLZWULAbiFVEg.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/16 20:52:42 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> as /tmp/worker-4-1652734362298260641
2022/05/16 20:52:53 Prepared job with id: go-testjdbcio_postgresreadwrite_9bf14949-cd7b-4f5a-bc42-72d78edf24b7 and staging token: go-testjdbcio_postgresreadwrite_9bf14949-cd7b-4f5a-bc42-72d78edf24b7
2022/05/16 20:52:54 Staged binary artifact with token:
2022/05/16 20:52:54 Submitted job: go0testjdbcio0postgresreadwrite-jenkins-0516205254-a6b87381_be0c8e51-2d7b-4544-aa5e-4400fbf3537b
2022/05/16 20:52:54 Job state: STOPPED
2022/05/16 20:52:54 Job state: STARTING
2022/05/16 20:52:54 Job state: RUNNING
2022/05/16 20:54:18 Job state: DONE
2022/05/16 20:54:18 Warning: 6 errors during metrics processing: [failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"EzkhoYmfMkExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xe7\x0c\xe7\x0c\xe7\x0c" labels:{key:"PCOLLECTION" value:"EzkhoYmfMkExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"EzkhoYmfMkExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"EzkhoYmfMkExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xe7\x0c\xe7\x0c\xe7\x0c" labels:{key:"PCOLLECTION" value:"EzkhoYmfMkExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xda\x0c\xda\x0c\xda\x0c" labels:{key:"PCOLLECTION" value:"EzkhoYmfMkExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"}]
--- PASS: TestJDBCIO_PostgresReadWrite (153.59s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 392.963s
=== RUN TestKafkaIO_BasicReadWrite
--- FAIL: TestKafkaIO_BasicReadWrite (0.01s)
panic: tried cross-language for beam:transform:org.apache.beam:kafka_write:v1 against localhost:33497 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n4" value:{unique_name:"n4" coder_id:"c1@UctRLXDvjn" is_bounded:BOUNDED windowing_strategy_id:"w0@UctRLXDvjn"}} windowing_strategies:{key:"w0@UctRLXDvjn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c2@UctRLXDvjn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UctRLXDvjn" value:{spec:{urn:"beam:coder:bytes:v1"}}} coders:{key:"c1@UctRLXDvjn" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@UctRLXDvjn" component_coder_ids:"c0@UctRLXDvjn"}} coders:{key:"c2@UctRLXDvjn" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:kafka_write:v1" payload:"\n}\n\x1c\n\x0eProducerConfig\x1a\n*\x08\n\x02\x10\x07\x12\x02\x10\x07\n\x0b\n\x05Topic\x1a\x02\x10\x07\n\x13\n\rKeySerializer\x1a\x02\x10\x07\n\x15\n\x0fValueSerializer\x1a\x02\x10\x07\x12$d97fbd8d-dde2-46d8-babd-f5372b6ab5e6\x12\xda\x01\x04\x00\x00\x00\x00\x01\x11bootstrap.servers\x0flocalhost:33985=xlang_kafkaio_basic_test_ef21fd96-4e8e-4a51-9bf5-99677bfed3a49org.apache.kafka.common.serialization.ByteArraySerializer9org.apache.kafka.common.serialization.ByteArraySerializer"} inputs:{key:"i0" value:"n4"} environment_id:"go"} namespace:"UctRLXDvjn"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:33497: connect: connection refused" [recovered]
panic: tried cross-language for beam:transform:org.apache.beam:kafka_write:v1 against localhost:33497 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n4" value:{unique_name:"n4" coder_id:"c1@UctRLXDvjn" is_bounded:BOUNDED windowing_strategy_id:"w0@UctRLXDvjn"}} windowing_strategies:{key:"w0@UctRLXDvjn" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c2@UctRLXDvjn" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@UctRLXDvjn" value:{spec:{urn:"beam:coder:bytes:v1"}}} coders:{key:"c1@UctRLXDvjn" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@UctRLXDvjn" component_coder_ids:"c0@UctRLXDvjn"}} coders:{key:"c2@UctRLXDvjn" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:kafka_write:v1" payload:"\n}\n\x1c\n\x0eProducerConfig\x1a\n*\x08\n\x02\x10\x07\x12\x02\x10\x07\n\x0b\n\x05Topic\x1a\x02\x10\x07\n\x13\n\rKeySerializer\x1a\x02\x10\x07\n\x15\n\x0fValueSerializer\x1a\x02\x10\x07\x12$d97fbd8d-dde2-46d8-babd-f5372b6ab5e6\x12\xda\x01\x04\x00\x00\x00\x00\x01\x11bootstrap.servers\x0flocalhost:33985=xlang_kafkaio_basic_test_ef21fd96-4e8e-4a51-9bf5-99677bfed3a49org.apache.kafka.common.serialization.ByteArraySerializer9org.apache.kafka.common.serialization.ByteArraySerializer"} inputs:{key:"i0" value:"n4"} environment_id:"go"} namespace:"UctRLXDvjn"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:33497: connect: connection refused"
goroutine 21 [running]:
testing.tRunner.func1.2({0xca3820, 0xc00049e300})
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1389 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1392 +0x39f
panic({0xca3820, 0xc00049e300})
/home/jenkins/sdk/go1.18.1/src/runtime/panic.go:838 +0x207
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc0004a6300?, 0xc0004dc370?}, {0xdc9e9e, 0x2d}, {0xc00013e6e0?, 0x0?, 0x5?}, {0xc0003594e0, 0xf}, 0xc000175c60, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/pkg/beam/xlang.go>:162 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/kafkaio.Write({0xc0004a6ae0?, 0xc0004dc370?}, {0xc0003594e0, 0xf}, {0xc0003594a0, 0xf}, {0xc000143c80, 0x3d}, {0xc000175e60?}, {0x0, ...})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/pkg/beam/io/xlang/kafkaio/kafka.go>:278 +0x4ad
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.writeInts({0xc0004a6ac0?, 0xc0004dc370?}, {0xc0003594e0, 0xf}, {0xc0003594a0, 0xf}, {0xc000143c80, 0x3d}, {0xc0004e8000, 0x3e8, ...})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka.go>:48 +0x24b
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.WritePipeline({0xc0003594e0, 0xf}, {0xc0003594a0, 0xf}, {0xc000143c80, 0x3d}, {0xc0004e8000, 0x3e8, 0x3e8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka.go>:70 +0x157
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.TestKafkaIO_BasicReadWrite(0xc0004b44e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go>:61 +0xed
testing.tRunner(0xc0004b44e0, 0xdfe4f8)
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1486 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.155s
FAIL
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:io:google-cloud-platform:compileJava'.
> Failed to store cache entry for task ':sdks:java:io:google-cloud-platform:compileJava'
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 195
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 52m 46s
241 actionable tasks: 185 executed, 45 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/i3srbhbbysnnm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #1651
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/1651/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13015] Update the SDK harness grouping table to be memory bounded
------------------------------------------
[...truncated 1.47 MB...]
>
coders: <
key: "vdpvNBCRYhRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$7af13d12-5024-42b5-935b-e5a8a57728e4"
>
>
>
coders: <
key: "vdpvNBCRYhSerializableCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\312\241\002\360^\254\355\000\005sr\000,org.apache.beam.sdk.coders.SerializableCoder\010\364 \216\305ynl\002\000\001L\000\004typet\000\021Ljava/lang/Class;xr\000&ofV\000\024Custom\005P8j\260\010\235\013;\035\013\002\000\000xr\000 j\213\000\005/\034C\335\325\211\256\274~\370\001/\020pvr\000$N1\000\\io.BoundedSource!`v\023\177\370QA\0015\010r\000\035Z3\000\t,0\020\213\372\020Y\214\347\323\002\000\000xp"
>
>
>
coders: <
key: "vdpvNBCRYhTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006]\313\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215d7\242\227\362z%\204e\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000HL>\335\002 vendor/gu\0019Lv26_0_jre/com/google\001\0134mon/collect/Bi\tZ\000\006\005Z\014st\000\020\035u$List;L\000\007op\005\273\010t\000,R\267\001-\000M\004\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\337*4\272sr\000\021\001\342\000.\001\342\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ei\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\360\001b\020xsr\000J>\365\001)f\000.%f\000.5f\020.com.)f\001\013\014mon.-f\000.\001\334%j\001S\001\001(\003\000\000xpw\004\000\000\000\001A\251\000\027\001\005\000\032\001l\000\023\005\222%\021\020Array!\203 x\201\322\035\231\307a\235\003\001\274\024\004sizex\001I\000\001\t@\014sr\0002>\241\000\241A-\226\024.AutoV\241;\000_i\244\004_FAD\034\303\343i\345\363l$\364\205.\004\013dm\233\205*\000\022I\002!\026\030/String!\313\014name\001\246\010 L\000Q\020\001\017\014\022L\000\004a\335\010t\000.\216\034\002\005|a\340a\326\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\226\010t\000\000\001y\004\027sZ\267\005\021\370\rA\000OI\216\034\367\031\n\2336X\271\227\305\".\301\000\014\017xps\001P\004\025?IS\004\000wQS%\374\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001u(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\353\010t\000\023=\3604Boolean;L\000\trow)C\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\272Lions$EmptyMapY6\024\205Z\334\347\265\247\211WA\302\000.\r\3224\315 r\200\325\234\372\356\002\000\001Z\000\005\211\000\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\345\375\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\241\036x\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\223ESR\007\002\2776H\347\343\020z1Oc\005e\014\014sr\000Ro\001\005\364\004s.\001\313\371\212(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000\034x\237G[\330\210\240{eR \005tokent\000LB\032\002\251,\212\222\006\010ref\305\222\001\241\000T\001N\000;\345r\000Z>\221\000\tQ\212}\005\rQ\005\362\005Q\024$Simple\026\005\020!\255\001\001\t\372\346\346\005Bi\000\0342{#\261\276\3768|%\033\030\013runtim\005w\010t\000\030}m\r8\005\362\030;xpvr\000\036>\355\000\241\311-~(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "vdpvNBCRYhVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\330\001\350\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xrr5\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*jj\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "vdpvNBCRYhVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*j5\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "vdpvNBCRYhbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.40.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.40.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar\022@79bbed34591f15783869a605b839f02a9c034a3cec699aa5aafe622b13d3afe5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar\022@50b15308fb1be9c2d86747f5046d4541f73398735a642c7ca655ee4432a906a1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar\022@7541eac86c5a4d50a37d323c31c90f61aad9dff9b07fadae764c5a1e2d5a2a7b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar\022@5dd5277501aba1738ff4d0ac7c84e904445871b6c65d51cb8dbbcd5970a1fb70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar\022@62acee297d509cb08ea347308ca45d0611ab8a9fe5b4825983e00f4fad2d50f0"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar\022@761129d7ceae74417a5fa72166eb3e449cd6466ce571cc71d7f6ed95759ac952"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-SSZFwrFY24v1DlDBL-FE-XB3bdYMrYlFhaQ_wmexlLk.jar\022@492645c2b158db8bf50e50c12fe144f970776dd60cad894585a43fc267b194b9"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-SSZFwrFY24v1DlDBL-FE-XB3bdYMrYlFhaQ_wmexlLk.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/16 15:13:11 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> as /tmp/worker-4-1652713991171590244
2022/05/16 15:13:18 Prepared job with id: go-testjdbcio_postgresreadwrite_eed6f94a-f29c-46c5-a4a7-4a6bfe02cf85 and staging token: go-testjdbcio_postgresreadwrite_eed6f94a-f29c-46c5-a4a7-4a6bfe02cf85
2022/05/16 15:13:18 Staged binary artifact with token:
2022/05/16 15:13:18 Submitted job: go0testjdbcio0postgresreadwrite-jenkins-0516151318-94b8fb2e_616fdd81-7125-433c-b70b-23f002c45989
2022/05/16 15:13:18 Job state: STOPPED
2022/05/16 15:13:18 Job state: STARTING
2022/05/16 15:13:18 Job state: RUNNING
2022/05/16 15:14:32 Job state: DONE
2022/05/16 15:14:32 Warning: 6 errors during metrics processing: [failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"vdpvNBCRYhExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xe7\x0c\xe7\x0c\xe7\x0c" labels:{key:"PCOLLECTION" value:"vdpvNBCRYhExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"vdpvNBCRYhExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"vdpvNBCRYhExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xda\x0c\xda\x0c\xda\x0c" labels:{key:"PCOLLECTION" value:"vdpvNBCRYhExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/PairWithRestriction0"} failed to deduce Step from MonitoringInfo: urn:"beam:metric:sampled_byte_size:v1" type:"beam:metrics:distribution_int64:v1" payload:"\x01\xe7\x0c\xe7\x0c\xe7\x0c" labels:{key:"PCOLLECTION" value:"vdpvNBCRYhExternal/JdbcIO.ReadRows/JdbcIO.Read/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output/SplitAndSize0"}]
--- PASS: TestJDBCIO_PostgresReadWrite (100.59s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 167.573s
=== RUN TestKafkaIO_BasicReadWrite
--- FAIL: TestKafkaIO_BasicReadWrite (0.01s)
panic: tried cross-language for beam:transform:org.apache.beam:kafka_write:v1 against localhost:38255 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n4" value:{unique_name:"n4" coder_id:"c1@qyKOgMyRoD" is_bounded:BOUNDED windowing_strategy_id:"w0@qyKOgMyRoD"}} windowing_strategies:{key:"w0@qyKOgMyRoD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c2@qyKOgMyRoD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qyKOgMyRoD" value:{spec:{urn:"beam:coder:bytes:v1"}}} coders:{key:"c1@qyKOgMyRoD" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@qyKOgMyRoD" component_coder_ids:"c0@qyKOgMyRoD"}} coders:{key:"c2@qyKOgMyRoD" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:kafka_write:v1" payload:"\n}\n\x1c\n\x0eProducerConfig\x1a\n*\x08\n\x02\x10\x07\x12\x02\x10\x07\n\x0b\n\x05Topic\x1a\x02\x10\x07\n\x13\n\rKeySerializer\x1a\x02\x10\x07\n\x15\n\x0fValueSerializer\x1a\x02\x10\x07\x12$d97fbd8d-dde2-46d8-babd-f5372b6ab5e6\x12\xda\x01\x04\x00\x00\x00\x00\x01\x11bootstrap.servers\x0flocalhost:44431=xlang_kafkaio_basic_test_b3f9f55a-cb92-479a-8230-3abb216a60b79org.apache.kafka.common.serialization.ByteArraySerializer9org.apache.kafka.common.serialization.ByteArraySerializer"} inputs:{key:"i0" value:"n4"} environment_id:"go"} namespace:"qyKOgMyRoD"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:38255: connect: connection refused" [recovered]
panic: tried cross-language for beam:transform:org.apache.beam:kafka_write:v1 against localhost:38255 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n4" value:{unique_name:"n4" coder_id:"c1@qyKOgMyRoD" is_bounded:BOUNDED windowing_strategy_id:"w0@qyKOgMyRoD"}} windowing_strategies:{key:"w0@qyKOgMyRoD" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c2@qyKOgMyRoD" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@qyKOgMyRoD" value:{spec:{urn:"beam:coder:bytes:v1"}}} coders:{key:"c1@qyKOgMyRoD" value:{spec:{urn:"beam:coder:kv:v1"} component_coder_ids:"c0@qyKOgMyRoD" component_coder_ids:"c0@qyKOgMyRoD"}} coders:{key:"c2@qyKOgMyRoD" value:{spec:{urn:"beam:coder:global_window:v1"}}} environments:{key:"go" value:{}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:kafka_write:v1" payload:"\n}\n\x1c\n\x0eProducerConfig\x1a\n*\x08\n\x02\x10\x07\x12\x02\x10\x07\n\x0b\n\x05Topic\x1a\x02\x10\x07\n\x13\n\rKeySerializer\x1a\x02\x10\x07\n\x15\n\x0fValueSerializer\x1a\x02\x10\x07\x12$d97fbd8d-dde2-46d8-babd-f5372b6ab5e6\x12\xda\x01\x04\x00\x00\x00\x00\x01\x11bootstrap.servers\x0flocalhost:44431=xlang_kafkaio_basic_test_b3f9f55a-cb92-479a-8230-3abb216a60b79org.apache.kafka.common.serialization.ByteArraySerializer9org.apache.kafka.common.serialization.ByteArraySerializer"} inputs:{key:"i0" value:"n4"} environment_id:"go"} namespace:"qyKOgMyRoD"
expansion failed
caused by:
rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:38255: connect: connection refused"
goroutine 34 [running]:
testing.tRunner.func1.2({0xca2820, 0xc000124d00})
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1389 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1392 +0x39f
panic({0xca2820, 0xc000124d00})
/home/jenkins/sdk/go1.18.1/src/runtime/panic.go:838 +0x207
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc00010e8e0?, 0xc000156960?}, {0xdc8e9e, 0x2d}, {0xc0000dc6e0?, 0x0?, 0x5?}, {0xc000126560, 0xf}, 0xc00055dc60, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/pkg/beam/xlang.go>:162 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/kafkaio.Write({0xc00010e4a0?, 0xc000156960?}, {0xc000126560, 0xf}, {0xc0001264b0, 0xf}, {0xc000132680, 0x3d}, {0xc00055de60?}, {0x0, ...})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/pkg/beam/io/xlang/kafkaio/kafka.go>:278 +0x4ad
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.writeInts({0xc00010e460?, 0xc000156960?}, {0xc000126560, 0xf}, {0xc0001264b0, 0xf}, {0xc000132680, 0x3d}, {0xc000560000, 0x3e8, ...})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka.go>:48 +0x24b
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.WritePipeline({0xc000126560, 0xf}, {0xc0001264b0, 0xf}, {0xc000132680, 0x3d}, {0xc000560000, 0x3e8, 0x3e8})
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka.go>:70 +0x157
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka.TestKafkaIO_BasicReadWrite(0xc00054a9c0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/integration/io/xlang/kafka/kafka_test.go>:61 +0xed
testing.tRunner(0xc00054a9c0, 0xdfd438)
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
/home/jenkins/sdk/go1.18.1/src/testing/testing.go:1486 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.130s
FAIL
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:3:job-server:sparkJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 195
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 59m 34s
234 actionable tasks: 35 executed, 199 up-to-date
Publishing build scan...
https://gradle.com/s/sbxrknmcl3lw4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org