You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/01/11 19:13:31 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Direct #2171

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2171/display/redirect?page=changes>

Changes:

[mmack] [BEAM-13243][BEAM-8374] Add support for missing PublishResponse fields

[mmack] [adhoc] Run spotlessApply on java examples to fix master

[noreply] [BEAM-13628] Update SideInputCache to use full Transform and


------------------------------------------
[...truncated 107.07 KB...]
  Downloading google_cloud_dlp-3.4.0-py2.py3-none-any.whl (110 kB)
Collecting google-cloud-language==1.3.0
  Downloading google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-profiler==3.0.6
  Downloading google-cloud-profiler-3.0.6.tar.gz (33 kB)
Collecting google-cloud-pubsub==2.9.0
  Downloading google_cloud_pubsub-2.9.0-py2.py3-none-any.whl (219 kB)
Collecting google-cloud-pubsublite==1.2.0
  Downloading google_cloud_pubsublite-1.2.0-py2.py3-none-any.whl (252 kB)
Collecting google-cloud-recommendations-ai==0.2.0
  Downloading google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting google-cloud-spanner==1.19.1
  Downloading google_cloud_spanner-1.19.1-py2.py3-none-any.whl (255 kB)
Collecting google-cloud-videointelligence==1.16.1
  Downloading google_cloud_videointelligence-1.16.1-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision==1.0.0
  Downloading google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB)
Collecting google-crc32c==1.3.0
  Downloading google_crc32c-1.3.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB)
Collecting google-pasta==0.2.0
  Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting google-python-cloud-debugger==2.18
  Downloading google_python_cloud_debugger-2.18-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (769 kB)
Collecting google-resumable-media==2.1.0
  Downloading google_resumable_media-2.1.0-py2.py3-none-any.whl (75 kB)
Collecting googleapis-common-protos==1.54.0
  Downloading googleapis_common_protos-1.54.0-py2.py3-none-any.whl (207 kB)
Collecting greenlet==1.1.2
  Downloading greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB)
Collecting grpc-google-iam-v1==0.12.3
  Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB)
Collecting grpcio==1.43.0
  Downloading grpcio-1.43.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.1 MB)
Collecting grpcio-gcp==0.2.2
  Downloading grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting grpcio-status==1.43.0
  Downloading grpcio_status-1.43.0-py3-none-any.whl (10.0 kB)
Collecting guppy3==3.1.2
  Downloading guppy3-3.1.2-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (606 kB)
Collecting h5py==3.1.0
  Downloading h5py-3.1.0-cp36-cp36m-manylinux1_x86_64.whl (4.0 MB)
Collecting hdfs==2.6.0
  Downloading hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2==0.19.1
  Downloading httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting idna==3.3
  Downloading idna-3.3-py3-none-any.whl (61 kB)
Collecting importlib-metadata==4.8.3
  Downloading importlib_metadata-4.8.3-py3-none-any.whl (17 kB)
Collecting joblib==1.1.0
  Downloading joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting keras==2.6.0
  Downloading keras-2.6.0-py2.py3-none-any.whl (1.3 MB)
Collecting Keras-Preprocessing==1.1.2
  Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
Collecting libcst==0.3.23
  Downloading libcst-0.3.23-py3-none-any.whl (517 kB)
Collecting Markdown==3.3.6
  Downloading Markdown-3.3.6-py3-none-any.whl (97 kB)
Collecting mmh3==3.0.0
  Downloading mmh3-3.0.0-cp36-cp36m-manylinux2010_x86_64.whl (49 kB)
Collecting mock==2.0.0
  Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting more-itertools==8.12.0
  Downloading more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting mypy-extensions==0.4.3
  Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)
Collecting nltk==3.6.7
  Downloading nltk-3.6.7-py3-none-any.whl (1.5 MB)
Collecting nose==1.3.7
  Downloading nose-1.3.7-py3-none-any.whl (154 kB)
Collecting numpy==1.19.5
  Downloading numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB)
Collecting oauth2client==4.1.3
  Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting oauthlib==3.1.1
  Downloading oauthlib-3.1.1-py2.py3-none-any.whl (146 kB)
Collecting opt-einsum==3.3.0
  Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting orjson==3.6.1
  Downloading orjson-3.6.1-cp36-cp36m-manylinux_2_24_x86_64.whl (233 kB)
Collecting overrides==6.1.0
  Downloading overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting packaging==21.3
  Downloading packaging-21.3-py3-none-any.whl (40 kB)
Collecting pandas==1.1.5
  Downloading pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5 MB)

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerSetup

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava
Jan 11, 2022 6:40:29 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12
go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12
System Go installation: /usr/bin/go is go version go1.16.12 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12
go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12
/home/jenkins/go/bin/go1.16.12 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 3 -timeout 2h --runner=portable --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test --dataflow_worker_jar= --endpoint=localhost:45879 --test_expansion_addr=localhost:33303 --io_expansion_addr=localhost:57459 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.37.0-SNAPSHOT.jar>
=== RUN   TestAutomatedExpansionService
--- PASS: TestAutomatedExpansionService (2.51s)
=== RUN   TestXLang_Prefix
--- FAIL: TestXLang_Prefix (0.00s)
panic: 	tried cross-language for beam:transforms:xlang:test:prefix against localhost:33303 and failed
	expanding external transform
	expanding transform with ExpansionRequest: components:{pcollections:{key:"n2"  value:{unique_name:"n2"  coder_id:"c0@nidWJtKbxc"  is_bounded:BOUNDED  windowing_strategy_id:"w0@nidWJtKbxc"}}  windowing_strategies:{key:"w0@nidWJtKbxc"  value:{window_fn:{urn:"beam:window_fn:global_windows:v1"}  merge_status:NON_MERGING  window_coder_id:"c1@nidWJtKbxc"  trigger:{default:{}}  accumulation_mode:DISCARDING  output_time:END_OF_WINDOW  closing_behavior:EMIT_IF_NONEMPTY  OnTimeBehavior:FIRE_IF_NONEMPTY  environment_id:"go"}}  coders:{key:"c0@nidWJtKbxc"  value:{spec:{urn:"beam:coder:string_utf8:v1"}}}  coders:{key:"c1@nidWJtKbxc"  value:{spec:{urn:"beam:coder:global_window:v1"}}}  environments:{key:"go"  value:{}}}  transform:{unique_name:"External"  spec:{urn:"beam:transforms:xlang:test:prefix"  payload:"\n2\n\n\n\x04Data\x1a\x02\x10\x07\x12$1adc2c3d-0e8c-4642-8c37-130fbd2c034f\x12\n\x01\x00\x07prefix_"}  inputs:{key:"i0"  value:"n2"}  environment_id:"go"}  namespace:"nidWJtKbxc"
expansion failed
	caused by:
rpc error: code = Unavailable desc = connection closed [recovered]
	panic: 	tried cross-language for beam:transforms:xlang:test:prefix against localhost:33303 and failed
	expanding external transform
	expanding transform with ExpansionRequest: components:{pcollections:{key:"n2"  value:{unique_name:"n2"  coder_id:"c0@nidWJtKbxc"  is_bounded:BOUNDED  windowing_strategy_id:"w0@nidWJtKbxc"}}  windowing_strategies:{key:"w0@nidWJtKbxc"  value:{window_fn:{urn:"beam:window_fn:global_windows:v1"}  merge_status:NON_MERGING  window_coder_id:"c1@nidWJtKbxc"  trigger:{default:{}}  accumulation_mode:DISCARDING  output_time:END_OF_WINDOW  closing_behavior:EMIT_IF_NONEMPTY  OnTimeBehavior:FIRE_IF_NONEMPTY  environment_id:"go"}}  coders:{key:"c0@nidWJtKbxc"  value:{spec:{urn:"beam:coder:string_utf8:v1"}}}  coders:{key:"c1@nidWJtKbxc"  value:{spec:{urn:"beam:coder:global_window:v1"}}}  environments:{key:"go"  value:{}}}  transform:{unique_name:"External"  spec:{urn:"beam:transforms:xlang:test:prefix"  payload:"\n2\n\n\n\x04Data\x1a\x02\x10\x07\x12$1adc2c3d-0e8c-4642-8c37-130fbd2c034f\x12\n\x01\x00\x07prefix_"}  inputs:{key:"i0"  value:"n2"}  environment_id:"go"}  namespace:"nidWJtKbxc"
expansion failed
	caused by:
rpc error: code = Unavailable desc = connection closed

goroutine 56 [running]:
testing.tRunner.func1.2(0xcc53e0, 0xc0000a0cc0)
	/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1143 +0x332
testing.tRunner.func1(0xc000103080)
	/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1146 +0x4b6
panic(0xcc53e0, 0xc0000a0cc0)
	/home/jenkins/sdk/go1.16.12/src/runtime/panic.go:965 +0x1b9
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage(0xc0001c49e0, 0xc0005484b0, 0xdd4e8c, 0x21, 0xc000130640, 0x40, 0x40, 0x7ffdf969f4be, 0xf, 0xc0001bbc80, ...)
	<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/pkg/beam/xlang.go>:162 +0x1f7
github.com/apache/beam/sdks/v2/go/examples/xlang.Prefix(0xc0001c4920, 0xc0005484b0, 0xdbf17e, 0x7, 0x7ffdf969f4be, 0xf, 0xc0006ecc60, 0x0)
	<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/examples/xlang/transforms.go>:52 +0x3ab
github.com/apache/beam/sdks/v2/go/test/integration/xlang.TestXLang_Prefix(0xc000103080)
	<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/xlang/xlang_test.go>:124 +0x1d4
testing.tRunner(0xc000103080, 0xdf85d0)
	/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1193 +0xef
created by testing.(*T).Run
	/home/jenkins/sdk/go1.16.12/src/testing/testing.go:1238 +0x2b3
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/xlang	2.568s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:181: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	3.033s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combineGloballyTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:257
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > partitionTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:314
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > coGroupByKeyTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:230
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > groupByKeyTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:198
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:275
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:295
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:156
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > multiInputOutputWithSideInputTest FAILED
    org.apache.beam.vendor.grpc.v1p36p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:178
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:123

8 tests completed, 8 failed

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 170

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 51m 29s
200 actionable tasks: 149 executed, 43 from cache, 8 up-to-date

Publishing build scan...
https://gradle.com/s/6okwow3iptt4w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_Direct #2172

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2172/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org