You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/05/05 18:35:56 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2612
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2612/display/redirect?page=changes>
Changes:
[zyichi] Move master readme.md to 2.40.0
[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink
------------------------------------------
[...truncated 1.17 MB...]
component_coder_ids: "nLUaKowcwrIterableCoder"
>
>
coders: <
key: "nLUaKowcwrRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$340911b8-8eac-415a-8b8f-ed297b5fce7a"
>
>
>
coders: <
key: "nLUaKowcwrSerializableCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\312\241\002\360^\254\355\000\005sr\000,org.apache.beam.sdk.coders.SerializableCoder\010\364 \216\305ynl\002\000\001L\000\004typet\000\021Ljava/lang/Class;xr\000&ofV\000\024Custom\005P8j\260\010\235\013;\035\013\002\000\000xr\000 j\213\000\005/\034C\335\325\211\256\274~\370\001/\020pvr\000$N1\000\\io.BoundedSource!`v\023\177\370QA\0015\010r\000\035Z3\000\t,0\020\213\372\020Y\214\347\323\002\000\000xp"
>
>
>
coders: <
key: "nLUaKowcwrTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006]\313\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215d7\242\227\362z%\204e\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000HL>\335\002 vendor/gu\0019Lv26_0_jre/com/google\001\0134mon/collect/Bi\tZ\000\006\005Z\014st\000\020\035u$List;L\000\007op\005\273\010t\000,R\267\001-\000M\004\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\0007\356\336\024sr\000\021\001\342\000.\001\342\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ei\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\360\001b\020xsr\000J>\365\001)f\000.%f\000.5f\020.com.)f\001\013\014mon.-f\000.\001\334%j\001S\001\001(\003\000\000xpw\004\000\000\000\001A\251\000\027\001\005\000\032\001l\000\023\005\222%\021\020Array!\203 x\201\322\035\231\307a\235\003\001\274\024\004sizex\001I\000\001\t@\014sr\0002>\241\000\241A-\226\024.AutoV\241;\000_i\244\004_FAD\034\303\343i\345\363l$\364\205.\004\013dm\233\205*\000\022I\002!\026\030/String!\313\014name\001\246\010 L\000Q\020\001\017\014\022L\000\004a\335\010t\000.\216\034\002\005|a\340a\326\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\226\010t\000\000\001y\004\027sZ\267\005\021\370\rA\000OI\216\034\367\031\n\2336X\271\227\305\".\301\000\014\017xps\001P\004\025?IS\004\000wQS%\374\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001u(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\353\010t\000\023=\3604Boolean;L\000\trow)C\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\272Lions$EmptyMapY6\024\205Z\334\347\265\247\211WA\302\000.\r\3224\315 r\200\325\234\372\356\002\000\001Z\000\005\211\000\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\345\375\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\241\036x\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\223o\005\322\351\016ga@2\221wJ>I+\005e\014\014sr\000Ro\001\005\364\004s.\001\313\371\212(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000\034x\237G[\330\210\240{eR \005tokent\000LB\032\002\251,\212\222\006\010ref\305\222\001\241\000T\001N\000;\345r\000Z>\221\000\tQ\212}\005\rQ\005\362\005Q\024$Simple\026\005\020!\255\001\001\t\372\346\346\005Bi\000\0342{#\261\276\3768|%\033\030\013runtim\005w\010t\000\030}m\r8\005\362\030;xpvr\000\036>\355\000\241\311-~(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "nLUaKowcwrVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\330\001\350\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xrr5\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*jj\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "nLUaKowcwrVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*j5\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "nLUaKowcwrbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.40.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.40.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar\022@79bbed34591f15783869a605b839f02a9c034a3cec699aa5aafe622b13d3afe5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar\022@50b15308fb1be9c2d86747f5046d4541f73398735a642c7ca655ee4432a906a1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar\022@7541eac86c5a4d50a37d323c31c90f61aad9dff9b07fadae764c5a1e2d5a2a7b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar\022@5dd5277501aba1738ff4d0ac7c84e904445871b6c65d51cb8dbbcd5970a1fb70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar\022@62acee297d509cb08ea347308ca45d0611ab8a9fe5b4825983e00f4fad2d50f0"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar\022@761129d7ceae74417a5fa72166eb3e449cd6466ce571cc71d7f6ed95759ac952"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-LInsa8NrYN8sB-lpISsvm_N6W6ZjZbD40JcprN2Pplo.jar\022@2c89ec6bc36b60df2c07e969212b2f9bf37a5ba66365b0f8d09729acdd8fa65a"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-LInsa8NrYN8sB-lpISsvm_N6W6ZjZbD40JcprN2Pplo.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:31:45 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> as /tmp/worker-4-1651771905142857174
2022/05/05 17:31:59 Prepared job with id: go-testjdbcio_postgresreadwrite-d8507305-2ec0-49fd-9b96-d3924c06c580 and staging token: go-testjdbcio_postgresreadwrite-d8507305-2ec0-49fd-9b96-d3924c06c580
2022/05/05 17:32:00 Staged binary artifact with token:
2022/05/05 17:32:00 Submitted job: go-testjdbcio_postgresreadwrite-d8507305-2ec0-49fd-9b96-d3924c06c580
2022/05/05 17:32:00 2022-05-05 17:32:00. (1): Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
2022/05/05 17:32:00 2022-05-05 17:32:00. (2): Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
2022/05/05 17:32:00 Job state: STOPPED
2022/05/05 17:32:00 Job state: STARTING
2022/05/05 17:32:00 Job state: RUNNING
2022/05/05 17:32:00 2022-05-05 17:32:00. (3): ==================== <function annotate_downstream_side_inputs at 0x7f4295d16ef0> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (4): ==================== <function fix_side_input_pcoll_coders at 0x7f4295d18050> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (5): ==================== <function pack_combiners at 0x7f4295d18560> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (6): ==================== <function lift_combiners at 0x7f4295d185f0> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (7): ==================== <function expand_sdf at 0x7f4295d187a0> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (8): ==================== <function expand_gbk at 0x7f4295d18830> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (9): ==================== <function sink_flattens at 0x7f4295d18950> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (10): ==================== <function greedily_fuse at 0x7f4295d189e0> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (11): ==================== <function read_to_impulse at 0x7f4295d18a70> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (12): ==================== <function impulse_to_input at 0x7f4295d18b00> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (13): ==================== <function sort_stages at 0x7f4295d18d40> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (14): ==================== <function add_impulse_to_dangling_transforms at 0x7f4295d18e60> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (15): ==================== <function setup_timer_mapping at 0x7f4295d18cb0> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (16): ==================== <function populate_data_channel_coders at 0x7f4295d18dd0> ====================
2022/05/05 17:32:00 2022-05-05 17:32:00. (17): starting control server on port 34901
2022/05/05 17:32:00 2022-05-05 17:32:00. (18): starting data server on port 39581
2022/05/05 17:32:00 2022-05-05 17:32:00. (19): starting state server on port 34677
2022/05/05 17:32:00 2022-05-05 17:32:00. (20): starting logging server on port 35179
2022/05/05 17:32:00 2022-05-05 17:32:00. (21): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f42943453d0> for environment nLUaKowcwrbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.40.0.dev')
2022/05/05 17:32:00 2022-05-05 17:32:00. (22): Attempting to pull image apache/beam_java8_sdk:2.40.0.dev
2022/05/05 17:32:02 2022-05-05 17:32:01. (23): Unable to pull image apache/beam_java8_sdk:2.40.0.dev, defaulting to local image if it exists
2022/05/05 17:32:15 2022-05-05 17:32:15. (24): Waiting for docker to start up. Current status is running
2022/05/05 17:32:15 2022-05-05 17:32:15. (25): Docker container is running. container_id = b'c60e3503623c8df1e3aacbcc76a845fd15d56cf80fd7d43614b7932876094707', worker_id = worker_12
2022/05/05 17:32:16 2022-05-05 17:32:16. (26): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4294405ed0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2022/05/05 17:32:24 2022-05-05 17:32:24. (27): Attempting to pull image apache/beam_go_sdk:dev
2022/05/05 17:32:25 2022-05-05 17:32:25. (28): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/05/05 17:32:39 2022-05-05 17:32:39. (29): Waiting for docker to start up. Current status is running
2022/05/05 17:32:39 2022-05-05 17:32:39. (30): Docker container is running. container_id = b'eede3a135ec38ff493b280fa421da4cc7e2f3af233aecc6b9515ae8ee8d8dcc0', worker_id = worker_14
2022/05/05 17:32:50 2022-05-05 17:32:50. (31): Completed job in 50.15241503715515 seconds with state DONE.
2022/05/05 17:32:50 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (133.02s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 268.804s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:203: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.175s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 195
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 25m 20s
233 actionable tasks: 165 executed, 57 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/hc3odgp7c3tli
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #2614
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2614/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #2613
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2613/display/redirect?page=changes>
Changes:
[noreply] Upgrade python sdk container requirements. (#17549)
[noreply] Merge pull request #17497: [BEAM-11205] Update GCP Libraries BOM version
[noreply] [BEAM-12603] Add retry on grpc data channel and remove retry from test.
[noreply] Merge pull request #17359: [BEAM-14303] Add a way to exclude output
[noreply] [BEAM-14347] Allow users to optimize DoFn execution with a single
------------------------------------------
[...truncated 835.15 KB...]
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.40.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar\022@79bbed34591f15783869a605b839f02a9c034a3cec699aa5aafe622b13d3afe5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar\022@50b15308fb1be9c2d86747f5046d4541f73398735a642c7ca655ee4432a906a1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar\022@7541eac86c5a4d50a37d323c31c90f61aad9dff9b07fadae764c5a1e2d5a2a7b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar\022@5dd5277501aba1738ff4d0ac7c84e904445871b6c65d51cb8dbbcd5970a1fb70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar\022@62acee297d509cb08ea347308ca45d0611ab8a9fe5b4825983e00f4fad2d50f0"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar\022@761129d7ceae74417a5fa72166eb3e449cd6466ce571cc71d7f6ed95759ac952"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-vwIHeZRkOJawztXgeRROEw35sa58kQWpQ3K_5xePhoM.jar\022@bf02077994643896b0ced5e079144e130df9b1ae7c9105a94372bfe7178f8683"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.40.0-SNAPSHOT-vwIHeZRkOJawztXgeRROEw35sa58kQWpQ3K_5xePhoM.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 23:23:33 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> as /tmp/worker-4-1651793013265033223
2022/05/05 23:23:35 Prepared job with id: go-testjdbcio_postgresreadwrite-51e7b377-1fbd-4355-8fd1-b7fdb0edb1e9 and staging token: go-testjdbcio_postgresreadwrite-51e7b377-1fbd-4355-8fd1-b7fdb0edb1e9
2022/05/05 23:23:35 Staged binary artifact with token:
2022/05/05 23:23:35 Submitted job: go-testjdbcio_postgresreadwrite-51e7b377-1fbd-4355-8fd1-b7fdb0edb1e9
2022/05/05 23:23:35 2022-05-05 23:23:35. (1): Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
2022/05/05 23:23:35 2022-05-05 23:23:35. (8): ==================== <function expand_gbk at 0x7f56dbd99830> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (9): ==================== <function sink_flattens at 0x7f56dbd99950> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (10): ==================== <function greedily_fuse at 0x7f56dbd999e0> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (11): ==================== <function read_to_impulse at 0x7f56dbd99a70> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (12): ==================== <function impulse_to_input at 0x7f56dbd99b00> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (13): ==================== <function sort_stages at 0x7f56dbd99d40> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (14): ==================== <function add_impulse_to_dangling_transforms at 0x7f56dbd99e60> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (15): ==================== <function setup_timer_mapping at 0x7f56dbd99cb0> ====================
2022/05/05 23:23:35 2022-05-05 23:23:35. (16): ==================== <function populate_data_channel_coders at 0x7f56dbd99dd0> ====================
2022/05/05 23:23:35 Job state: STOPPED
2022/05/05 23:23:35 Job state: STARTING
2022/05/05 23:23:35 Job state: RUNNING
2022/05/05 23:23:35 2022-05-05 23:23:35. (17): starting control server on port 44329
2022/05/05 23:23:35 2022-05-05 23:23:35. (18): starting data server on port 38589
2022/05/05 23:23:35 2022-05-05 23:23:35. (19): starting state server on port 33443
2022/05/05 23:23:35 2022-05-05 23:23:35. (20): starting logging server on port 44973
2022/05/05 23:23:35 2022-05-05 23:23:35. (21): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f56b07c4210> for environment IamUNdfCiFbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.40.0.dev')
2022/05/05 23:23:35 2022-05-05 23:23:35. (22): Attempting to pull image apache/beam_java8_sdk:2.40.0.dev
2022/05/05 23:23:36 2022-05-05 23:23:36. (23): Unable to pull image apache/beam_java8_sdk:2.40.0.dev, defaulting to local image if it exists
2022/05/05 23:23:37 2022-05-05 23:23:37. (24): Waiting for docker to start up. Current status is running
2022/05/05 23:23:37 2022-05-05 23:23:37. (25): Docker container is running. container_id = b'764d2e6a1d1dfdc4007504a24cd52452077aa264964ce202da654e27473f6a8e', worker_id = worker_16
2022/05/05 23:23:38 2022-05-05 23:23:38. (26): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f56d9c20750> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2022/05/05 23:23:38 2022-05-05 23:23:38. (27): Attempting to pull image apache/beam_go_sdk:dev
2022/05/05 23:23:39 2022-05-05 23:23:39. (28): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2022/05/05 23:23:39 2022-05-05 23:23:39. (29): Waiting for docker to start up. Current status is running
2022/05/05 23:23:39 2022-05-05 23:23:39. (30): Docker container is running. container_id = b'020f3324bbb119ee601369b4304db7cbe310536b9617a09c80186d96a27ab5f4', worker_id = worker_17
2022/05/05 23:23:43 2022-05-05 23:23:43. (31): Completed job in 7.763378858566284 seconds with state DONE.
2022/05/05 23:23:43 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (34.06s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 86.278s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:203: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.038s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:45349 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5537 items / 5527 deselected / 1 skipped / 9 selected
apache_beam/io/external/generate_sequence_test.py ... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
===== 10 passed, 1 skipped, 5527 deselected, 2 warnings in 140.35 seconds ======
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:45349 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5537 items / 5527 deselected / 1 skipped / 9 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 3 skipped, 5527 deselected in 337.51 seconds ============
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:45349 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5537 items / 5528 deselected / 1 skipped / 8 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 9 passed, 1 skipped, 5528 deselected in 227.80 seconds ============
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 28837.
Stopping expansion service pid: 28838.
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4189306
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 195
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 42m 52s
233 actionable tasks: 198 executed, 26 from cache, 9 up-to-date
Publishing build scan...
https://gradle.com/s/xzymty374wvyc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org