You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/04/30 00:58:45 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Direct #1173

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1173/display/redirect?page=changes>

Changes:

[heejong] bugfix for cut_release_branch.sh

[Kenneth Knowles] Update website for 2.29.0 release

[Kenneth Knowles] [BEAM-12222] Update Dataflow container for side input changes

[Kenneth Knowles] Increase timeout of Dataflow V1 streaming ValidatesRunner

[noreply] [BEAM-12158] Regen go protos & rename internal proto package (#14612)

[noreply] Update golock instructions (#14678)


------------------------------------------
[...truncated 2.27 MB...]
INFO:root:==================== <function pack_combiners at 0x7f3ecf20d6a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f3ecf20d7b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f3ecf20d950> ====================
INFO:root:==================== <function expand_gbk at 0x7f3ecf20d9d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f3ecf20dae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f3ecf20db70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f3ecf20dbf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f3ecf20dc80> ====================
INFO:root:==================== <function sort_stages at 0x7f3ecf20dea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f3ecf20de18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f3ecf20df28> ====================
INFO:root:starting control server on port 46339
INFO:root:starting data server on port 37625
INFO:root:starting state server on port 46545
INFO:root:starting logging server on port 38473
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3ecec40fd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'002143f685b4d9aa23ff0e7d89922a1eafa042216b4ec800da940e39432fce4d', worker_id = worker_46
INFO:root:Running ((((ref_AppliedPTransform_Create-enrich-Impulse_3)+(ref_AppliedPTransform_Create-enrich-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_11))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-enrich-Map-decode-_13))+(ref_PCollection_PCollection_2/Write)
INFO:root:Running ((((ref_AppliedPTransform_Create-simple-Impulse_15)+(ref_AppliedPTransform_Create-simple-FlatMap-lambda-at-core-py-2930-_16))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-AddRandomKeys_19))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_21))+(Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_23))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-RemoveRandomKeys_24))+(ref_AppliedPTransform_Create-simple-Map-decode-_25))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3ecec76f98> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'5dd6e5991e100156797ff86b1d8b22373185ecc2c4c6508bf7682cdf2e99805a', worker_id = worker_47
INFO:root:Running (((((ref_PCollection_PCollection_2/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-left_TimestampCombiner-Flatten-PCollecti))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/0))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/0)
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-right_TimestampCombiner-Flatten-PCollect))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext2))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG2))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/1))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/1)
INFO:root:Running (SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write)
INFO:root:Running (((((SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG6))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-Par))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Select-Fields-ParDo-Select--ParMultiDo-S))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCalcRel_96-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_17/Write)
INFO:root:Running (((((ref_PCollection_PCollection_17/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_33))+(ref_AppliedPTransform_assert_that-ToVoidKey_34))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_37))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_29)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_30))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_32))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_36))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_40))+(ref_AppliedPTransform_assert_that-Unkey_41))+(ref_AppliedPTransform_assert_that-Match_42)
INFO:root:Successfully completed job in 9.89508056640625 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '57793']
DEBUG:root:Waiting for grpc channel to be ready at localhost:57793.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:57793'
DEBUG:root:Waiting for grpc channel to be ready at localhost:57793.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:28 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:57793.
DEBUG:root:Waiting for grpc channel to be ready at localhost:57793.
DEBUG:root:Waiting for grpc channel to be ready at localhost:57793.
DEBUG:root:Waiting for grpc channel to be ready at localhost:57793.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:29 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:30 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:32 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQL:'
INFO:apache_beam.utils.subprocess_server:b'SELECT COUNT(*) AS `count`'
INFO:apache_beam.utils.subprocess_server:b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:32 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQLPlan>'
INFO:apache_beam.utils.subprocess_server:b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  LogicalProject($f0=[0])'
INFO:apache_beam.utils.subprocess_server:b'    BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:32 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f95dd9651e0> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f95dd9658c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f3ecf20d158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f3ecf20d268> ====================
INFO:root:==================== <function pack_combiners at 0x7f3ecf20d6a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f3ecf20d7b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f3ecf20d950> ====================
INFO:root:==================== <function expand_gbk at 0x7f3ecf20d9d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f3ecf20dae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f3ecf20db70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f3ecf20dbf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f3ecf20dc80> ====================
INFO:root:==================== <function sort_stages at 0x7f3ecf20dea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f3ecf20de18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f3ecf20df28> ====================
INFO:root:starting control server on port 35823
INFO:root:starting data server on port 37267
INFO:root:starting state server on port 36723
INFO:root:starting logging server on port 41943
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3ecebcaac8> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'389e846f7a3f4eab837528decfbeb636d493e4121df8db762eeb18798ab6e449', worker_id = worker_48
INFO:root:Running ((((ref_AppliedPTransform_Create-Impulse_3)+(ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-Map-decode-_13))+(ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14))+(ref_AppliedPTransform_WindowInto-WindowIntoFn-_15))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3ecec40710> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'f9bd65338dccf137bbe8e54c8f7a16d76bcf1f0ffb1afb13f2280531693d13e0', worker_id = worker_49
INFO:root:Running ((ref_PCollection_PCollection_1/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele))+(SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Write)
INFO:root:Running ((((SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-))+(ref_PCollection_PCollection_11/Write)
INFO:root:Running (((((ref_PCollection_PCollection_11/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23))+(ref_AppliedPTransform_assert_that-ToVoidKey_24))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_27))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_19)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_22))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_26))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30))+(ref_AppliedPTransform_assert_that-Unkey_31))+(ref_AppliedPTransform_assert_that-Match_32)
INFO:root:Successfully completed job in 9.774919986724854 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_zetasql_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '48573']
DEBUG:root:Waiting for grpc channel to be ready at localhost:48573.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:48573'
DEBUG:root:Waiting for grpc channel to be ready at localhost:48573.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:46 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:48573.
DEBUG:root:Waiting for grpc channel to be ready at localhost:48573.
DEBUG:root:Waiting for grpc channel to be ready at localhost:48573.
DEBUG:root:Waiting for grpc channel to be ready at localhost:48573.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:47 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:48 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:47:51 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])"
INFO:apache_beam.utils.subprocess_server:b'  BeamValuesRel(tuples=[[{ 0 }]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f95dd9651e0> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f95dd9658c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f3ecf20d158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f3ecf20d268> ====================
INFO:root:==================== <function pack_combiners at 0x7f3ecf20d6a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f3ecf20d7b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f3ecf20d950> ====================
INFO:root:==================== <function expand_gbk at 0x7f3ecf20d9d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f3ecf20dae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f3ecf20db70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f3ecf20dbf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f3ecf20dc80> ====================
INFO:root:==================== <function sort_stages at 0x7f3ecf20dea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f3ecf20de18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f3ecf20df28> ====================
INFO:root:starting control server on port 42813
INFO:root:starting data server on port 44639
INFO:root:starting state server on port 40215
INFO:root:starting logging server on port 36439
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3ecec409e8> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'94fefde4f6306994f63e9e1c52b00288c644af1e05bbc9562179e5054f9b2c91', worker_id = worker_50
INFO:root:Running ((((external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse)+(external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
INFO:root:Running (((external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3ececcdeb8> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'3e0f5e800687b16c12db3a910e243d3b89830d0368b8dd8c911da4d0d44b51f5', worker_id = worker_51
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9))+(ref_AppliedPTransform_assert_that-ToVoidKey_10))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_13))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_5)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_8))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_12))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16))+(ref_AppliedPTransform_assert_that-Unkey_17))+(ref_AppliedPTransform_assert_that-Match_18)
INFO:root:Successfully completed job in 11.318580150604248 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok

----------------------------------------------------------------------
XML: nosetests-xlangSqlValidateRunner.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 170.058s

OK

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4556.
Stopping expansion service pid: 4559.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 32321

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 24m 38s
158 actionable tasks: 35 executed, 123 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/36npj4c43e35m

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_XVR_Direct #1177

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1177/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_XVR_Direct #1176

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1176/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-12257] Infer accumulator coder from underlying AggregateFn in

[randomstep] [BEAM-12252] Bump kotlin version to 1.4.32 and improve Kotlin code

[noreply] [BEAM-12165] Add support for ParquetIO Sink to specify an Avro model

[noreply] [BEAM-12018] Initial implementation for melt (#14689)


------------------------------------------
[...truncated 1.79 MB...]
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1227bbe358> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'56e7b6334e3f5ef42cbd680500bf49e6248c1d2e39dd5524f68e1259f20eac6c', worker_id = worker_42
INFO:root:Running ((((ref_AppliedPTransform_Create-simple-Impulse_15)+(ref_AppliedPTransform_Create-simple-FlatMap-lambda-at-core-py-2930-_16))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-AddRandomKeys_19))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_21))+(Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_23))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-RemoveRandomKeys_24))+(ref_AppliedPTransform_Create-simple-Map-decode-_25))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1227bbe8d0> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'bd93d9f8fda8c0bd1a635e56f27d2fe19a2f8069b71ffe3e771734cee46d29be', worker_id = worker_43
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-right_TimestampCombiner-Flatten-PCollect))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext2))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG2))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/1))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/1)
INFO:root:Running ((((ref_AppliedPTransform_Create-enrich-Impulse_3)+(ref_AppliedPTransform_Create-enrich-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_11))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-enrich-Map-decode-_13))+(ref_PCollection_PCollection_2/Write)
INFO:root:Running (((((ref_PCollection_PCollection_2/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-left_TimestampCombiner-Flatten-PCollecti))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/0))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/0)
INFO:root:Running (SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write)
INFO:root:Running (((((SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG6))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-Par))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Select-Fields-ParDo-Select--ParMultiDo-S))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCalcRel_96-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_17/Write)
INFO:root:Running (((((ref_PCollection_PCollection_17/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_33))+(ref_AppliedPTransform_assert_that-ToVoidKey_34))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_37))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_29)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_30))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_32))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_36))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_40))+(ref_AppliedPTransform_assert_that-Unkey_41))+(ref_AppliedPTransform_assert_that-Match_42)
INFO:root:Successfully completed job in 10.021724224090576 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '58283']
DEBUG:root:Waiting for grpc channel to be ready at localhost:58283.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:58283'
DEBUG:root:Waiting for grpc channel to be ready at localhost:58283.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:21 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:58283.
DEBUG:root:Waiting for grpc channel to be ready at localhost:58283.
DEBUG:root:Waiting for grpc channel to be ready at localhost:58283.
DEBUG:root:Waiting for grpc channel to be ready at localhost:58283.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:22 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:23 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQL:'
INFO:apache_beam.utils.subprocess_server:b'SELECT COUNT(*) AS `count`'
INFO:apache_beam.utils.subprocess_server:b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:25 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQLPlan>'
INFO:apache_beam.utils.subprocess_server:b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  LogicalProject($f0=[0])'
INFO:apache_beam.utils.subprocess_server:b'    BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:25 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fc62a099488> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fc62a099b70> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f12281fb158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f12281fb268> ====================
INFO:root:==================== <function pack_combiners at 0x7f12281fb6a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f12281fb7b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f12281fb950> ====================
INFO:root:==================== <function expand_gbk at 0x7f12281fb9d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f12281fbae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f12281fbb70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f12281fbbf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f12281fbc80> ====================
INFO:root:==================== <function sort_stages at 0x7f12281fbea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f12281fbe18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f12281fbf28> ====================
INFO:root:starting control server on port 38073
INFO:root:starting data server on port 33953
INFO:root:starting state server on port 46837
INFO:root:starting logging server on port 39109
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1227c4a1d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'f77a8f54b9bfc8b21c88f959d5dc175014016fc6ad56f2bf5642034220dbff7b', worker_id = worker_44
INFO:root:Running ((((ref_AppliedPTransform_Create-Impulse_3)+(ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-Map-decode-_13))+(ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14))+(ref_AppliedPTransform_WindowInto-WindowIntoFn-_15))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1227bdea90> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'7660ab4728d3ea3c371beec61302acbf8b715e6abfb647f6d28d36594dfeff01', worker_id = worker_45
INFO:root:Running ((ref_PCollection_PCollection_1/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele))+(SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Write)
INFO:root:Running ((((SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-))+(ref_PCollection_PCollection_11/Write)
INFO:root:Running (((((ref_PCollection_PCollection_11/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23))+(ref_AppliedPTransform_assert_that-ToVoidKey_24))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_27))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_19)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_22))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_26))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30))+(ref_AppliedPTransform_assert_that-Unkey_31))+(ref_AppliedPTransform_assert_that-Match_32)
INFO:root:Successfully completed job in 9.852922677993774 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_zetasql_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '39117']
DEBUG:root:Waiting for grpc channel to be ready at localhost:39117.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:39117'
DEBUG:root:Waiting for grpc channel to be ready at localhost:39117.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:39 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:39117.
DEBUG:root:Waiting for grpc channel to be ready at localhost:39117.
DEBUG:root:Waiting for grpc channel to be ready at localhost:39117.
DEBUG:root:Waiting for grpc channel to be ready at localhost:39117.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:40 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:40:44 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])"
INFO:apache_beam.utils.subprocess_server:b'  BeamValuesRel(tuples=[[{ 0 }]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fc62a099488> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fc62a099b70> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f12281fb158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f12281fb268> ====================
INFO:root:==================== <function pack_combiners at 0x7f12281fb6a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f12281fb7b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f12281fb950> ====================
INFO:root:==================== <function expand_gbk at 0x7f12281fb9d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f12281fbae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f12281fbb70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f12281fbbf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f12281fbc80> ====================
INFO:root:==================== <function sort_stages at 0x7f12281fbea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f12281fbe18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f12281fbf28> ====================
INFO:root:starting control server on port 43331
INFO:root:starting data server on port 36305
INFO:root:starting state server on port 46669
INFO:root:starting logging server on port 40453
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1227bc67b8> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'b16feeb8070a9406b727f403168628e4cf3c3c3f9e85cf54d64b6520e519509c', worker_id = worker_46
INFO:root:Running ((((external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse)+(external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
INFO:root:Running (((external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1227bc6860> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'232d94de2bd3f4db52b1b2a3af0fa8a77cbe98ed0e0ae2de12c7848995f3cc6c', worker_id = worker_47
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_5)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_8))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_12))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9))+(ref_AppliedPTransform_assert_that-ToVoidKey_10))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_13))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16))+(ref_AppliedPTransform_assert_that-Unkey_17))+(ref_AppliedPTransform_assert_that-Match_18)
INFO:root:Successfully completed job in 11.40711236000061 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok

----------------------------------------------------------------------
XML: nosetests-xlangSqlValidateRunner.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 175.417s

OK

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava FROM-CACHE

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 16648.
Stopping expansion service pid: 16651.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 11938

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 14s
158 actionable tasks: 33 executed, 2 from cache, 123 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/eec34upzui5tq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_XVR_Direct #1175

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1175/display/redirect?page=changes>

Changes:

[noreply] [BEAM-12223] Fix javadoc bug in JdbcIO (#14642)


------------------------------------------
[...truncated 1.16 MB...]
INFO:root:==================== <function expand_gbk at 0x7f9578d369d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f9578d36ae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f9578d36b70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f9578d36bf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f9578d36c80> ====================
INFO:root:==================== <function sort_stages at 0x7f9578d36ea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f9578d36e18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f9578d36f28> ====================
INFO:root:starting control server on port 39553
INFO:root:starting data server on port 41345
INFO:root:starting state server on port 42657
INFO:root:starting logging server on port 34051
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9577f662b0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'8776fe6b0dcd7d9468afe7c55fe63897b52717b0bae6df50cfa8d96a6d028472', worker_id = worker_46
INFO:root:Running ((((ref_AppliedPTransform_Create-simple-Impulse_15)+(ref_AppliedPTransform_Create-simple-FlatMap-lambda-at-core-py-2930-_16))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-AddRandomKeys_19))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_21))+(Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_23))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-RemoveRandomKeys_24))+(ref_AppliedPTransform_Create-simple-Map-decode-_25))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9577f5a630> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'a75a08a7d16de8ae3f06f47c47779f38d4cc9bef52dee4ef853e781b0509cb88', worker_id = worker_47
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-right_TimestampCombiner-Flatten-PCollect))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext2))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG2))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/1))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/1)
INFO:root:Running ((((ref_AppliedPTransform_Create-enrich-Impulse_3)+(ref_AppliedPTransform_Create-enrich-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_11))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-enrich-Map-decode-_13))+(ref_PCollection_PCollection_2/Write)
INFO:root:Running (((((ref_PCollection_PCollection_2/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-left_TimestampCombiner-Flatten-PCollecti))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/0))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/0)
INFO:root:Running (SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write)
INFO:root:Running (((((SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG6))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-Par))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Select-Fields-ParDo-Select--ParMultiDo-S))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCalcRel_96-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_17/Write)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_29)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_30))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_32))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_36))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (((((ref_PCollection_PCollection_17/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_33))+(ref_AppliedPTransform_assert_that-ToVoidKey_34))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_37))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_40))+(ref_AppliedPTransform_assert_that-Unkey_41))+(ref_AppliedPTransform_assert_that-Match_42)
INFO:root:Successfully completed job in 10.658600091934204 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '35959']
DEBUG:root:Waiting for grpc channel to be ready at localhost:35959.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:35959'
DEBUG:root:Waiting for grpc channel to be ready at localhost:35959.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:17 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:35959.
DEBUG:root:Waiting for grpc channel to be ready at localhost:35959.
DEBUG:root:Waiting for grpc channel to be ready at localhost:35959.
DEBUG:root:Waiting for grpc channel to be ready at localhost:35959.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:18 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:19 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQL:'
INFO:apache_beam.utils.subprocess_server:b'SELECT COUNT(*) AS `count`'
INFO:apache_beam.utils.subprocess_server:b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQLPlan>'
INFO:apache_beam.utils.subprocess_server:b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  LogicalProject($f0=[0])'
INFO:apache_beam.utils.subprocess_server:b'    BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f56632ec1e0> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f56632ec8c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f9578d36158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f9578d36268> ====================
INFO:root:==================== <function pack_combiners at 0x7f9578d366a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f9578d367b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f9578d36950> ====================
INFO:root:==================== <function expand_gbk at 0x7f9578d369d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f9578d36ae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f9578d36b70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f9578d36bf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f9578d36c80> ====================
INFO:root:==================== <function sort_stages at 0x7f9578d36ea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f9578d36e18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f9578d36f28> ====================
INFO:root:starting control server on port 42481
INFO:root:starting data server on port 41055
INFO:root:starting state server on port 44579
INFO:root:starting logging server on port 40589
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9577f4acc0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'843ba7f0ce7dbec84ae130e020f2fba9baba5f45ae341c90a84ded72f6d1c836', worker_id = worker_48
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_19)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_22))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_26))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running ((((ref_AppliedPTransform_Create-Impulse_3)+(ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-Map-decode-_13))+(ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14))+(ref_AppliedPTransform_WindowInto-WindowIntoFn-_15))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9577ecf2e8> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'5f5bbfcf967f0b260aebcc7c3aa82c6a3f854c9081ee3211f979c277aeb5ff51', worker_id = worker_49
INFO:root:Running ((ref_PCollection_PCollection_1/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele))+(SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Write)
INFO:root:Running ((((SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-))+(ref_PCollection_PCollection_11/Write)
INFO:root:Running (((((ref_PCollection_PCollection_11/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23))+(ref_AppliedPTransform_assert_that-ToVoidKey_24))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_27))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30))+(ref_AppliedPTransform_assert_that-Unkey_31))+(ref_AppliedPTransform_assert_that-Match_32)
INFO:root:Successfully completed job in 17.46485137939453 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_zetasql_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '41697']
DEBUG:root:Waiting for grpc channel to be ready at localhost:41697.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:41697'
DEBUG:root:Waiting for grpc channel to be ready at localhost:41697.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:41697.
DEBUG:root:Waiting for grpc channel to be ready at localhost:41697.
DEBUG:root:Waiting for grpc channel to be ready at localhost:41697.
DEBUG:root:Waiting for grpc channel to be ready at localhost:41697.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:44 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:45 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 12:36:49 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])"
INFO:apache_beam.utils.subprocess_server:b'  BeamValuesRel(tuples=[[{ 0 }]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f56632ec1e0> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f56632ec8c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f9578d36158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f9578d36268> ====================
INFO:root:==================== <function pack_combiners at 0x7f9578d366a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f9578d367b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f9578d36950> ====================
INFO:root:==================== <function expand_gbk at 0x7f9578d369d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f9578d36ae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f9578d36b70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f9578d36bf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f9578d36c80> ====================
INFO:root:==================== <function sort_stages at 0x7f9578d36ea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f9578d36e18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f9578d36f28> ====================
INFO:root:starting control server on port 44757
INFO:root:starting data server on port 37491
INFO:root:starting state server on port 36163
INFO:root:starting logging server on port 43035
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9577f81a58> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'5d8d5f189c1ae7259609165c3f06c30415e158d500c9782eadc916ba1a63e152', worker_id = worker_50
INFO:root:Running ((((external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse)+(external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
INFO:root:Running (((external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9577f22780> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'58223a27db49913f169ec0c2b27146dee39a10272018f52d1ed6f19cb6baac48', worker_id = worker_51
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9))+(ref_AppliedPTransform_assert_that-ToVoidKey_10))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_13))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_5)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_8))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_12))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16))+(ref_AppliedPTransform_assert_that-Unkey_17))+(ref_AppliedPTransform_assert_that-Match_18)
INFO:root:Successfully completed job in 11.739778757095337 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok

----------------------------------------------------------------------
XML: nosetests-xlangSqlValidateRunner.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 185.342s

OK

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython FROM-CACHE
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava FROM-CACHE

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 29843.
Stopping expansion service pid: 29846.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 13685

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 49s
158 actionable tasks: 33 executed, 2 from cache, 123 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/ougfskf3nt5p2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_XVR_Direct #1174

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1174/display/redirect?page=changes>

Changes:

[heejong] adding 2.31.0 section to CHANGES.md

[daniel.o.programmer] [BEAM-12147][BEAM-9919] Add Go SDK x-lang prefix transform


------------------------------------------
[...truncated 1.72 MB...]
INFO:root:==================== <function expand_sdf at 0x7f1f602d0950> ====================
INFO:root:==================== <function expand_gbk at 0x7f1f602d09d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f1f602d0ae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f1f602d0b70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f1f602d0bf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f1f602d0c80> ====================
INFO:root:==================== <function sort_stages at 0x7f1f602d0ea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f1f602d0e18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f1f602d0f28> ====================
INFO:root:starting control server on port 37605
INFO:root:starting data server on port 40331
INFO:root:starting state server on port 39225
INFO:root:starting logging server on port 39423
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1f5fd0bd30> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'ac135727c17214f0def149c72acf0cfd6d7880594ad9fcfa5072a22c2da293f6', worker_id = worker_46
INFO:root:Running ((((ref_AppliedPTransform_Create-enrich-Impulse_3)+(ref_AppliedPTransform_Create-enrich-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create enrich/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_11))+(ref_AppliedPTransform_Create-enrich-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-enrich-Map-decode-_13))+(ref_PCollection_PCollection_2/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1f0c2d10f0> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'e3f993a823579d4fb5f76f54786222bf04def2585bbc6b908602c188b0a769fa', worker_id = worker_47
INFO:root:Running (((((ref_PCollection_PCollection_2/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-left_TimestampCombiner-Flatten-PCollecti))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/0))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/0)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_29)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_30))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_32))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_36))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running ((((ref_AppliedPTransform_Create-simple-Impulse_15)+(ref_AppliedPTransform_Create-simple-FlatMap-lambda-at-core-py-2930-_16))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-AddRandomKeys_19))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_21))+(Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((Create simple/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timesta_23))+(ref_AppliedPTransform_Create-simple-MaybeReshuffle-Reshuffle-RemoveRandomKeys_24))+(ref_AppliedPTransform_Create-simple-Map-decode-_25))+(ref_PCollection_PCollection_1/Write)
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-right_TimestampCombiner-Flatten-PCollect))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-ext2))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG2))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Transcode/1))+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Write/1)
INFO:root:Running (SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/Flatten/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write)
INFO:root:Running (((((SqlTransform(beam:external:java:sql:v1)/BeamCoGBKJoinRel_95/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read)+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-CoG6))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Join-Impl-CoGroup-ExpandCrossProduct-Par))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCoGBKJoinRel_95-Select-Fields-ParDo-Select--ParMultiDo-S))+(external_7SqlTransform-beam-external-java-sql-v1--BeamCalcRel_96-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_17/Write)
INFO:root:Running (((((ref_PCollection_PCollection_17/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_33))+(ref_AppliedPTransform_assert_that-ToVoidKey_34))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_37))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_40))+(ref_AppliedPTransform_assert_that-Unkey_41))+(ref_AppliedPTransform_assert_that-Match_42)
INFO:root:Successfully completed job in 9.802540302276611 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_windowing_before_sql (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '58153']
DEBUG:root:Waiting for grpc channel to be ready at localhost:58153.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:58153'
DEBUG:root:Waiting for grpc channel to be ready at localhost:58153.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:30 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:58153.
DEBUG:root:Waiting for grpc channel to be ready at localhost:58153.
DEBUG:root:Waiting for grpc channel to be ready at localhost:58153.
DEBUG:root:Waiting for grpc channel to be ready at localhost:58153.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:31 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:32 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:34 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQL:'
INFO:apache_beam.utils.subprocess_server:b'SELECT COUNT(*) AS `count`'
INFO:apache_beam.utils.subprocess_server:b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:34 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: SQLPlan>'
INFO:apache_beam.utils.subprocess_server:b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  LogicalProject($f0=[0])'
INFO:apache_beam.utils.subprocess_server:b'    BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:34 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO:apache_beam.utils.subprocess_server:b'  BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fa9d27b41e0> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fa9d27b48c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:27 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n  Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4\n  Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n  Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n  Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n  Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n  Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14\n  Map(<lambda at sql_test.py:171>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_WindowInto-WindowIntoFn-_15\n  WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/selectKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-Grou\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/Combine/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToRow/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-\n  SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/mergeRecord/ParMultiDo(Anonymous):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_19\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_22\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_24\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_26\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_27\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_28\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_29\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_31\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_32\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f1f602d0158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f1f602d0268> ====================
INFO:root:==================== <function pack_combiners at 0x7f1f602d06a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f1f602d07b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f1f602d0950> ====================
INFO:root:==================== <function expand_gbk at 0x7f1f602d09d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f1f602d0ae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f1f602d0b70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f1f602d0bf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f1f602d0c80> ====================
INFO:root:==================== <function sort_stages at 0x7f1f602d0ea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f1f602d0e18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f1f602d0f28> ====================
INFO:root:starting control server on port 44129
INFO:root:starting data server on port 42371
INFO:root:starting state server on port 34085
INFO:root:starting logging server on port 33619
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1f5fd3a1d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'1b220b687ab80d3e453449ceb6313a0c3d70c67cdb2fa80a09a9cb2da470ed70', worker_id = worker_48
INFO:root:Running ((((ref_AppliedPTransform_Create-Impulse_3)+(ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2930-_4))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
INFO:root:Running ((((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-Map-decode-_13))+(ref_AppliedPTransform_Map-lambda-at-sql_test-py-171-_14))+(ref_AppliedPTransform_WindowInto-WindowIntoFn-_15))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1f5fd7cc88> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'69017519d1723e4dd1497bd13100cd79ef91ad67a420b153b3f69277f4ba575f', worker_id = worker_49
INFO:root:Running ((ref_PCollection_PCollection_1/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToKvs-sele))+(SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Write)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_19)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_20))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_22))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_26))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running ((((SqlTransform(beam:external:java:sql:v1)/BeamAggregationRel_40/Group.CombineFieldsByFields/ToKvs/GroupByKey/Read)+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-Combine-Pa))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-Group-CombineFieldsByFields-ToRow-ParM))+(external_8SqlTransform-beam-external-java-sql-v1--BeamAggregationRel_40-mergeRecord-ParMultiDo-Anonymous-))+(ref_PCollection_PCollection_11/Write)
INFO:root:Running (((((ref_PCollection_PCollection_11/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_23))+(ref_AppliedPTransform_assert_that-ToVoidKey_24))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_27))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_30))+(ref_AppliedPTransform_assert_that-Unkey_31))+(ref_AppliedPTransform_assert_that-Match_32)
INFO:root:Successfully completed job in 9.713140726089478 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_zetasql_generate_data (apache_beam.transforms.sql_test.SqlTransformTest) ... INFO:apache_beam.utils.subprocess_server:Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar>
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.31.0-SNAPSHOT.jar'> '36631']
DEBUG:root:Waiting for grpc channel to be ready at localhost:36631.
INFO:apache_beam.utils.subprocess_server:b'Starting expansion service at localhost:36631'
DEBUG:root:Waiting for grpc channel to be ready at localhost:36631.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:49 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO:apache_beam.utils.subprocess_server:b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:external:java:generate_sequence:v1]'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5680a178'
INFO:apache_beam.utils.subprocess_server:b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$3/1130478920@5fdef03a'
DEBUG:root:Waiting for grpc channel to be ready at localhost:36631.
DEBUG:root:Waiting for grpc channel to be ready at localhost:36631.
DEBUG:root:Waiting for grpc channel to be ready at localhost:36631.
DEBUG:root:Waiting for grpc channel to be ready at localhost:36631.
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO:apache_beam.utils.subprocess_server:b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO:apache_beam.utils.subprocess_server:b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO:apache_beam.utils.subprocess_server:b'Apr 30, 2021 6:37:54 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal'
INFO:apache_beam.utils.subprocess_server:b'INFO: BEAMPlan>'
INFO:apache_beam.utils.subprocess_server:b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])"
INFO:apache_beam.utils.subprocess_server:b'  BeamValuesRel(tuples=[[{ 0 }]])'
INFO:apache_beam.utils.subprocess_server:b''
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
DEBUG:root:Unhandled type_constraint: Union[]
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:No image given, using default Python SDK image
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fa9d27b41e0> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fa9d27b48c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:16 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Boun\n  SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-\n  SqlTransform(beam:external:java:sql:v1)/BeamZetaSqlCalcRel_17/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_5\n  assert_that/Create/Impulse:beam:transform:impulse:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6\n  assert_that/Create/FlatMap(<lambda at core.py:2930>):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_8\n  assert_that/Create/Map(decode):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9\n  assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_10\n  assert_that/ToVoidKey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_12\n  assert_that/Group/pair_with_0:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_13\n  assert_that/Group/pair_with_1:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_14\n  assert_that/Group/Flatten:beam:transform:flatten:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_15\n  assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16\n  assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_17\n  assert_that/Unkey:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_18\n  assert_that/Match:beam:transform:pardo:v1\n  must follow: \n  downstream_side_inputs: <unknown>']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7f1f602d0158> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7f1f602d0268> ====================
INFO:root:==================== <function pack_combiners at 0x7f1f602d06a8> ====================
INFO:root:==================== <function lift_combiners at 0x7f1f602d07b8> ====================
INFO:root:==================== <function expand_sdf at 0x7f1f602d0950> ====================
INFO:root:==================== <function expand_gbk at 0x7f1f602d09d8> ====================
INFO:root:==================== <function sink_flattens at 0x7f1f602d0ae8> ====================
INFO:root:==================== <function greedily_fuse at 0x7f1f602d0b70> ====================
INFO:root:==================== <function read_to_impulse at 0x7f1f602d0bf8> ====================
INFO:root:==================== <function impulse_to_input at 0x7f1f602d0c80> ====================
INFO:root:==================== <function sort_stages at 0x7f1f602d0ea0> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f1f602d0e18> ====================
INFO:root:==================== <function populate_data_channel_coders at 0x7f1f602d0f28> ====================
INFO:root:starting control server on port 38493
INFO:root:starting data server on port 45587
INFO:root:starting state server on port 35931
INFO:root:starting logging server on port 35407
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1f5fc90a90> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'cc461f2b9f1eacd7cb108e68890c02b581963c3afd3b698ee118d1a5971866ca', worker_id = worker_50
INFO:root:Running ((((external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--Impulse)+(external_9SqlTransform-beam-external-java-sql-v1--BeamValuesRel_13-Create-Values-Read-CreateSource--ParDo-Outp))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/PairWithRestriction))+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/SplitAndSizeRestriction))+(external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Write)
INFO:root:Running (((external_9SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource).output_split/Read)+(SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_13/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/Process))+(external_9SqlTransform-beam-external-java-sql-v1--BeamZetaSqlCalcRel_17-ParDo-Calc--ParMultiDo-Calc-))+(ref_PCollection_PCollection_1/Write)
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1f5fd2ef98> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev
INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'45738720ea4dc5ac89203fcb4355e18be08839b5df8a87ca38b9958cd42cc217', worker_id = worker_51
INFO:root:Running (((((ref_PCollection_PCollection_1/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_9))+(ref_AppliedPTransform_assert_that-ToVoidKey_10))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_13))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_5)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2930-_6))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_8))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_12))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_16))+(ref_AppliedPTransform_assert_that-Unkey_17))+(ref_AppliedPTransform_assert_that-Match_18)
INFO:root:Successfully completed job in 11.25013780593872 seconds.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok

----------------------------------------------------------------------
XML: nosetests-xlangSqlValidateRunner.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 9 tests in 170.964s

OK

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava FROM-CACHE

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 21268.
Stopping expansion service pid: 21271.

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 16107

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 16s
158 actionable tasks: 33 executed, 2 from cache, 123 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/nbmukr7jcwk2u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org