You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2024/01/16 05:54:39 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5070

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5070/display/redirect>

Changes:


------------------------------------------
[...truncated 1.54 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:33 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f95695831f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f9569583280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f95695839d0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff0bc5da1f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff0bc5da310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff0bc5da820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff0bc5da8b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff0bc5daa60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff0bc5daaf0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff0bc5dac10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff0bc5daca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff0bc5dad30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff0bc5dadc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff0bc5db040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff0bc5db160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff0bc5daf70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff0bc5db0d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 35571
INFO     root:portable_runner.py:543 starting data server on port 32783
INFO     root:portable_runner.py:543 starting state server on port 39907
INFO     root:portable_runner.py:543 starting logging server on port 44251
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff0ebd618b0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'e6ca385c77075b218f59566e405524fd66f1b230146c2db6a393d963eace5bcc', worker_id = worker_87
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7ff0eafe3ca0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:54919')
INFO     root:portable_runner.py:543 Requesting worker at localhost:54919
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:46 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:35571.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:56 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:56 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-3d96cfc6-b161-47c2-95d7-e83549bbf17d failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 280.57s (0:04:40) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1579869

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1580414.
Stopping expansion service pid: 1580415.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 34m 57s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/q7c4qtyhs5ym4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5097

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5097/display/redirect?page=changes>

Changes:

[noreply] Decommission all remaining jenkins jobs (#30113)


------------------------------------------
[...truncated 1.76 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:11 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:12 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:13 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f669ae3f1f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f669ae3f280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f669ae3f9d0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fb17d23b4c0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fb17d23b5e0> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fb17d23baf0> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fb17d23bb80> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fb17d23bd30> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fb17d23bdc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fb17d23bee0> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fb17d23bf70> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fb17d23c040> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fb17d23c0d0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7fb17d23c310> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fb17d23c430> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fb17d23c280> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fb17d23c3a0> ====================
INFO     root:portable_runner.py:543 starting control server on port 42099
INFO     root:portable_runner.py:543 starting data server on port 41897
INFO     root:portable_runner.py:543 starting state server on port 43723
INFO     root:portable_runner.py:543 starting logging server on port 41015
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb17c05d340> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'6dc5da90bce2abc0856c3bfdfb1e06e40a7210f61dc9dba05811492fd2245243', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fb1b1abe2e0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:46837')
INFO     root:portable_runner.py:543 Requesting worker at localhost:46837
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:25 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:42099.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:34 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:34 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-52e2fbcc-d0f9-4989-9af5-656d16b893be failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 295.98s (0:04:55) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2465244

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2485105.
Stopping expansion service pid: 2485106.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 52s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/4zyuuqkc3qx4u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5096

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5096/display/redirect>

Changes:


------------------------------------------
[...truncated 1.63 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:51 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:51 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:51 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:53 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:53 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:53 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f415c5df1f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f415c5df280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f415c5df9d0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f56621134c0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f56621135e0> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5662113af0> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5662113b80> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5662113d30> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5662113dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5662113ee0> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5662113f70> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5662115040> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f56621150d0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5662115310> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5662115430> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5662115280> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f56621153a0> ====================
INFO     root:portable_runner.py:543 starting control server on port 33819
INFO     root:portable_runner.py:543 starting data server on port 45185
INFO     root:portable_runner.py:543 starting state server on port 34541
INFO     root:portable_runner.py:543 starting logging server on port 33333
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f56941b6790> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'91f865540a618a87ecee8616fbc98628d2ff6b1c6db157d8d9dfc1ab50f3af8a', worker_id = worker_87
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f569402b7c0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:36381')
INFO     root:portable_runner.py:543 Requesting worker at localhost:36381
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:47:04 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:33819.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:47:14 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:47:14 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-94514494-873e-40a8-9a05-c92fc2127286 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 288.59s (0:04:48) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1643381

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1669265.
Stopping expansion service pid: 1669266.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 37m 31s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/ilkxthguqxmli

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5095

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5095/display/redirect>

Changes:


------------------------------------------
[...truncated 1.74 MB...]
apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar>
INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar'> '42139' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:42139
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:54 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING  root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:42139.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:57 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:57 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:57 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:59 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe1105e0ee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe1105e0f70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe1105df700> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7febded874c0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7febded875e0> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7febded87af0> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7febded87b80> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7febded87d30> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7febded87dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7febded87ee0> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7febded87f70> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7febded88040> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7febded880d0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7febded88310> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7febded88430> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7febded88280> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7febded883a0> ====================
INFO     root:portable_runner.py:543 starting control server on port 40077
INFO     root:portable_runner.py:543 starting data server on port 34579
INFO     root:portable_runner.py:543 starting state server on port 32819
INFO     root:portable_runner.py:543 starting logging server on port 35385
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fec12b2c670> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'464d18dd407983360468a12ff412520112d81e626fafe23a6b93d60ae4598222', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fec0e3a07f0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:42139')
INFO     root:portable_runner.py:543 Requesting worker at localhost:42139
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:11 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:40077.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:20 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:20 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-ae4acd53-8b1b-4e46-aa86-df4b0b8e9e5f failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 311.29s (0:05:11) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 316889

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 331913.
Stopping expansion service pid: 331914.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 37m 45s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/ijgixbr6cwuhs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5094

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5094/display/redirect>

Changes:


------------------------------------------
[...truncated 1.79 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING  root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:60013.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:32 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:32 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:33 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f874e7cbee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f874e7cbf70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f874e7cd700> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f128cb984c0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f128cb985e0> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f128cb98af0> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f128cb98b80> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f128cb98d30> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f128cb98dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f128cb98ee0> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f128cb98f70> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f128cb99040> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f128cb990d0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f128cb99310> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f128cb99430> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f128cb99280> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f128cb993a0> ====================
INFO     root:portable_runner.py:543 starting control server on port 39273
INFO     root:portable_runner.py:543 starting data server on port 34553
INFO     root:portable_runner.py:543 starting state server on port 37585
INFO     root:portable_runner.py:543 starting logging server on port 46431
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f12c157d9a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'a3035d638056a53e6b286df6ef2a9131e9888602f3332fcc529c05c157fe8d82', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f12c15f6c40> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:60013')
INFO     root:portable_runner.py:543 Requesting worker at localhost:60013
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:46 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:39273.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:55 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:55 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-2e716f66-a9c0-4518-afcb-d1cd04bab07d failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 293.38s (0:04:53) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3586159

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3617947.
Stopping expansion service pid: 3617948.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 39m 13s
261 actionable tasks: 184 executed, 67 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/dnnit2qsfxzma

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5093

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5093/display/redirect>

Changes:


------------------------------------------
[...truncated 1.44 MB...]

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '37499' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:37499
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:39 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:40 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:40 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:40 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ffa506eac10> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ffa506eaca0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ffa506e8430> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe5bf62a1f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe5bf62a310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe5bf62a820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe5bf62a8b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe5bf62aa60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe5bf62aaf0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe5bf62ac10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe5bf62aca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe5bf62ad30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe5bf62adc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe5bf62b040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe5bf62b160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe5bf62af70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe5bf62b0d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 38409
INFO     root:portable_runner.py:543 starting data server on port 42949
INFO     root:portable_runner.py:543 starting state server on port 37157
INFO     root:portable_runner.py:543 starting logging server on port 34833
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe5ee6aee50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'5037f5d3d198a8d98a81aabba8f63ad28b3c76a9d325d378919af93346a50c1f', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fe5f0fb7d60> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:37499')
INFO     root:portable_runner.py:543 Requesting worker at localhost:37499
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:53 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:38409.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:48:02 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:48:02 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-0c868536-1204-47f8-acae-0adc9a32189c failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7306 deselected in 289.97s (0:04:49) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2762273

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2786184.
Stopping expansion service pid: 2786185.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 21s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/gtitdctshandi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


beam_PostCommit_XVR_Direct - Build # 5092 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_Direct - Build # 5092 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5092/ to view the results.

Build failed in Jenkins: beam_PostCommit_XVR_Direct #5091

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5091/display/redirect>

Changes:


------------------------------------------
[...truncated 1.73 MB...]
E       AttributeError: 'bytes' object has no attribute 'end'

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '45883' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:45883
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:36 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING  root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:45883.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:38 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0b226eaa60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0b226eaaf0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0b226eb280> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fefa6e831f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fefa6e83310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fefa6e83820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fefa6e838b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fefa6e83a60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fefa6e83af0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fefa6e83c10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fefa6e83ca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fefa6e83d30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fefa6e83dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7fefa6e84040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fefa6e84160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fefa6e83f70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fefa6e840d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 44343
INFO     root:portable_runner.py:543 starting data server on port 41609
INFO     root:portable_runner.py:543 starting state server on port 35937
INFO     root:portable_runner.py:543 starting logging server on port 44751
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fefd8ec94c0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'402df4a2eb45ca8e71dd5a959900e1d95b9890da53fcc86776d3d162efa48890', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fefdbe96280> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:45883')
INFO     root:portable_runner.py:543 Requesting worker at localhost:45883
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:52 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:44343.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:45:01 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:45:01 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-8c03aaf0-89be-47af-a0d4-e55e2c1e1e42 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 290.74s (0:04:50) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1555692

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1558804.
Stopping expansion service pid: 1558805.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 35m 21s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/kxa2cnilfr3e2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5090

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5090/display/redirect>

Changes:


------------------------------------------
[...truncated 1.04 MB...]
      >
      component_coder_ids: "HyVSQosVbwVarIntCoder"
      component_coder_ids: "HyVSQosVbwIterableCoder"
    >
  >
  coders: <
    key: "HyVSQosVbwRowCoder"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\004\022$f21e325f-2200-484f-825f-8454a13a12e8"
      >
    >
  >
  coders: <
    key: "HyVSQosVbwVarIntCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "HyVSQosVbwVoidCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
      >
    >
  >
  environments: <
    key: "HyVSQosVbwbeam:env:docker:v1"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:timer:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:custom_window:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:param_windowed_value:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:sharded_key:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:harness_monitoring_infos:v1"
      capabilities: "beam:protocol:control_request_elements_embedding:v1"
      capabilities: "beam:protocol:state_caching:v1"
      capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar\022@ad70115bcd9f3d60630a1551c6c3c977540f32379e395fc947775954abf43412"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar"
      >
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:worker_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_worker_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/23 23:22:40 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1706052160843561412
2024/01/23 23:22:43 Prepared job with id: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a and staging token: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a
2024/01/23 23:22:43 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a
2024/01/23 23:22:43 Submitted job: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a
2024/01/23 23:22:43 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: STOPPED
2024/01/23 23:22:43 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: STARTING
2024/01/23 23:22:43 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: RUNNING
2024/01/23 23:22:43 2024-01-23 23:22:43. (1): ==================== <function annotate_downstream_side_inputs at 0x7f0c446841f0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f0c44684310> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (3): ==================== <function pack_combiners at 0x7f0c44684820> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (4): ==================== <function lift_combiners at 0x7f0c446848b0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (5): ==================== <function expand_sdf at 0x7f0c44684a60> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (6): ==================== <function expand_gbk at 0x7f0c44684af0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (7): ==================== <function sink_flattens at 0x7f0c44684c10> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (8): ==================== <function greedily_fuse at 0x7f0c44684ca0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (9): ==================== <function read_to_impulse at 0x7f0c44684d30> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (10): ==================== <function impulse_to_input at 0x7f0c44684dc0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (11): ==================== <function sort_stages at 0x7f0c44685040> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f0c44685160> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (13): ==================== <function setup_timer_mapping at 0x7f0c44684f70> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (14): ==================== <function populate_data_channel_coders at 0x7f0c446850d0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (15): starting control server on port 33995
2024/01/23 23:22:43 2024-01-23 23:22:43. (16): starting data server on port 39037
2024/01/23 23:22:43 2024-01-23 23:22:43. (17): starting state server on port 42937
2024/01/23 23:22:43 2024-01-23 23:22:43. (18): starting logging server on port 44647
2024/01/23 23:22:43 2024-01-23 23:22:43. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c78bea0a0> for environment HyVSQosVbwbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/23 23:22:43 2024-01-23 23:22:43. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/23 23:22:44 2024-01-23 23:22:44. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/23 23:22:49 2024-01-23 23:22:49. (22): Waiting for docker to start up. Current status is running
2024/01/23 23:22:49 2024-01-23 23:22:49. (23): Docker container is running. container_id = b'e7142f83cec1658871333b75d840efd94f9da4a10b3c5e002845524780f1be6c', worker_id = worker_16
2024/01/23 23:22:50 2024-01-23 23:22:50. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c79698130> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/23 23:22:53 2024-01-23 23:22:53. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/23 23:22:53 2024-01-23 23:22:53. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/23 23:22:54 2024-01-23 23:22:54. (27): Waiting for docker to start up. Current status is running
2024/01/23 23:22:54 2024-01-23 23:22:54. (28): Docker container is running. container_id = b'2d5b68a79c09dc668c7232a6ff12d09f8e8ca9b9c2a8b61b063433b47d3b11d9', worker_id = worker_18
2024/01/23 23:22:58 2024-01-23 23:22:58. (29): Completed job in 14.266560792922974 seconds with state DONE.
2024/01/23 23:22:58 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: DONE
2024/01/23 23:22:58 🐳 Terminating container: 4074f8f598e9
2024/01/23 23:22:58 🚫 Container terminated: 4074f8f598e9
--- PASS: TestJDBCIO_PostgresReadWrite (45.83s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	108.834s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.022s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40195
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpcprps8qk/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40157
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 35m 3s
261 actionable tasks: 183 executed, 68 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/v4azomgq5pnj6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5089

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5089/display/redirect>

Changes:


------------------------------------------
[...truncated 1.04 MB...]
  coders: <
    key: "oegwhlvaUaKvCoder"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "oegwhlvaUaVarIntCoder"
      component_coder_ids: "oegwhlvaUaRowCoder"
    >
  >
  coders: <
    key: "oegwhlvaUaKvCoder1"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "oegwhlvaUaVarIntCoder"
      component_coder_ids: "oegwhlvaUaCoder1"
    >
  >
  coders: <
    key: "oegwhlvaUaKvCoder2"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "oegwhlvaUaVarIntCoder"
      component_coder_ids: "oegwhlvaUaIterableCoder"
    >
  >
  coders: <
    key: "oegwhlvaUaRowCoder"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\004\022$c3aecc09-c8cc-4be7-8b4a-680f87728385"
      >
    >
  >
  coders: <
    key: "oegwhlvaUaVarIntCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "oegwhlvaUaVoidCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:worker_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_worker_binary:v1"
      >
    >
  >
  environments: <
    key: "oegwhlvaUabeam:env:docker:v1"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:timer:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:custom_window:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:param_windowed_value:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:sharded_key:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:harness_monitoring_infos:v1"
      capabilities: "beam:protocol:control_request_elements_embedding:v1"
      capabilities: "beam:protocol:state_caching:v1"
      capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar\022@4c6749adba74b4713313f2bcddcdcc43d70815d4c887f4b7feafdab4740e3332"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/23 17:34:31 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1706031271551235705
2024/01/23 17:34:35 Prepared job with id: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8 and staging token: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8
2024/01/23 17:34:36 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8
2024/01/23 17:34:36 Submitted job: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8
2024/01/23 17:34:36 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: STOPPED
2024/01/23 17:34:36 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: STARTING
2024/01/23 17:34:36 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: RUNNING
2024/01/23 17:34:36 2024-01-23 17:34:36. (1): ==================== <function annotate_downstream_side_inputs at 0x7f3d00ebb1f0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f3d00ebb310> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (3): ==================== <function pack_combiners at 0x7f3d00ebb820> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (4): ==================== <function lift_combiners at 0x7f3d00ebb8b0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (5): ==================== <function expand_sdf at 0x7f3d00ebba60> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (6): ==================== <function expand_gbk at 0x7f3d00ebbaf0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (7): ==================== <function sink_flattens at 0x7f3d00ebbc10> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (8): ==================== <function greedily_fuse at 0x7f3d00ebbca0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (9): ==================== <function read_to_impulse at 0x7f3d00ebbd30> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (10): ==================== <function impulse_to_input at 0x7f3d00ebbdc0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (11): ==================== <function sort_stages at 0x7f3d00ebc040> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f3d00ebc160> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (13): ==================== <function setup_timer_mapping at 0x7f3d00ebbf70> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (14): ==================== <function populate_data_channel_coders at 0x7f3d00ebc0d0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (15): starting control server on port 43057
2024/01/23 17:34:36 2024-01-23 17:34:36. (16): starting data server on port 41867
2024/01/23 17:34:36 2024-01-23 17:34:36. (17): starting state server on port 40945
2024/01/23 17:34:36 2024-01-23 17:34:36. (18): starting logging server on port 39591
2024/01/23 17:34:36 2024-01-23 17:34:36. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3d35f0c520> for environment oegwhlvaUabeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/23 17:34:38 2024-01-23 17:34:38. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/23 17:34:38 2024-01-23 17:34:38. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/23 17:34:40 2024-01-23 17:34:40. (22): Waiting for docker to start up. Current status is running
2024/01/23 17:34:40 2024-01-23 17:34:40. (23): Docker container is running. container_id = b'7f5a1eb1d8e838b0088fa5287f636fd8aa3fe4bed6b34880bca122afe00a2e0d', worker_id = worker_17
2024/01/23 17:34:42 2024-01-23 17:34:42. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3cfc516130> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/23 17:34:45 2024-01-23 17:34:45. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/23 17:34:45 2024-01-23 17:34:45. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/23 17:34:47 2024-01-23 17:34:47. (27): Waiting for docker to start up. Current status is running
2024/01/23 17:34:47 2024-01-23 17:34:47. (28): Docker container is running. container_id = b'9534b4f4c22c03cbb3c09c4fd6589b2ef6e205f8ed52e080ee49808879e402c3', worker_id = worker_19
2024/01/23 17:34:51 2024-01-23 17:34:51. (29): Completed job in 15.148397207260132 seconds with state DONE.
2024/01/23 17:34:51 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: DONE
2024/01/23 17:34:51 🐳 Terminating container: 7ebd56a4a6cb
2024/01/23 17:34:51 🚫 Container terminated: 7ebd56a4a6cb
--- PASS: TestJDBCIO_PostgresReadWrite (62.40s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	154.526s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.060s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 45793
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpc9dxbfhx/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39009
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 46m 4s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/qyqh6j42bjwoe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5088

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5088/display/redirect>

Changes:


------------------------------------------
[...truncated 1.67 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING  root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:58275.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:11 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:13 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f97a72d4a60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f97a72d4af0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f97a72d5280> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f5d6ffb11f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f5d6ffb1310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5d6ffb1820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5d6ffb18b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5d6ffb1a60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5d6ffb1af0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5d6ffb1c10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5d6ffb1ca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5d6ffb1d30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f5d6ffb1dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5d6ffb2040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5d6ffb2160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5d6ffb1f70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f5d6ffb20d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 40725
INFO     root:portable_runner.py:543 starting data server on port 38129
INFO     root:portable_runner.py:543 starting state server on port 45377
INFO     root:portable_runner.py:543 starting logging server on port 39677
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5da5045910> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'f22dd15bc792882eb148b6e9547eff1dbb74eb55d4a8717500e455db7e5ad8c3', worker_id = worker_87
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f5da454b580> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:58275')
INFO     root:portable_runner.py:543 Requesting worker at localhost:58275
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:25 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-14.c.apache-beam-testing.internal:40725.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:37 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:37 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-f6559805-a98a-46c5-817e-13ef42d1be82 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 343.18s (0:05:43) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 144583

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 158493.
Stopping expansion service pid: 158494.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 40m 27s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/qpeopet32l7kg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5087

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5087/display/redirect>

Changes:


------------------------------------------
[...truncated 1.73 MB...]
E         File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
E           if input_watermark > window.end + self.allowed_lateness:
E       AttributeError: 'bytes' object has no attribute 'end'

apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO     root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '54769' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:54769
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:23 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:24 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:25 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:25 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa2d926e9d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa2d926ea60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa2d926f1f0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fca167731f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fca16773310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fca16773820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fca167738b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fca16773a60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fca16773af0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fca16773c10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fca16773ca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fca16773d30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fca16773dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7fca16774040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fca16774160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fca16773f70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fca167740d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 39865
INFO     root:portable_runner.py:543 starting data server on port 39247
INFO     root:portable_runner.py:543 starting state server on port 45417
INFO     root:portable_runner.py:543 starting logging server on port 32823
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca47bad040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'7d8351897af97fec58408467a0eb12d9ce26168128e306c17adfb50d31efb47c', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fca47b7b400> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:54769')
INFO     root:portable_runner.py:543 Requesting worker at localhost:54769
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:38 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:39865.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:47 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:47 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-13b2404f-7a3f-4e93-94a7-5ca9a3811626 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 284.33s (0:04:44) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 621741

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 623527.
Stopping expansion service pid: 623528.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 52s
261 actionable tasks: 221 executed, 30 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/emoes2s3pk772

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5086

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5086/display/redirect?page=changes>

Changes:

[noreply] Address Feedback from Beam Website Feedback Form. (#30064)


------------------------------------------
[...truncated 1.04 MB...]
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
	at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
	at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.)
	at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:653)
	at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
	at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
Caused by: org.postgresql.util.PSQLException: Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
	at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:303)
	at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
	at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:225)
	at org.postgresql.Driver.makeConnection(Driver.java:465)
	at org.postgresql.Driver.connect(Driver.java:264)
	at org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:52)
	at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:374)
	at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:106)
	at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:649)
	at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
	at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn$DoFnInvoker.invokeProcessElement(Unknown Source)
	at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
	at org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1792)
	at org.apache.beam.fn.harness.FnApiDoFnRunner.access$3000(FnApiDoFnRunner.java:143)
	at org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:2650)
	at org.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)
	at org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)
	at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
	at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
	at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:607)
	at org.postgresql.core.PGStream.createSocket(PGStream.java:231)
	at org.postgresql.core.PGStream.<init>(PGStream.java:95)
	at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:98)
	at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:213)
	... 36 more
2024/01/22 16:09:38 Job[go-testjdbcio_basicreadwrite-841-a3b772c1-8748-4767-8597-4bc1dd7b24b3] state: FAILED
    jdbc_test.go:116: Failed to execute job: job go-testjdbcio_basicreadwrite-841-a3b772c1-8748-4767-8597-4bc1dd7b24b3 failed:
        Error running pipeline.
        Traceback (most recent call last):
          File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
            self.result = self._invoke_runner()
          File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
            return fn_runner.FnApiRunner(
          File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
            return self.run_stages(stage_context, stages)
          File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
            bundle_results = self._execute_bundle(
          File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
            self._run_bundle(
          File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
            result, splits = bundle_manager.process_bundle(
          File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1406, in process_bundle
            raise RuntimeError(result.error)
        RuntimeError: org.apache.beam.sdk.util.UserCodeException: java.sql.SQLException: Cannot create PoolableConnectionFactory (Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.)
        	at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
        	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn$DoFnInvoker.invokeProcessElement(Unknown Source)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1792)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.access$3000(FnApiDoFnRunner.java:143)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:2650)
        	at org.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)
        	at org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
        	at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
        	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
        	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
        	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
        	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
        	at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
        	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        	at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        	at java.lang.Thread.run(Thread.java:750)
        Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.)
        	at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:653)
        	at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
        	at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
        	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
        	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
        Caused by: org.postgresql.util.PSQLException: Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
        	at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:303)
        	at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
        	at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:225)
        	at org.postgresql.Driver.makeConnection(Driver.java:465)
        	at org.postgresql.Driver.connect(Driver.java:264)
        	at org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:52)
        	at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:374)
        	at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:106)
        	at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:649)
        	at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
        	at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
        	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
        	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
        	at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn$DoFnInvoker.invokeProcessElement(Unknown Source)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1792)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.access$3000(FnApiDoFnRunner.java:143)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:2650)
        	at org.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)
        	at org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)
        	at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
        	at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
        	at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
        	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
        	at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
        	at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
        	at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
        	at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
        	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        	at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        	at java.lang.Thread.run(Thread.java:750)
        Caused by: java.net.ConnectException: Connection refused (Connection refused)
        	at java.net.PlainSocketImpl.socketConnect(Native Method)
        	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
        	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
        	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
        	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        	at java.net.Socket.connect(Socket.java:607)
        	at org.postgresql.core.PGStream.createSocket(PGStream.java:231)
        	at org.postgresql.core.PGStream.<init>(PGStream.java:95)
        	at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:98)
        	at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:213)
        	... 36 more
2024/01/22 16:09:38 🐳 Terminating container: 9eb08b15f51f
    containers.go:100: error terminating container: Error response from daemon: No such container: 9eb08b15f51fd99e58afda492d2d06220548fcfde7313fc164f4773970bc9812
--- FAIL: TestJDBCIO_BasicReadWrite (62.68s)
=== RUN   TestJDBCIO_PostgresReadWrite
    jdbc_test.go:128: failed to start container with 5 retries: Error response from daemon: No such container: 9b09499a1ea926d3bd7db5a9bc46ab17f38eaa24dc34ab5c99c5593c04bfccab: creating reaper failed: failed to create container
--- FAIL: TestJDBCIO_PostgresReadWrite (15.00s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	80.747s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.036s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40847
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp4ht4jmbo/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36063
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 37m 22s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/34cb5zjfxtbwu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5085

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5085/display/redirect>

Changes:


------------------------------------------
[...truncated 1.20 MB...]
      >
      component_coder_ids: "KKWqINJGKcVarIntCoder"
      component_coder_ids: "KKWqINJGKcIterableCoder"
    >
  >
  coders: <
    key: "KKWqINJGKcRowCoder"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\004\022$d7f638c7-3f67-4411-97e9-5d7d2a70e8b6"
      >
    >
  >
  coders: <
    key: "KKWqINJGKcVarIntCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "KKWqINJGKcVoidCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
      >
    >
  >
  environments: <
    key: "KKWqINJGKcbeam:env:docker:v1"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:timer:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:custom_window:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:param_windowed_value:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:sharded_key:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:harness_monitoring_infos:v1"
      capabilities: "beam:protocol:control_request_elements_embedding:v1"
      capabilities: "beam:protocol:state_caching:v1"
      capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar\022@4c6749adba74b4713313f2bcddcdcc43d70815d4c887f4b7feafdab4740e3332"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar"
      >
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:worker_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_worker_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/21 22:37:06 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-3-1705876626566602413
2024/01/21 22:37:10 Prepared job with id: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e and staging token: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e
2024/01/21 22:37:11 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e
2024/01/21 22:37:11 Submitted job: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e
2024/01/21 22:37:11 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: STOPPED
2024/01/21 22:37:11 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: STARTING
2024/01/21 22:37:11 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: RUNNING
2024/01/21 22:37:11 2024-01-21 22:37:11. (1): ==================== <function annotate_downstream_side_inputs at 0x7fb7984019d0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fb798401af0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (3): ==================== <function pack_combiners at 0x7fb7983ff040> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (4): ==================== <function lift_combiners at 0x7fb7983ff0d0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (5): ==================== <function expand_sdf at 0x7fb7983ff280> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (6): ==================== <function expand_gbk at 0x7fb7983ff310> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (7): ==================== <function sink_flattens at 0x7fb7983ff430> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (8): ==================== <function greedily_fuse at 0x7fb7983ff4c0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (9): ==================== <function read_to_impulse at 0x7fb7983ff550> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (10): ==================== <function impulse_to_input at 0x7fb7983ff5e0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (11): ==================== <function sort_stages at 0x7fb7983ff820> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fb7983ff940> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (13): ==================== <function setup_timer_mapping at 0x7fb7983ff790> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (14): ==================== <function populate_data_channel_coders at 0x7fb7983ff8b0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (15): starting control server on port 43517
2024/01/21 22:37:11 2024-01-21 22:37:11. (16): starting data server on port 37569
2024/01/21 22:37:11 2024-01-21 22:37:11. (17): starting state server on port 40293
2024/01/21 22:37:11 2024-01-21 22:37:11. (18): starting logging server on port 38791
2024/01/21 22:37:11 2024-01-21 22:37:11. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb7cbfd3670> for environment KKWqINJGKcbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/21 22:37:11 2024-01-21 22:37:11. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/21 22:37:11 2024-01-21 22:37:11. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/21 22:37:14 2024-01-21 22:37:14. (22): Waiting for docker to start up. Current status is running
2024/01/21 22:37:14 2024-01-21 22:37:14. (23): Docker container is running. container_id = b'302e30f6ca67cc16ec183b04ebb59e318024c9e87fc32172920cb6fdbe5282ed', worker_id = worker_14
2024/01/21 22:37:16 2024-01-21 22:37:16. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb7cd4210d0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/21 22:37:16 2024-01-21 22:37:16. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/21 22:37:17 2024-01-21 22:37:17. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/21 22:37:17 2024-01-21 22:37:17. (27): Waiting for docker to start up. Current status is running
2024/01/21 22:37:17 2024-01-21 22:37:17. (28): Docker container is running. container_id = b'3020b46f0d910f09509f228c9319fc71ffde61156217b58607d53df4b6754727', worker_id = worker_15
2024/01/21 22:37:22 2024-01-21 22:37:22. (29): Completed job in 11.135669708251953 seconds with state DONE.
2024/01/21 22:37:22 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: DONE
2024/01/21 22:37:22 🐳 Terminating container: 36d2c45bc593
2024/01/21 22:37:22 🚫 Container terminated: 36d2c45bc593
--- PASS: TestJDBCIO_PostgresReadWrite (43.80s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	99.323s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.028s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38813
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpm4k88azz/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35357
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 36m 41s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/bvlpzn262evv4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5084

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5084/display/redirect>

Changes:


------------------------------------------
[...truncated 1.20 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f220386b280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f220386b310> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f220386ba60> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f92529d19d0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f92529d1af0> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f92529cc040> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f92529cc0d0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f92529cc280> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f92529cc310> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f92529cc430> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f92529cc4c0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f92529cc550> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f92529cc5e0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f92529cc820> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f92529cc940> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f92529cc790> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f92529cc8b0> ====================
INFO     root:portable_runner.py:543 starting control server on port 42349
INFO     root:portable_runner.py:543 starting data server on port 45927
INFO     root:portable_runner.py:543 starting state server on port 35033
INFO     root:portable_runner.py:543 starting logging server on port 38499
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9286e17310> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'7b511beb34ff1fe92ad1a904edeea6ddb33e5b0b818d0f374b4b24139ce2655e', worker_id = worker_87
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f9286fe2610> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:39689')
INFO     root:portable_runner.py:543 Requesting worker at localhost:39689
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:26 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:42349.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:35 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:35 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-183776a4-8a46-41db-a412-096eeb6cd23c failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 295.25s (0:04:55) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2082237

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2083114.
Stopping expansion service pid: 2083115.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 36m 58s
261 actionable tasks: 179 executed, 72 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/prxlvgqls7gkm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5083

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5083/display/redirect>

Changes:


------------------------------------------
[...truncated 1.63 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:54 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:54 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:55 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc782c94280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc782c94310> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc782c94a60> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f93f99e59d0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f93f99e5af0> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f93f99e6040> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f93f99e60d0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f93f99e6280> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f93f99e6310> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f93f99e6430> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f93f99e64c0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f93f99e6550> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f93f99e65e0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f93f99e6820> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f93f99e6940> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f93f99e6790> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f93f99e68b0> ====================
INFO     root:portable_runner.py:543 starting control server on port 41771
INFO     root:portable_runner.py:543 starting data server on port 37323
INFO     root:portable_runner.py:543 starting state server on port 34125
INFO     root:portable_runner.py:543 starting logging server on port 36135
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f942df23580> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'e76cd2dea4895fe116b2c8974d4b595369f83acedf9f0d9affccaff416b9ee32', worker_id = worker_87
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f942dfe0250> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:52427')
INFO     root:portable_runner.py:543 Requesting worker at localhost:52427
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:03:07 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:41771.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:03:16 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:03:16 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-d40b8520-b1a0-402d-9ff5-2b113ab55ac4 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 294.89s (0:04:54) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 986297

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 987191.
Stopping expansion service pid: 987192.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 37m 18s
261 actionable tasks: 179 executed, 72 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/lr3uwqirvoyqk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5082

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5082/display/redirect?page=changes>

Changes:

[noreply] [Python] Enrichment Transform with BigTable handler (#30001)


------------------------------------------
[...truncated 1.34 MB...]
  coders: <
    key: "fMHPWNBLKMKvCoder"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "fMHPWNBLKMVarIntCoder"
      component_coder_ids: "fMHPWNBLKMRowCoder"
    >
  >
  coders: <
    key: "fMHPWNBLKMKvCoder1"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "fMHPWNBLKMVarIntCoder"
      component_coder_ids: "fMHPWNBLKMCoder1"
    >
  >
  coders: <
    key: "fMHPWNBLKMKvCoder2"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "fMHPWNBLKMVarIntCoder"
      component_coder_ids: "fMHPWNBLKMIterableCoder"
    >
  >
  coders: <
    key: "fMHPWNBLKMRowCoder"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\004\022$9d5aed3a-e324-47e1-9780-aafec6fa714e"
      >
    >
  >
  coders: <
    key: "fMHPWNBLKMVarIntCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "fMHPWNBLKMVoidCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  environments: <
    key: "fMHPWNBLKMbeam:env:docker:v1"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:timer:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:custom_window:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:param_windowed_value:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:sharded_key:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:harness_monitoring_infos:v1"
      capabilities: "beam:protocol:control_request_elements_embedding:v1"
      capabilities: "beam:protocol:state_caching:v1"
      capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-EhOlsw5loEq-0j-S48CmpRhVu_K3XNUljpzhuT4lIhE.jar\022@1213a5b30e65a04abed23f92e3c0a6a51855bbf2b75cd5258e9ce1b93e252211"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-EhOlsw5loEq-0j-S48CmpRhVu_K3XNUljpzhuT4lIhE.jar"
      >
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:worker_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_worker_binary:v1"
      >
    >
  >
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2024/01/19 17:17:02 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705684622947856629
2024/01/19 17:17:05 Prepared job with id: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f and staging token: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f
2024/01/19 17:17:05 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f
2024/01/19 17:17:05 Submitted job: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f
2024/01/19 17:17:05 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: STOPPED
2024/01/19 17:17:05 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: STARTING
2024/01/19 17:17:05 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: RUNNING
2024/01/19 17:17:05 2024-01-19 17:17:05. (1): ==================== <function annotate_downstream_side_inputs at 0x7f21fd9e09d0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f21fd9e0af0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (3): ==================== <function pack_combiners at 0x7f21fd9dd040> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (4): ==================== <function lift_combiners at 0x7f21fd9dd0d0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (5): ==================== <function expand_sdf at 0x7f21fd9dd280> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (6): ==================== <function expand_gbk at 0x7f21fd9dd310> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (7): ==================== <function sink_flattens at 0x7f21fd9dd430> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (8): ==================== <function greedily_fuse at 0x7f21fd9dd4c0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (9): ==================== <function read_to_impulse at 0x7f21fd9dd550> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (10): ==================== <function impulse_to_input at 0x7f21fd9dd5e0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (11): ==================== <function sort_stages at 0x7f21fd9dd820> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f21fd9dd940> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (13): ==================== <function setup_timer_mapping at 0x7f21fd9dd790> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (14): ==================== <function populate_data_channel_coders at 0x7f21fd9dd8b0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (15): starting control server on port 35025
2024/01/19 17:17:05 2024-01-19 17:17:05. (16): starting data server on port 35605
2024/01/19 17:17:05 2024-01-19 17:17:05. (17): starting state server on port 39021
2024/01/19 17:17:05 2024-01-19 17:17:05. (18): starting logging server on port 46297
2024/01/19 17:17:05 2024-01-19 17:17:05. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2231743c10> for environment fMHPWNBLKMbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/19 17:17:09 2024-01-19 17:17:09. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/19 17:17:09 2024-01-19 17:17:09. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/19 17:17:10 2024-01-19 17:17:10. (22): Waiting for docker to start up. Current status is running
2024/01/19 17:17:10 2024-01-19 17:17:10. (23): Docker container is running. container_id = b'9eaf56ec52c86d0194f556e3d124fbf92992a6d56dfe7c449aaa69bbd9175f01', worker_id = worker_15
2024/01/19 17:17:12 2024-01-19 17:17:12. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f21ec7c38b0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/19 17:17:14 2024-01-19 17:17:14. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/19 17:17:15 2024-01-19 17:17:15. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/19 17:17:16 2024-01-19 17:17:16. (27): Waiting for docker to start up. Current status is running
2024/01/19 17:17:16 2024-01-19 17:17:16. (28): Docker container is running. container_id = b'f24152dfe89dc0120dd0676ed45befc2db010c66bde34f5135a00617709f31e3', worker_id = worker_17
2024/01/19 17:17:19 2024-01-19 17:17:19. (29): Completed job in 13.872668743133545 seconds with state DONE.
2024/01/19 17:17:19 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: DONE
2024/01/19 17:17:19 🐳 Terminating container: 125b641a0e8b
2024/01/19 17:17:20 🚫 Container terminated: 125b641a0e8b
--- PASS: TestJDBCIO_PostgresReadWrite (40.24s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	105.030s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.047s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 34763
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpub6f9k6t/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35003
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 36m 47s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/ib3hvp73tqnx6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5081

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5081/display/redirect>

Changes:


------------------------------------------
[...truncated 1.63 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:43 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:43 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:45 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:46 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:46 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb04b110280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb04b110310> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb04b110a60> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd198bae9d0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd198baeaf0> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd198bac040> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd198bac0d0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd198bac280> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd198bac310> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd198bac430> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd198bac4c0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd198bac550> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd198bac5e0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd198bac820> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd198bac940> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd198bac790> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd198bac8b0> ====================
INFO     root:portable_runner.py:543 starting control server on port 38275
INFO     root:portable_runner.py:543 starting data server on port 39909
INFO     root:portable_runner.py:543 starting state server on port 39273
INFO     root:portable_runner.py:543 starting logging server on port 40927
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd1cd0bb520> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'cb89a48290abb9721789ea415cdd323cfb5d6acb8a693ef29f53db60a401a34b', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fd1cd03fd90> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:47403')
INFO     root:portable_runner.py:543 Requesting worker at localhost:47403
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:56 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:38275.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:48:06 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:48:06 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-5cea84fc-eeb1-4d13-ba47-b9f1194314f7 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7280 deselected in 284.02s (0:04:44) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3761892

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3762442.
Stopping expansion service pid: 3762443.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 35m 39s
261 actionable tasks: 179 executed, 72 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/fl4hdn6fxoozc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5080

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5080/display/redirect>

Changes:


------------------------------------------
[...truncated 1.34 MB...]
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_worker_binary:v1"
      >
    >
  >
  environments: <
    key: "hdsseiqwckbeam:env:docker:v1"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:timer:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:custom_window:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:param_windowed_value:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:sharded_key:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:harness_monitoring_infos:v1"
      capabilities: "beam:protocol:control_request_elements_embedding:v1"
      capabilities: "beam:protocol:state_caching:v1"
      capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-kdmwgmcqeYRetSKD9J4iJK7js8aYz0b1fICfEc5e3TE.jar\022@91d9b082672a79845eb52283f49e2224aee3b3c698cf46f57c809f11ce5edd31"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-kdmwgmcqeYRetSKD9J4iJK7js8aYz0b1fICfEc5e3TE.jar"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/18 20:02:41 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705608161167613568
2024/01/18 20:02:45 Prepared job with id: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640 and staging token: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640
2024/01/18 20:02:45 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640
2024/01/18 20:02:45 Submitted job: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640
2024/01/18 20:02:45 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: STOPPED
2024/01/18 20:02:45 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: STARTING
2024/01/18 20:02:45 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: RUNNING
2024/01/18 20:02:45 2024-01-18 20:02:45. (1): ==================== <function annotate_downstream_side_inputs at 0x7f6e04eab9d0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f6e04eabaf0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (3): ==================== <function pack_combiners at 0x7f6e04ea7040> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (4): ==================== <function lift_combiners at 0x7f6e04ea70d0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (5): ==================== <function expand_sdf at 0x7f6e04ea7280> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (6): ==================== <function expand_gbk at 0x7f6e04ea7310> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (7): ==================== <function sink_flattens at 0x7f6e04ea7430> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (8): ==================== <function greedily_fuse at 0x7f6e04ea74c0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (9): ==================== <function read_to_impulse at 0x7f6e04ea7550> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (10): ==================== <function impulse_to_input at 0x7f6e04ea75e0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (11): ==================== <function sort_stages at 0x7f6e04ea7820> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f6e04ea7940> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (13): ==================== <function setup_timer_mapping at 0x7f6e04ea7790> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (14): ==================== <function populate_data_channel_coders at 0x7f6e04ea78b0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (15): starting control server on port 38163
2024/01/18 20:02:45 2024-01-18 20:02:45. (16): starting data server on port 39715
2024/01/18 20:02:45 2024-01-18 20:02:45. (17): starting state server on port 39347
2024/01/18 20:02:45 2024-01-18 20:02:45. (18): starting logging server on port 44603
2024/01/18 20:02:45 2024-01-18 20:02:45. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6e38640f70> for environment hdsseiqwckbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/18 20:02:45 2024-01-18 20:02:45. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/18 20:02:46 2024-01-18 20:02:46. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/18 20:02:53 2024-01-18 20:02:53. (22): Waiting for docker to start up. Current status is running
2024/01/18 20:02:53 2024-01-18 20:02:53. (23): Docker container is running. container_id = b'5c89b4268cbc31860792abceceb208ceac33bebaacf39a3cf99c04efe8f4841d', worker_id = worker_16
2024/01/18 20:02:54 2024-01-18 20:02:54. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6e39e9a850> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/18 20:02:57 2024-01-18 20:02:57. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/18 20:02:58 2024-01-18 20:02:58. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/18 20:02:59 2024-01-18 20:02:59. (27): Waiting for docker to start up. Current status is running
2024/01/18 20:02:59 2024-01-18 20:02:59. (28): Docker container is running. container_id = b'12f39c122fa79be254846b8b1722355390ffafd2187bf2fd0b8b7f99f54f9e1e', worker_id = worker_18
2024/01/18 20:03:05 2024-01-18 20:03:05. (29): Completed job in 19.60710096359253 seconds with state DONE.
2024/01/18 20:03:05 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: DONE
2024/01/18 20:03:05 🐳 Terminating container: a0218a5340a1
2024/01/18 20:03:05 🚫 Container terminated: a0218a5340a1
--- PASS: TestJDBCIO_PostgresReadWrite (63.56s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	183.796s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.111s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:307
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:328
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:349
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:370
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:285
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:263
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:392
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PythonDependenciesTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:401
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:242
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.ConsecutivePythonTransformsTest > testConsecutivePythonMaps FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ConsecutivePythonTransformsTest.java:44
    java.lang.NullPointerException at Preconditions.java:1010

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33431
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp9q1iqf4g/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 37919
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest > testDataframeSum FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at DataframeTransformTest.java:50
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonMap FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at PythonMapTest.java:41
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at PythonMapTest.java:54
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInferenceWithKVs FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at RunInferenceTransformTest.java:108
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at RunInferenceTransformTest.java:60
    java.lang.NullPointerException at Preconditions.java:1010

17 tests completed, 15 failed

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 55s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/32zcl5zt6rlbe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5079

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5079/display/redirect>

Changes:


------------------------------------------
[...truncated 1.80 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:23 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:24 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:24 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:26 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:26 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:26 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe829146430> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe8291464c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe829146c10> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f650e8da1f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f650e8da310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f650e8da820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f650e8da8b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f650e8daa60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f650e8daaf0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f650e8dac10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f650e8daca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f650e8dad30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f650e8dadc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f650e8db040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f650e8db160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f650e8daf70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f650e8db0d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 43865
INFO     root:portable_runner.py:543 starting data server on port 40477
INFO     root:portable_runner.py:543 starting state server on port 41807
INFO     root:portable_runner.py:543 starting logging server on port 37323
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6543861b50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'a256318e4ae857aba3820934876d54ddcf2808e49ad94abff036744a452426fa', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f6543895460> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:40141')
INFO     root:portable_runner.py:543 Requesting worker at localhost:40141
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:38 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:43865.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:47 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:47 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-d1aa053d-d8bb-428f-b7b9-128631980a61 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 287.64s (0:04:47) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1166213

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1182478.
Stopping expansion service pid: 1182479.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 42m
261 actionable tasks: 180 executed, 71 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/qtnjyooj2oj5y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5078

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5078/display/redirect?page=changes>

Changes:

[noreply] GCS autosharding flag (#29886)


------------------------------------------
[...truncated 1.64 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:49 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff802c48430> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff802c484c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff802c48c10> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4f058b51f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4f058b5310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4f058b5820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4f058b58b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4f058b5a60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4f058b5af0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4f058b5c10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4f058b5ca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4f058b5d30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4f058b5dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4f058b6040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4f058b6160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4f058b5f70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4f058b60d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 43089
INFO     root:portable_runner.py:543 starting data server on port 42737
INFO     root:portable_runner.py:543 starting state server on port 39889
INFO     root:portable_runner.py:543 starting logging server on port 42097
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4f350b6820> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'7c053c20d0d8cba3e572acab7f75fae1b9d60abf3f1d476998a5d27fbf39a5e4', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f4f3a130f70> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:41677')
INFO     root:portable_runner.py:543 Requesting worker at localhost:41677
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:02:04 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:43089.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:02:14 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:02:14 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-3a9596fa-4ab4-48a5-a640-e5264e0f2a16 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 323.87s (0:05:23) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3847991

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3861358.
Stopping expansion service pid: 3861359.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 39m 3s
261 actionable tasks: 182 executed, 69 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/ictkzwzjyraxw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5077

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5077/display/redirect>

Changes:


------------------------------------------
[...truncated 1.81 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:03 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:03 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:04 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa37f7e3430> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa37f7e34c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa37f7e3c10> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f0ee1f5a1f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f0ee1f5a310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f0ee1f5a820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f0ee1f5a8b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f0ee1f5aa60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f0ee1f5aaf0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f0ee1f5ac10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f0ee1f5aca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f0ee1f5ad30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f0ee1f5adc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f0ee1f5b040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f0ee1f5b160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f0ee1f5af70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f0ee1f5b0d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 36527
INFO     root:portable_runner.py:543 starting data server on port 42353
INFO     root:portable_runner.py:543 starting state server on port 44579
INFO     root:portable_runner.py:543 starting logging server on port 33385
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0f167f0df0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'170ba6809c855fd7e73d8a5f50124bdc5bb8b86dae73609173f6b2184cd60904', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f0f167b2b20> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:48285')
INFO     root:portable_runner.py:543 Requesting worker at localhost:48285
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:17 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:36527.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:26 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:26 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-888fb3fb-b9cc-4d77-8900-ae70d8173fee failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 298.72s (0:04:58) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2525790

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2537618.
Stopping expansion service pid: 2537619.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 44s
261 actionable tasks: 176 executed, 75 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/pdzrx7too23ws

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5076

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5076/display/redirect>

Changes:


------------------------------------------
[...truncated 1.77 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING  root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:33371.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f449247e430> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f449247e4c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f449247ec10> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fdf9b4fb1f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fdf9b4fb310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fdf9b4fb820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fdf9b4fb8b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fdf9b4fba60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fdf9b4fbaf0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fdf9b4fbc10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fdf9b4fbca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fdf9b4fbd30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fdf9b4fbdc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7fdf9b4fc040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fdf9b4fc160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fdf9b4fbf70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fdf9b4fc0d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 33895
INFO     root:portable_runner.py:543 starting data server on port 43791
INFO     root:portable_runner.py:543 starting state server on port 35965
INFO     root:portable_runner.py:543 starting logging server on port 41741
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdfd05952b0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'644703cc7eea5cbd33a2f0f2b6826f911a1ec47dd57a54ffd4ab98c92aef2e27', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fdfcfd0aa60> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:33371')
INFO     root:portable_runner.py:543 Requesting worker at localhost:33371
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:55:09 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:33895.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:55:20 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:55:20 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-96ee2fe7-ec79-448b-90c6-1e74b78744f7 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 339.22s (0:05:39) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1345264

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1352508.
Stopping expansion service pid: 1352509.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 44m 36s
261 actionable tasks: 221 executed, 30 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/mtxowiwv6ohcc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5075

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5075/display/redirect?page=changes>

Changes:

[noreply] Additional test for windmill OrderedListState implementation. (#29970)


------------------------------------------
[...truncated 1.34 MB...]
      >
      component_coder_ids: "bPNbGtuZnoVarIntCoder"
      component_coder_ids: "bPNbGtuZnoIterableCoder"
    >
  >
  coders: <
    key: "bPNbGtuZnoRowCoder"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\004\022$52ed2d85-aabb-4b04-9956-1a27f0ac6b3c"
      >
    >
  >
  coders: <
    key: "bPNbGtuZnoVarIntCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "bPNbGtuZnoVoidCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
      >
    >
  >
  environments: <
    key: "bPNbGtuZnobeam:env:docker:v1"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:timer:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:custom_window:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:param_windowed_value:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:sharded_key:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:harness_monitoring_infos:v1"
      capabilities: "beam:protocol:control_request_elements_embedding:v1"
      capabilities: "beam:protocol:state_caching:v1"
      capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar\022@82eef683ad89f017364dbc2b986b39254bd67e34f5f819f6d5565ec4593abd03"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar"
      >
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:worker_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_worker_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/17 11:24:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705490645841044530
2024/01/17 11:24:08 Prepared job with id: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d and staging token: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d
2024/01/17 11:24:09 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d
2024/01/17 11:24:09 Submitted job: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d
2024/01/17 11:24:09 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: STOPPED
2024/01/17 11:24:09 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: STARTING
2024/01/17 11:24:09 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: RUNNING
2024/01/17 11:24:09 2024-01-17 11:24:09. (1): ==================== <function annotate_downstream_side_inputs at 0x7f1814e801f0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f1814e80310> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (3): ==================== <function pack_combiners at 0x7f1814e80820> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (4): ==================== <function lift_combiners at 0x7f1814e808b0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (5): ==================== <function expand_sdf at 0x7f1814e80a60> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (6): ==================== <function expand_gbk at 0x7f1814e80af0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (7): ==================== <function sink_flattens at 0x7f1814e80c10> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (8): ==================== <function greedily_fuse at 0x7f1814e80ca0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (9): ==================== <function read_to_impulse at 0x7f1814e80d30> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (10): ==================== <function impulse_to_input at 0x7f1814e80dc0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (11): ==================== <function sort_stages at 0x7f1814e81040> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f1814e81160> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (13): ==================== <function setup_timer_mapping at 0x7f1814e80f70> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (14): ==================== <function populate_data_channel_coders at 0x7f1814e810d0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (15): starting control server on port 36883
2024/01/17 11:24:09 2024-01-17 11:24:09. (16): starting data server on port 42593
2024/01/17 11:24:09 2024-01-17 11:24:09. (17): starting state server on port 33969
2024/01/17 11:24:09 2024-01-17 11:24:09. (18): starting logging server on port 35753
2024/01/17 11:24:09 2024-01-17 11:24:09. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1846e912e0> for environment bPNbGtuZnobeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/17 11:24:12 2024-01-17 11:24:12. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/17 11:24:12 2024-01-17 11:24:12. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/17 11:24:14 2024-01-17 11:24:14. (22): Waiting for docker to start up. Current status is running
2024/01/17 11:24:14 2024-01-17 11:24:14. (23): Docker container is running. container_id = b'9a79cad589ca8336d967548231adbc4d7e6bf4e0632c7576d21848e4d4d7a9b2', worker_id = worker_15
2024/01/17 11:24:15 2024-01-17 11:24:15. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1846e97df0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/17 11:24:18 2024-01-17 11:24:18. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/17 11:24:18 2024-01-17 11:24:18. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/17 11:24:20 2024-01-17 11:24:20. (27): Waiting for docker to start up. Current status is running
2024/01/17 11:24:20 2024-01-17 11:24:20. (28): Docker container is running. container_id = b'0f0911f337b6061744f4573d119a69f0372bab938d759b1e28d88519d7514d10', worker_id = worker_17
2024/01/17 11:24:23 2024-01-17 11:24:23. (29): Completed job in 14.699676990509033 seconds with state DONE.
2024/01/17 11:24:23 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: DONE
2024/01/17 11:24:23 🐳 Terminating container: 411648bf09a4
2024/01/17 11:24:23 🚫 Container terminated: 411648bf09a4
--- PASS: TestJDBCIO_PostgresReadWrite (46.98s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	139.762s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.073s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36227
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp9ggjjfz5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33763
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 44s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/7vtpyak3eaanw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5074

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5074/display/redirect>

Changes:


------------------------------------------
[...truncated 1.34 MB...]
      >
      component_coder_ids: "DeYAOnKxWZVarIntCoder"
      component_coder_ids: "DeYAOnKxWZIterableCoder"
    >
  >
  coders: <
    key: "DeYAOnKxWZRowCoder"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\004\022$5640da34-f5af-4a10-b3d3-28a3833cd069"
      >
    >
  >
  coders: <
    key: "DeYAOnKxWZVarIntCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "DeYAOnKxWZVoidCoder"
    value: <
      spec: <
        urn: "beam:coders:javasdk:0.1"
        payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
      >
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:row:v1"
        payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
      >
    >
  >
  environments: <
    key: "DeYAOnKxWZbeam:env:docker:v1"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:timer:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:custom_window:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:param_windowed_value:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:sharded_key:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:harness_monitoring_infos:v1"
      capabilities: "beam:protocol:control_request_elements_embedding:v1"
      capabilities: "beam:protocol:state_caching:v1"
      capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar\022@82eef683ad89f017364dbc2b986b39254bd67e34f5f819f6d5565ec4593abd03"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar"
      >
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v1"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
      capabilities: "beam:protocol:worker_status:v1"
      capabilities: "beam:protocol:monitoring_info_short_ids:v1"
      capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
      capabilities: "beam:transform:to_string:v1"
      capabilities: "beam:protocol:data_sampling:v1"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      capabilities: "beam:coder:timer:v1"
      dependencies: <
        type_urn: "beam:artifact:type:file:v1"
        role_urn: "beam:artifact:role:go_worker_binary:v1"
      >
    >
  >
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/17 05:32:26 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705469546467463398
2024/01/17 05:32:28 Prepared job with id: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928 and staging token: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928
2024/01/17 05:32:29 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928
2024/01/17 05:32:29 Submitted job: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928
2024/01/17 05:32:29 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: STOPPED
2024/01/17 05:32:29 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: STARTING
2024/01/17 05:32:29 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: RUNNING
2024/01/17 05:32:29 2024-01-17 05:32:29. (1): ==================== <function annotate_downstream_side_inputs at 0x7fcaed4ed1f0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fcaed4ed310> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (3): ==================== <function pack_combiners at 0x7fcaed4ed820> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (4): ==================== <function lift_combiners at 0x7fcaed4ed8b0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (5): ==================== <function expand_sdf at 0x7fcaed4eda60> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (6): ==================== <function expand_gbk at 0x7fcaed4edaf0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (7): ==================== <function sink_flattens at 0x7fcaed4edc10> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (8): ==================== <function greedily_fuse at 0x7fcaed4edca0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (9): ==================== <function read_to_impulse at 0x7fcaed4edd30> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (10): ==================== <function impulse_to_input at 0x7fcaed4eddc0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (11): ==================== <function sort_stages at 0x7fcaed4ee040> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fcaed4ee160> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (13): ==================== <function setup_timer_mapping at 0x7fcaed4edf70> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (14): ==================== <function populate_data_channel_coders at 0x7fcaed4ee0d0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (15): starting control server on port 36351
2024/01/17 05:32:29 2024-01-17 05:32:29. (16): starting data server on port 34265
2024/01/17 05:32:29 2024-01-17 05:32:29. (17): starting state server on port 33409
2024/01/17 05:32:29 2024-01-17 05:32:29. (18): starting logging server on port 36579
2024/01/17 05:32:29 2024-01-17 05:32:29. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcaec2c3160> for environment DeYAOnKxWZbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/17 05:32:32 2024-01-17 05:32:32. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/17 05:32:33 2024-01-17 05:32:33. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/17 05:32:34 2024-01-17 05:32:34. (22): Waiting for docker to start up. Current status is running
2024/01/17 05:32:34 2024-01-17 05:32:34. (23): Docker container is running. container_id = b'2ef963e32c73f75d4e2715420b5ab4b2f0a85521c0ea7ff0ce9987c7cc7dfcb0', worker_id = worker_15
2024/01/17 05:32:35 2024-01-17 05:32:35. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcaec2cf2e0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/17 05:32:37 2024-01-17 05:32:37. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/17 05:32:38 2024-01-17 05:32:38. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/17 05:32:39 2024-01-17 05:32:39. (27): Waiting for docker to start up. Current status is running
2024/01/17 05:32:39 2024-01-17 05:32:39. (28): Docker container is running. container_id = b'2a42a93a9d8efc3131a3d17556c748d838716152d6805720f5c418bfb1829be4', worker_id = worker_17
2024/01/17 05:32:43 2024-01-17 05:32:43. (29): Completed job in 13.82400369644165 seconds with state DONE.
2024/01/17 05:32:43 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: DONE
2024/01/17 05:32:43 🐳 Terminating container: 0c03b199c459
2024/01/17 05:32:43 🚫 Container terminated: 0c03b199c459
--- PASS: TestJDBCIO_PostgresReadWrite (40.60s)
FAIL
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc	111.100s
=== RUN   TestKafkaIO_BasicReadWrite
    integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok  	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka	6.041s
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35399
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpwezm6slu/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39151
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 35m 55s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/cdrouuklkywfo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5073

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5073/display/redirect>

Changes:


------------------------------------------
[...truncated 1.78 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:13 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:14 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:15 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:16 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:16 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f58406c14c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f58406c1550> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f58406c1ca0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f9756d181f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f9756d18310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f9756d18820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f9756d188b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f9756d18a60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f9756d18af0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f9756d18c10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f9756d18ca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f9756d18d30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f9756d18dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f9756d19040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f9756d19160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f9756d18f70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f9756d190d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 33515
INFO     root:portable_runner.py:543 starting data server on port 38699
INFO     root:portable_runner.py:543 starting state server on port 34929
INFO     root:portable_runner.py:543 starting logging server on port 33345
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f978b47abb0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'5e28ebddc9d689ab70539e87246fcecb801e5034006738dedb64638de0ad0f95', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f978b555880> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:35651')
INFO     root:portable_runner.py:543 Requesting worker at localhost:35651
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:27 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:33515.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:36 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:36 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-7cfb5472-e9ae-49e6-a41e-ed44f7f9215a failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 297.30s (0:04:57) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1572938

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1584666.
Stopping expansion service pid: 1584667.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 54s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/ssw6n3nd7pdkg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5072

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5072/display/redirect>

Changes:


------------------------------------------
[...truncated 1.81 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:52 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fac0dfed4c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fac0dfed550> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fac0dfedca0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f9dab6ba1f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f9dab6ba310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f9dab6ba820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f9dab6ba8b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f9dab6baa60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f9dab6baaf0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f9dab6bac10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f9dab6baca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f9dab6bad30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f9dab6badc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f9dab6bb040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f9dab6bb160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f9dab6baf70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f9dab6bb0d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 35161
INFO     root:portable_runner.py:543 starting data server on port 34769
INFO     root:portable_runner.py:543 starting state server on port 41083
INFO     root:portable_runner.py:543 starting logging server on port 38149
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9dd37aa1f0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'8b022aeb4ccb253700a2c4fd6334217c210c5968ae7f48f128c22ed0da558d60', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f9de06871c0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:60771')
INFO     root:portable_runner.py:543 Requesting worker at localhost:60771
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:48:06 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:35161.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:48:16 PM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:48:16 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-653e6f48-d81b-4882-ae41-f5008aa36c15 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 300.73s (0:05:00) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 394428

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 402477.
Stopping expansion service pid: 402478.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 33s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/t7wxxssglyceo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #5071

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5071/display/redirect?page=changes>

Changes:

[noreply] Add a read timeout and cache BigQueryIOMetadata (#29662)


------------------------------------------
[...truncated 1.80 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:generate_sequence:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 	beam:schematransform:org.apache.beam:yaml:explode:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:49 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 
INFO     root:environments.py:318 No image given, using default Python SDK image
INFO     root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f3d69f191f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f3d69f19280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f3d69f199d0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO     root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f1aea1491f0> ====================
INFO     root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f1aea149310> ====================
INFO     root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f1aea149820> ====================
INFO     root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f1aea1498b0> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f1aea149a60> ====================
INFO     root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f1aea149af0> ====================
INFO     root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f1aea149c10> ====================
INFO     root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f1aea149ca0> ====================
INFO     root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f1aea149d30> ====================
INFO     root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f1aea149dc0> ====================
INFO     root:portable_runner.py:543 ==================== <function sort_stages at 0x7f1aea14a040> ====================
INFO     root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f1aea14a160> ====================
INFO     root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f1aea149f70> ====================
INFO     root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f1aea14a0d0> ====================
INFO     root:portable_runner.py:543 starting control server on port 44663
INFO     root:portable_runner.py:543 starting data server on port 40005
INFO     root:portable_runner.py:543 starting state server on port 38871
INFO     root:portable_runner.py:543 starting logging server on port 34679
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1b1e9e8f70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO     root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO     root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:543 Docker container is running. container_id = b'7546b4b940dbc2caa9d980f54511d68b9469e5589f957c827686dd7d14c882a7', worker_id = worker_89
INFO     root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f1b1f091040> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:55951')
INFO     root:portable_runner.py:543 Requesting worker at localhost:55951
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:03 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:44663.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **  "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:12 AM org.apache.beam.fn.harness.FnHarness main
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:12 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR    root:portable_runner.py:543 Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'

ERROR    root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-595c4e0c-c175-4b9c-b1a6-cc85b33b1766 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
    self.result = self._invoke_runner()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
    return fn_runner.FnApiRunner(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
    bundle_results = self._execute_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
    self._run_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
    self._send_input_to_worker(process_bundle_id, transform_id, elements)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
    for byte_stream in (byte_streams or []):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
    return itertools.chain(*self.partition(1))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
    for wkvs in windowed_key_values(key, windowed_values):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
    for wvalue in self.process_elements(state,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
    if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 292.21s (0:04:52) =====

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3407493

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3418929.
Stopping expansion service pid: 3418930.

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 38m 29s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/iz5w22asgkxak

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org