You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/12/25 12:56:18 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Spark #4612

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4612/display/redirect>

Changes:


------------------------------------------
[...truncated 935.86 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:53:53 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:53:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:53:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:53:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:53:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:53:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7efc8e4059e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7efc8e405a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7efc8e406200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7efc507c79d0>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '52159' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:52159
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:55:03 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:55:04 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:55:04 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:55:05 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:55:07 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 12:55:08 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7efc8e4059e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7efc8e405a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7efc8e406200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 654.85s (0:10:54) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 282928.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 292169.
Stopping expansion service pid: 292170.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 48s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/lfdt2thz6mpoq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_Spark #4625

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4625/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4624

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4624/display/redirect?page=changes>

Changes:

[noreply] [Spark Dataset runner] Trigger evaluation using write noop rather than


------------------------------------------
[...truncated 972.45 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:54:52 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:54:54 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:54:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:54:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f27a6c899e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f27a6c89a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f27a6c8a200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7f27685aa850>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '38213' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:38213
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:56:03 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:56:04 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:56:04 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:56:05 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:56:07 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:56:08 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f27a6c899e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f27a6c89a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f27a6c8a200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 697.18s (0:11:37) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 3257272.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3266967.
Stopping expansion service pid: 3266968.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 193

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 58m 45s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/263xevitrrtoo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4623

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4623/display/redirect?page=changes>

Changes:

[noreply] Update Java portable container for Dataflow (#24791)

[noreply] [BigQuery] Extend timestamp precision to microseconds when writing with


------------------------------------------
[...truncated 971.13 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:54:21 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:54:21 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:54:21 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:54:23 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:54:23 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:54:23 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f41f88c19e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f41f88c1a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f41f88c2200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7f41c83f3090>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '58487' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:58487
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:55:31 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:55:33 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:55:33 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:55:33 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:55:35 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 6:55:37 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f41f88c19e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f41f88c1a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f41f88c2200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 691.65s (0:11:31) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 3079036.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3088029.
Stopping expansion service pid: 3088030.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 193

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 58m 14s
267 actionable tasks: 178 executed, 77 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/oanvgg45y5qlw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4622

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4622/display/redirect?page=changes>

Changes:

[noreply] [#24515] Ensure that Go pipelines on Dataflow are not allowed to opt out


------------------------------------------
[...truncated 955.91 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:53:56 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:53:56 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:53:56 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:53:58 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:53:58 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:53:58 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fb2bfd209e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fb2bfd20a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fb2bfd21200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7fb2900ad610>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '56725' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:56725
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:55:06 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:55:08 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:55:08 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:55:08 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:55:10 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 28, 2022 12:55:12 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fb2bfd209e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fb2bfd20a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fb2bfd21200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 655.79s (0:10:55) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 2873380.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2882714.
Stopping expansion service pid: 2882715.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 193

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 53s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/w2bisndoh5tck

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4621

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4621/display/redirect?page=changes>

Changes:

[noreply] [Playground] Python multifile examples (#24751)

[noreply] [CdapIO] Complete examples for CDAP Salesforce plugins (#24567)

[noreply] Make go vet and go staticcheck output visible in CI (#24786)

[noreply] [Go SDK] Fix multimap support for the direct runner (#24775)


------------------------------------------
[...truncated 982.17 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:16 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:16 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:17 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:18 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:19 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:19 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f26724c69e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f26724c6a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f26724c8200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7f2634685810>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '56549' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:56549
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:27 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:28 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:28 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:28 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:30 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:32 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f26724c69e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f26724c6a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f26724c8200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 676.03s (0:11:16) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 2613852.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2623384.
Stopping expansion service pid: 2623385.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 58m 13s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/gliannzrpt4yo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4620

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4620/display/redirect>

Changes:


------------------------------------------
[...truncated 495.77 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:53:36 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:53:36 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:53:36 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:53:38 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:53:38 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:53:38 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fad954029e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fad95402a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fad95403200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7fad6061abd0>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '52629' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:52629
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:46 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:47 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:47 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:48 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:50 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:51 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fad954029e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fad95402a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fad95403200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 654.95s (0:10:54) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 1692823.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1702005.
Stopping expansion service pid: 1702006.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 32s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/wp3cenehismcg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4619

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4619/display/redirect?page=changes>

Changes:

[noreply] [BigQueryIO] Don't update schema of destination table when no schema is


------------------------------------------
[...truncated 962.87 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:18 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:19 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:19 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:21 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:54:21 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe4003019e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe400301a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe400302200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7fe3bc70e790>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '44507' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:44507
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:29 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:30 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:30 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:31 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:33 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 6:55:34 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe4003019e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe400301a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe400302200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 671.00s (0:11:11) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 1506113.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1515417.
Stopping expansion service pid: 1515418.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 58m 11s
267 actionable tasks: 178 executed, 77 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/5t2ussitjzsvq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4618

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4618/display/redirect>

Changes:


------------------------------------------
[...truncated 971.96 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:01 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:02 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:02 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:04 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:04 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:54:04 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f0c028c69e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f0c028c6a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f0c028c7200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7f0bec23a490>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '41083' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:41083
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:55:12 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:55:13 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:55:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:55:14 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:55:16 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 27, 2022 12:55:17 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f0c028c69e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f0c028c6a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f0c028c7200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 661.68s (0:11:01) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 1359308.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1368400.
Stopping expansion service pid: 1368401.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 54s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/dpnm2ddtogpmu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4617

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4617/display/redirect>

Changes:


------------------------------------------
[...truncated 505.40 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:05 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:08 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:08 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:08 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f6cb417f9e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f6cb417fa70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f6cb4181200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7f6c882a6950>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '40819' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:40819
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:55:16 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:55:17 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:55:17 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:55:17 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:55:19 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:55:21 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f6cb417f9e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f6cb417fa70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f6cb4181200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 661.49s (0:11:01) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 1149633.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1159049.
Stopping expansion service pid: 1159050.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 58s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/hywo2575xtzhs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4616

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4616/display/redirect>

Changes:


------------------------------------------
[...truncated 942.92 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:52 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:52 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:52 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:54 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:54 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:54 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe9731479e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe973147a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe973149200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7fe944133210>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '49273' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:49273
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:02 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:03 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:03 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:04 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:06 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:07 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe9731479e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe973147a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe973149200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 657.20s (0:10:57) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 957862.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 967064.
Stopping expansion service pid: 967065.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 44s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/tlwcrwon73jkk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4615

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4615/display/redirect>

Changes:


------------------------------------------
[...truncated 972.24 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:53:39 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:53:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:53:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:53:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:53:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:53:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f349da049e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f349da04a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f349da05200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7f347836c410>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '60261' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:60261
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:49 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:51 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:51 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:51 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:53 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 6:54:55 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f349da049e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f349da04a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f349da05200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 660.98s (0:11:00) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 800494.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 809625.
Stopping expansion service pid: 809626.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 32s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/hltgooknssx3q

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4614

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4614/display/redirect>

Changes:


------------------------------------------
[...truncated 966.48 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:58 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:58 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:53:58 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:54:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:54:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:54:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f8a9fd5e9e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f8a9fd5ea70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f8a9fd61200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7f8a787e2450>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '42237' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:42237
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:08 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:09 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:12 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 26, 2022 12:55:13 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f8a9fd5e9e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f8a9fd5ea70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f8a9fd61200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 659.53s (0:10:59) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 648087.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 657383.
Stopping expansion service pid: 657384.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 50s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/omo6brbztxxmk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Spark #4613

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/4613/display/redirect>

Changes:


------------------------------------------
[...truncated 972.13 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:53:50 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:53:50 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:53:50 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:53:52 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:53:52 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:53:52 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fda200409e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fda20040a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fda20042200> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________

self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>

    def test_zetasql_generate_data(self):
      with TestPipeline() as p:
        out = p | SqlTransform(
            """SELECT
              CAST(1 AS INT64) AS `int`,
              CAST('foo' AS STRING) AS `str`,
              CAST(3.14  AS FLOAT64) AS `flt`""",
            dialect="zetasql")
>       assert_that(out, equal_to([(1, "foo", 3.14)]))

apache_beam/transforms/sql_test.py:160: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/pipeline.py:600: in __exit__
    self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
    False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:577: in run
    return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
    job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
    return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
    grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:151: in result
    self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <grpc._utilities._ChannelReadyFuture object at 0x7fd9f42ab6d0>
timeout = 60

    def _block(self, timeout: Optional[float]) -> None:
        until = None if timeout is None else time.time() + timeout
        with self._condition:
            while True:
                if self._cancelled:
                    raise grpc.FutureCancelledError()
                elif self._matured:
                    return
                else:
                    if until is None:
                        self._condition.wait()
                    else:
                        remaining = until - time.time()
                        if remaining < 0:
>                           raise grpc.FutureTimeoutError()
E                           grpc.FutureTimeoutError

../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:97: FutureTimeoutError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO     root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '35715' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:35715
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:55:00 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:55:02 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:55:02 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:55:02 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:55:04 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 25, 2022 6:55:05 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:299 No image given, using default Python SDK image
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO     root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fda200409e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fda20040a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fda20042200> ====================
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc.FutureTimeoutError
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - grpc.FutureTimeoutError
===== 9 failed, 5 skipped, 6786 deselected, 1 warning in 659.45s (0:10:59) =====

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :runners:spark:2:job-server:sparkJobServerCleanup
Skipping invalid pid: 458360.

> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 467497.
Stopping expansion service pid: 467498.

FAILURE: Build completed with 4 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195

* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 57m 44s
267 actionable tasks: 177 executed, 78 from cache, 12 up-to-date

Publishing build scan...
https://gradle.com/s/tgm777gidlpoi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org