You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/12/08 00:48:06 UTC
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1222
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1222/display/redirect?page=changes>
Changes:
[noreply] pubsub: fix typo in grpc client factory
[Kenneth Knowles] Suppress keyfor warnings
[Kenneth Knowles] Suppress checker warnings that are confusing and difficult
[Kenneth Knowles] Add @Pure annotations to MongoDbIO autovalue fields
[Kenneth Knowles] Suppress checker in FnApiDoFnRunner due to crash
[Kenneth Knowles] Suppress checker framework in Dataflow
[Kenneth Knowles] Fix some nullness errors in Spark runner
[Kenneth Knowles] Upgrade checker framework to 3.27.0
[noreply] Samza runner support for non unique stateId across multiple ParDos
[noreply] Bump to Hadoop 3.3.4 for performance tests (#24550)
[noreply] regenerate python dependencies (#24582)
------------------------------------------
[...truncated 428.90 KB...]
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/1922375555/lib/python3.10/site-packages/httplib2/__init__.py:147: 64 warnings
apache_beam/transforms/sql_test.py: 27 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/httplib2/__init__.py>:147: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated
context = ssl.SSLContext(DEFAULT_TLS_VERSION)
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
============ 9 failed, 5 skipped, 140 warnings in 987.96s (0:16:27) ============
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208001754
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da1b4c6443a384eef4a4ccd4cff46b860f8fdf07ae14c0c4eb0f99f05e1e11c4
Deleted: sha256:41a7383688d57c78d0479ea06391477d2dfbeda26e4b64f963bb41b096ba1e4b
Deleted: sha256:b84cd4dc1c3508935a5b8b4ab8d51f74d2a3c44d18a07db20462d4882349e886
Deleted: sha256:371c5f6311e2ca4da82243c95b098c6249ac313ecf5fadf12df2d8e3980417bc
Deleted: sha256:48353466620953c9d435c992d48c26c2e52c2be45dd3121ee552c27bd30156f7
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208001754]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da1b4c6443a384eef4a4ccd4cff46b860f8fdf07ae14c0c4eb0f99f05e1e11c4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208001754] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da1b4c6443a384eef4a4ccd4cff46b860f8fdf07ae14c0c4eb0f99f05e1e11c4])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da1b4c6443a384eef4a4ccd4cff46b860f8fdf07ae14c0c4eb0f99f05e1e11c4
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da1b4c6443a384eef4a4ccd4cff46b860f8fdf07ae14c0c4eb0f99f05e1e11c4
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:da1b4c6443a384eef4a4ccd4cff46b860f8fdf07ae14c0c4eb0f99f05e1e11c4].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208001754
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4447b1c40b3f11c17c2f362713ffa97eb9a95410494c6948fc1ef2c11a7824f3
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208001754]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4447b1c40b3f11c17c2f362713ffa97eb9a95410494c6948fc1ef2c11a7824f3]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208001754] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4447b1c40b3f11c17c2f362713ffa97eb9a95410494c6948fc1ef2c11a7824f3])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4447b1c40b3f11c17c2f362713ffa97eb9a95410494c6948fc1ef2c11a7824f3
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4447b1c40b3f11c17c2f362713ffa97eb9a95410494c6948fc1ef2c11a7824f3
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4447b1c40b3f11c17c2f362713ffa97eb9a95410494c6948fc1ef2c11a7824f3].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 919164.
Stopping expansion service pid: 919165.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 30m 27s
168 actionable tasks: 115 executed, 47 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/5ldoapwdkunci
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1230
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1230/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1229
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1229/display/redirect?page=changes>
Changes:
[noreply] interface{} -> any for registration (#24600)
[noreply] Restrict tox to be in 3.x version (#24601)
[noreply] [Playground] support for Kafka-enabled examples (#24459)
[noreply] Fix some small notebook typos (#24616)
------------------------------------------
[...truncated 554.70 KB...]
google-api-core==2.11.0
google-api-python-client==2.68.0
google-apitools==0.5.31
google-auth==2.15.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
nltk==3.7
nose==1.3.7
numpy==1.22.4
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.5.2
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.3
scipy==1.9.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zstandard==0.19.0
Removing intermediate container 5d1b3cb9fff3
---> acaeab34dc32
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> f7b149ad2fe6
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 46189430a949
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 298f2273ae97
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 5669970ef88f
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 06f153f27f1f
Removing intermediate container 06f153f27f1f
---> 542638f6ad79
Step 22/32 : FROM beam as third_party_licenses
---> 542638f6ad79
Step 23/32 : ARG pull_licenses
---> Running in 4590aa2de700
Removing intermediate container 4590aa2de700
---> 07f084ca1fc8
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 871a2dd98c7e
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 1df94cd1a2b1
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 0222046728e8
Removing intermediate container 0222046728e8
---> 508f0445ece1
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> ff3e6d297251
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in ff8126f8dd16
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=aec9e80d11866b9612ec567fb53ab556adf7f10c3861185529d70ab96f322456
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mRemoving intermediate container ff8126f8dd16
---> 7dd0867da47a
Step 29/32 : FROM beam
---> 542638f6ad79
Step 30/32 : ARG pull_licenses
---> Running in 86f400a744b6
Removing intermediate container 86f400a744b6
---> 1ad4f8af794e
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 1e61d3fcc1a2
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 15724dc60bb4
Removing intermediate container 15724dc60bb4
---> 6f8acb66bbf8
Successfully built 6f8acb66bbf8
Successfully tagged apache/beam_python3.10_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209181747]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32edca65e2cfe93908704e442248c67dc4b85bdc4638120e5cfef73b3125a84b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209181747] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32edca65e2cfe93908704e442248c67dc4b85bdc4638120e5cfef73b3125a84b])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32edca65e2cfe93908704e442248c67dc4b85bdc4638120e5cfef73b3125a84b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:32edca65e2cfe93908704e442248c67dc4b85bdc4638120e5cfef73b3125a84b].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209181747]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:169637510e2da2ebe41c19bb65cc47f99f31c25c80e8725a5d6ea9e67850458f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209181747] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:169637510e2da2ebe41c19bb65cc47f99f31c25c80e8725a5d6ea9e67850458f])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:169637510e2da2ebe41c19bb65cc47f99f31c25c80e8725a5d6ea9e67850458f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:169637510e2da2ebe41c19bb65cc47f99f31c25c80e8725a5d6ea9e67850458f].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 39m 22s
168 actionable tasks: 114 executed, 48 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/s7dvhzsgo24yo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1228
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1228/display/redirect>
Changes:
------------------------------------------
[...truncated 517.05 KB...]
google-api-core==2.11.0
google-api-python-client==2.68.0
google-apitools==0.5.31
google-auth==2.15.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
nltk==3.7
nose==1.3.7
numpy==1.22.4
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.5.2
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.3
scipy==1.9.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zstandard==0.19.0
Removing intermediate container e370c8362754
---> b1d246263602
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 7135987284cc
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> deaa76dc7bbb
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> a5beb364f3c9
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 295ff91dcd4d
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in bd069a5b78d6
Removing intermediate container bd069a5b78d6
---> 411dbe3503b6
Step 22/32 : FROM beam as third_party_licenses
---> 411dbe3503b6
Step 23/32 : ARG pull_licenses
---> Running in ed3aafc2b49b
Removing intermediate container ed3aafc2b49b
---> 99db11054481
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> 75103b9d9cd2
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> ddf46c066633
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 9f350603a3f1
Removing intermediate container 9f350603a3f1
---> 578933845ba5
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 2fffb5c2fa64
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 6991f4bcefa2
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=866cbe093d0054b8dcaaab1090831f69075ceb3eb0fc31edcfddc83421a3450c
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mRemoving intermediate container 6991f4bcefa2
---> 2a4e5a10d8ae
Step 29/32 : FROM beam
---> 411dbe3503b6
Step 30/32 : ARG pull_licenses
---> Running in aee473615397
Removing intermediate container aee473615397
---> 32b190fe4344
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> d107b31378e5
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 1fbc18a8ae8c
Removing intermediate container 1fbc18a8ae8c
---> b5e52e930497
Successfully built b5e52e930497
Successfully tagged apache/beam_python3.10_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209121749]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2dac57a02ee0446e35013b41c8d1de55e018c34e278b23e4729ae9a871c15d5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209121749] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2dac57a02ee0446e35013b41c8d1de55e018c34e278b23e4729ae9a871c15d5])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2dac57a02ee0446e35013b41c8d1de55e018c34e278b23e4729ae9a871c15d5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:c2dac57a02ee0446e35013b41c8d1de55e018c34e278b23e4729ae9a871c15d5].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209121749]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b2faa16e85c3d1ff82844d7d9b4ef40bb7dc1c04cafe969b8751cd9ec19f7a5d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209121749] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b2faa16e85c3d1ff82844d7d9b4ef40bb7dc1c04cafe969b8751cd9ec19f7a5d])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b2faa16e85c3d1ff82844d7d9b4ef40bb7dc1c04cafe969b8751cd9ec19f7a5d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b2faa16e85c3d1ff82844d7d9b4ef40bb7dc1c04cafe969b8751cd9ec19f7a5d].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 33m 34s
168 actionable tasks: 115 executed, 47 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/dvau3pp4z53nq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1227
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1227/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Turn rawtype checking back on for core Java SDK
[hiandyzhang] ElasticsearchIO: Lower log level in flushBatch to avoid noisy log
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-2 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 58b4d46655d94374f3d3564752dc12eb98b95456 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 58b4d46655d94374f3d3564752dc12eb98b95456 # timeout=10
Commit message: "Merge pull request #24574: Turn rawtype checking back on for core Java SDK"
> git rev-list --no-walk b8a335be8abace2d44418f858533ef905297e244 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow] $ /bin/bash -xe /tmp/jenkins5809877386817787390.sh
+ echo '*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA SQL TRANSFORMS USING PYTHON 3.10 ***'
*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA SQL TRANSFORMS USING PYTHON 3.10 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.10 :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy FROM-CACHE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle FROM-CACHE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins FROM-CACHE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.19.3
go install golang.org/dl/go1.19.3@latest: no matching versions for query "latest"
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:java:container:goBuild'.
> Could not create task ':sdks:java:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 1s
10 actionable tasks: 4 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yptmju6jhpegk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1226
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1226/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Exclude IOs already split from Java Precommit job
[Kenneth Knowles] Move expansion services into appropriate precommits
[Kenneth Knowles] Split more IOs out of Java precommit
[Kenneth Knowles] Fix trigger paths for separated IOs
[Kenneth Knowles] Simplify bug report templates
[Kenneth Knowles] Fix bugs in issue template yml
[noreply] Fix issue templates (#24597)
[noreply] [#24024] Stop wrapping light weight functions with Contextful as they
[noreply] Sample window size as well (#24388)
[noreply] Implement Kafka Write Schema Transform (#24495)
[Kenneth Knowles] Eliminate null errors from JdbcIO
[noreply] docs(fix): Filter.whereFieldName(s?) ->
------------------------------------------
[...truncated 517.41 KB...]
google-api-core==2.11.0
google-api-python-client==2.68.0
google-apitools==0.5.31
google-auth==2.15.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
nltk==3.7
nose==1.3.7
numpy==1.22.4
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.5.2
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.3
scipy==1.9.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zstandard==0.19.0
Removing intermediate container 49b6e9ecedbd
---> fe7502cf8e62
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 98380f0655e1
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> f5660414f209
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> bb30f3165de5
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 097695313f7a
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 715354bbfc75
Removing intermediate container 715354bbfc75
---> a09d794610c2
Step 22/32 : FROM beam as third_party_licenses
---> a09d794610c2
Step 23/32 : ARG pull_licenses
---> Running in ce80b2741927
Removing intermediate container ce80b2741927
---> 3d505e56a97a
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> c93bfd1f95e5
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 5dd8d4509e09
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 04e381c01a99
Removing intermediate container 04e381c01a99
---> d1ee18cb48c3
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> 9974dd2d5966
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in 73bd78f6a1c6
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=475e5298796882af4b18ceead11745d87595f2ee661a39faf1fe100e765e8125
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mRemoving intermediate container 73bd78f6a1c6
---> ebe820832980
Step 29/32 : FROM beam
---> a09d794610c2
Step 30/32 : ARG pull_licenses
---> Running in 8d20890b129a
Removing intermediate container 8d20890b129a
---> 8436ff05d16c
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 7531ee6825a2
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in b9cefae1af5a
Removing intermediate container b9cefae1af5a
---> 99464b442299
Successfully built 99464b442299
Successfully tagged apache/beam_python3.10_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209001729]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14f78089b2a546879a2aedf4ff097a3611ef1c76eefe46bba389478cd7f84dac]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221209001729] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14f78089b2a546879a2aedf4ff097a3611ef1c76eefe46bba389478cd7f84dac])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14f78089b2a546879a2aedf4ff097a3611ef1c76eefe46bba389478cd7f84dac
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14f78089b2a546879a2aedf4ff097a3611ef1c76eefe46bba389478cd7f84dac].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209001729]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:056f8240aeff57307938e5e3ed87133877d2161e53ed256f1d7225b6dff2944c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221209001729] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:056f8240aeff57307938e5e3ed87133877d2161e53ed256f1d7225b6dff2944c])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:056f8240aeff57307938e5e3ed87133877d2161e53ed256f1d7225b6dff2944c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:056f8240aeff57307938e5e3ed87133877d2161e53ed256f1d7225b6dff2944c].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 32m
168 actionable tasks: 116 executed, 46 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/mucjjyobikguy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1225
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1225/display/redirect?page=changes>
Changes:
[noreply] [Tour Of Beam] Playground Router GRPC API host (#24542)
[noreply] Bump golang.org/x/net from 0.3.0 to 0.4.0 in /sdks (#24587)
[noreply] Replaced finalize with DoFn Teardown in Neo4jIO (#24571)
------------------------------------------
[...truncated 455.39 KB...]
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:1552 Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2022-12-08_10_40_26-9982826075831059323?project=<ProjectId>
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/1922375555/lib/python3.10/site-packages/httplib2/__init__.py:147: 64 warnings
apache_beam/transforms/sql_test.py: 27 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/httplib2/__init__.py>:147: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated
context = ssl.SSLContext(DEFAULT_TLS_VERSION)
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
=========== 9 failed, 5 skipped, 140 warnings in 1119.73s (0:18:39) ============
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208181752
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14201eb4ca149b26141e64d58e1aca023735a8b201247e1589a67d1dab40157d
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208181752]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14201eb4ca149b26141e64d58e1aca023735a8b201247e1589a67d1dab40157d]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208181752] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14201eb4ca149b26141e64d58e1aca023735a8b201247e1589a67d1dab40157d])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14201eb4ca149b26141e64d58e1aca023735a8b201247e1589a67d1dab40157d
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14201eb4ca149b26141e64d58e1aca023735a8b201247e1589a67d1dab40157d
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:14201eb4ca149b26141e64d58e1aca023735a8b201247e1589a67d1dab40157d].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208181752
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb803821a1ea6d43f254e9ff1a11c3a6798713c3d8014557e5463807975e2d15
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208181752]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb803821a1ea6d43f254e9ff1a11c3a6798713c3d8014557e5463807975e2d15]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208181752] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb803821a1ea6d43f254e9ff1a11c3a6798713c3d8014557e5463807975e2d15])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb803821a1ea6d43f254e9ff1a11c3a6798713c3d8014557e5463807975e2d15
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb803821a1ea6d43f254e9ff1a11c3a6798713c3d8014557e5463807975e2d15
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb803821a1ea6d43f254e9ff1a11c3a6798713c3d8014557e5463807975e2d15].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1254286.
Stopping expansion service pid: 1254287.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 31m 35s
168 actionable tasks: 114 executed, 48 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/gffibnvdjnpb6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1224
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1224/display/redirect>
Changes:
------------------------------------------
[...truncated 914.41 KB...]
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:1552 Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2022-12-08_04_46_37-4564037793138986203?project=<ProjectId>
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/1922375555/lib/python3.10/site-packages/httplib2/__init__.py:147: 64 warnings
apache_beam/transforms/sql_test.py: 27 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/httplib2/__init__.py>:147: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated
context = ssl.SSLContext(DEFAULT_TLS_VERSION)
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/batchworker.py", line 648, in do_work
work_executor.execute()
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/executor.py", line 208, in execute
op.start()
File "dataflow_worker/shuffle_operations.py", line 154, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 156, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "dataflow_worker/shuffle_operations.py", line 169, in dataflow_worker.shuffle_operations.ShuffleWriteOperation.start
File "/usr/local/lib/python3.10/site-packages/dataflow_worker/shuffle.py", line 589, in __enter__
raise RuntimeError(_PYTHON_310_SHUFFLE_ERROR_MESSAGE)
RuntimeError: This pipeline requires Dataflow Runner v2 in order to run with currently used version of Apache Beam on Python 3.10+. Please verify that the Dataflow Runner v2 is not disabled in the pipeline options or enable it explicitly via: --dataflow_service_option=use_runner_v2. Alternatively, downgrade to Python 3.9 to use Dataflow Runner v1.
=========== 9 failed, 5 skipped, 140 warnings in 1057.84s (0:17:37) ============
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208121908
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:95beefcbe045b9b0d78f0f33bd163f54357408be0ce8be64deb66f683addae48
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208121908]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:95beefcbe045b9b0d78f0f33bd163f54357408be0ce8be64deb66f683addae48]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208121908] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:95beefcbe045b9b0d78f0f33bd163f54357408be0ce8be64deb66f683addae48])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:95beefcbe045b9b0d78f0f33bd163f54357408be0ce8be64deb66f683addae48
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:95beefcbe045b9b0d78f0f33bd163f54357408be0ce8be64deb66f683addae48
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:95beefcbe045b9b0d78f0f33bd163f54357408be0ce8be64deb66f683addae48].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208121908
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7e27d17913fd9519f284614b2c437dac3ee6d545ceef27ee0d98c9ed82c95590
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208121908]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7e27d17913fd9519f284614b2c437dac3ee6d545ceef27ee0d98c9ed82c95590]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208121908] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7e27d17913fd9519f284614b2c437dac3ee6d545ceef27ee0d98c9ed82c95590])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7e27d17913fd9519f284614b2c437dac3ee6d545ceef27ee0d98c9ed82c95590
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7e27d17913fd9519f284614b2c437dac3ee6d545ceef27ee0d98c9ed82c95590
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7e27d17913fd9519f284614b2c437dac3ee6d545ceef27ee0d98c9ed82c95590].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1084234.
Stopping expansion service pid: 1084235.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 35m 55s
168 actionable tasks: 114 executed, 48 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/blyc5zt2gk7so
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #1223
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/1223/display/redirect?page=changes>
Changes:
[noreply] Return empty splits if unable to split, not errors (#24508)
------------------------------------------
[...truncated 534.27 KB...]
google-api-core==2.11.0
google-api-python-client==2.68.0
google-apitools==0.5.31
google-auth==2.15.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
nltk==3.7
nose==1.3.7
numpy==1.22.4
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.5.2
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.1.3
scipy==1.9.3
setuptools==65.6.3
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zstandard==0.19.0
Removing intermediate container 1d92b31d15ea
---> ec3eb0e1e5c9
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 788d0014e138
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 65c8f9b9621a
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> cfaa5ca30c69
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> c34676cdcba7
Step 21/32 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 1aacce2926c6
Removing intermediate container 1aacce2926c6
---> 166fc96695e6
Step 22/32 : FROM beam as third_party_licenses
---> 166fc96695e6
Step 23/32 : ARG pull_licenses
---> Running in 0cfc32cc7a66
Removing intermediate container 0cfc32cc7a66
---> 2500608610f7
Step 24/32 : COPY target/license_scripts /tmp/license_scripts/
---> b6c84b9dca51
Step 25/32 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> c0c614079d89
Step 26/32 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 0fd87cc17250
Removing intermediate container 0fd87cc17250
---> 8c7607036032
Step 27/32 : COPY target/license_scripts /tmp/license_scripts/
---> b6cecc0e9588
Step 28/32 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in a11e3e1e55ba
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.5-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.10/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.10/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22908 sha256=c15196fa223d60a38837fc1b2c5c7eb218b1d6aa275af5dc970f9345134fa61f
Stored in directory: /root/.cache/pip/wheels/62/2a/42/c655cf57d84ab59535337af009892aaf16256a813826b465f7
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.5
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mRemoving intermediate container a11e3e1e55ba
---> 3306cc8ef265
Step 29/32 : FROM beam
---> 166fc96695e6
Step 30/32 : ARG pull_licenses
---> Running in 111419ba2527
Removing intermediate container 111419ba2527
---> 0cca76d05ffd
Step 31/32 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> c86d788945ae
Step 32/32 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 1a08e388006b
Removing intermediate container 1a08e388006b
---> 0a9b51ee123c
Successfully built 0a9b51ee123c
Successfully tagged apache/beam_python3.10_sdk:2.45.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208061745]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:922e9c0987c2b33bcca9467df6f9f70125e835acbd151cf50d19075f935f6fbe]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20221208061745] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:922e9c0987c2b33bcca9467df6f9f70125e835acbd151cf50d19075f935f6fbe])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:922e9c0987c2b33bcca9467df6f9f70125e835acbd151cf50d19075f935f6fbe
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:922e9c0987c2b33bcca9467df6f9f70125e835acbd151cf50d19075f935f6fbe].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208061745]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b856695054edb7dc5870b92abc1ede32eec32adcd1586b2de573b50a1ce1725a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221208061745] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b856695054edb7dc5870b92abc1ede32eec32adcd1586b2de573b50a1ce1725a])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b856695054edb7dc5870b92abc1ede32eec32adcd1586b2de573b50a1ce1725a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b856695054edb7dc5870b92abc1ede32eec32adcd1586b2de573b50a1ce1725a].
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 32m 35s
168 actionable tasks: 116 executed, 46 from cache, 6 up-to-date
Publishing build scan...
https://gradle.com/s/ce7sq4pze7oyc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org