You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/09/06 08:43:54 UTC
Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #652
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/652/display/redirect>
Changes:
------------------------------------------
[...truncated 938.35 KB...]
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1693989731-8fb57c, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@7fedc1a3}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@5613ac8f, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@6ad1874, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@69b47354, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@1eaaef3b, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1693989827
nanos: 190000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1693989827
nanos: 191000000
}
message: "Hanged up for url: \"localhost:42457\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"
586a93e08123a9440c28d5cff11fa23909fdbc2a8e28532ecccc3eb6031597ff
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1693989812-909df0]
[32mPASSED[0m
[1m------------------------------ live log teardown -------------------------------[0m
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1693989731-8fb57c]
=================================== FAILURES ===================================
[31m[1m___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________[0m
self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>
@pytest.mark.uses_gcp_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
def test_model_bigqueryio_xlang(self):
p = TestPipeline()
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
> snippets.model_bigqueryio_xlang(p)
[1m[31mapache_beam/examples/snippets/snippets_test.py[0m:768:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31mapache_beam/examples/snippets/snippets.py[0m:1065: in model_bigqueryio_xlang
quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
[1m[31mapache_beam/pvalue.py[0m:137: in __or__
return self.pipeline.apply(ptransform, self)
[1m[31mapache_beam/pipeline.py[0m:655: in apply
return self.apply(
[1m[31mapache_beam/pipeline.py[0m:666: in apply
return self.apply(transform, pvalueish)
[1m[31mapache_beam/pipeline.py[0m:712: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
[1m[31mapache_beam/runners/runner.py[0m:203: in apply
return self.apply_PTransform(transform, input, options)
[1m[31mapache_beam/runners/runner.py[0m:207: in apply_PTransform
return transform.expand(input)
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2241: in expand
| "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2540: in __init__
expansion_service or _default_io_expansion_service())
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2480: in _default_io_expansion_service
return BeamJarExpansionService(
[1m[31mapache_beam/transforms/external.py[0m:983: in __init__
path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'
@classmethod
def path_to_beam_jar(
cls,
gradle_target,
appendix=None,
version=beam_version,
artifact_id=None):
if gradle_target in cls._BEAM_SERVICES.replacements:
return cls._BEAM_SERVICES.replacements[gradle_target]
gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
if not artifact_id:
artifact_id = 'beam-' + gradle_package.replace(':', '-')
project_root = os.path.sep.join(
os.path.abspath(__file__).split(os.path.sep)[:-5])
local_path = os.path.join(
project_root,
gradle_package.replace(':', os.path.sep),
'build',
'libs',
cls.jar_name(
artifact_id,
version.replace('.dev', ''),
classifier='SNAPSHOT',
appendix=appendix))
if os.path.exists(local_path):
_LOGGER.info('Using pre-built snapshot at %s', local_path)
return local_path
elif '.dev' in version:
# TODO: Attempt to use nightly snapshots?
> raise RuntimeError(
(
'%s not found. '
'Please build the server with \n cd %s; ./gradlew %s') %
(local_path, os.path.abspath(project_root), gradle_target))
[1m[31mE RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with [0m
[1m[31mE cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build[0m
[1m[31mapache_beam/utils/subprocess_server.py[0m:243: RuntimeError
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 20 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/examples/snippets/snippets_test.py::[1mSnippetsTest::test_model_bigqueryio_xlang[0m - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with
cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
[31m= [31m[1m1 failed[0m, [32m13 passed[0m, [33m17 skipped[0m, [33m7147 deselected[0m, [33m77 warnings[0m[31m in 325.50s (0:05:25)[0m[31m =[0m
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 3795342.
Skipping invalid pid: 3795343.
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 3795277
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 16s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/63a3v6obtx6e4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_Xlang_Gcp_Direct #658
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/658/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #657
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/657/display/redirect?page=changes>
Changes:
[noreply] Add buffered logger to the Python bootloader (#28317)
------------------------------------------
[...truncated 937.28 KB...]
timestamp {
seconds: 1694097844
nanos: 990000000
}
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694097735-6b75b2, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@22ea20d9}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@79592b6b, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@49be5bac, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@451f6e2e, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@42a66094, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694097847
nanos: 281000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694097847
nanos: 283000000
}
message: "Hanged up for url: \"localhost:45299\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"
f77f3d3fe823b6074876619d3e46c2fd6b1ccc6b08c2ef6f3a720aa12073a6e0
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694097824-6f5d1b]
[32mPASSED[0m
[1m------------------------------ live log teardown -------------------------------[0m
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694097735-6b75b2]
=================================== FAILURES ===================================
[31m[1m___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________[0m
self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>
@pytest.mark.uses_gcp_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
def test_model_bigqueryio_xlang(self):
p = TestPipeline()
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
> snippets.model_bigqueryio_xlang(p)
[1m[31mapache_beam/examples/snippets/snippets_test.py[0m:768:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31mapache_beam/examples/snippets/snippets.py[0m:1065: in model_bigqueryio_xlang
quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
[1m[31mapache_beam/pvalue.py[0m:137: in __or__
return self.pipeline.apply(ptransform, self)
[1m[31mapache_beam/pipeline.py[0m:655: in apply
return self.apply(
[1m[31mapache_beam/pipeline.py[0m:666: in apply
return self.apply(transform, pvalueish)
[1m[31mapache_beam/pipeline.py[0m:712: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
[1m[31mapache_beam/runners/runner.py[0m:203: in apply
return self.apply_PTransform(transform, input, options)
[1m[31mapache_beam/runners/runner.py[0m:207: in apply_PTransform
return transform.expand(input)
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2241: in expand
| "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2540: in __init__
expansion_service or _default_io_expansion_service())
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2480: in _default_io_expansion_service
return BeamJarExpansionService(
[1m[31mapache_beam/transforms/external.py[0m:983: in __init__
path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'
@classmethod
def path_to_beam_jar(
cls,
gradle_target,
appendix=None,
version=beam_version,
artifact_id=None):
if gradle_target in cls._BEAM_SERVICES.replacements:
return cls._BEAM_SERVICES.replacements[gradle_target]
gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
if not artifact_id:
artifact_id = 'beam-' + gradle_package.replace(':', '-')
project_root = os.path.sep.join(
os.path.abspath(__file__).split(os.path.sep)[:-5])
local_path = os.path.join(
project_root,
gradle_package.replace(':', os.path.sep),
'build',
'libs',
cls.jar_name(
artifact_id,
version.replace('.dev', ''),
classifier='SNAPSHOT',
appendix=appendix))
if os.path.exists(local_path):
_LOGGER.info('Using pre-built snapshot at %s', local_path)
return local_path
elif '.dev' in version:
# TODO: Attempt to use nightly snapshots?
> raise RuntimeError(
(
'%s not found. '
'Please build the server with \n cd %s; ./gradlew %s') %
(local_path, os.path.abspath(project_root), gradle_target))
[1m[31mE RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with [0m
[1m[31mE cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build[0m
[1m[31mapache_beam/utils/subprocess_server.py[0m:243: RuntimeError
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 19 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/examples/snippets/snippets_test.py::[1mSnippetsTest::test_model_bigqueryio_xlang[0m - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with
cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
[31m= [31m[1m1 failed[0m, [32m13 passed[0m, [33m17 skipped[0m, [33m7149 deselected[0m, [33m75 warnings[0m[31m in 352.08s (0:05:52)[0m[31m =[0m
> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguageCleanup
Stopping expansion service pid: 2546212.
Skipping invalid pid: 2546213.
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 2546309
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 59s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/hyos6i7g3nywe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #656
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/656/display/redirect>
Changes:
------------------------------------------
[...truncated 949.90 KB...]
> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguageCleanup
Stopping expansion service pid: 1875218.
Skipping invalid pid: 1875219.
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694076207
nanos: 730000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694076207
nanos: 731000000
}
message: "Hanged up for url: \"localhost:34857\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"
782d5e5245195f9126ce240b49804aee954f3c6b2ad6a74e7549c5f7a1b16634
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694076191-25bbbf]
[32mPASSED[0m
[1m------------------------------ live log teardown -------------------------------[0m
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694076110-33e740]
=================================== FAILURES ===================================
[31m[1m___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________[0m
self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>
@pytest.mark.uses_gcp_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
def test_model_bigqueryio_xlang(self):
p = TestPipeline()
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
> snippets.model_bigqueryio_xlang(p)
[1m[31mapache_beam/examples/snippets/snippets_test.py[0m:768:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31mapache_beam/examples/snippets/snippets.py[0m:1065: in model_bigqueryio_xlang
quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
[1m[31mapache_beam/pvalue.py[0m:137: in __or__
return self.pipeline.apply(ptransform, self)
[1m[31mapache_beam/pipeline.py[0m:655: in apply
return self.apply(
[1m[31mapache_beam/pipeline.py[0m:666: in apply
return self.apply(transform, pvalueish)
[1m[31mapache_beam/pipeline.py[0m:712: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
[1m[31mapache_beam/runners/runner.py[0m:203: in apply
return self.apply_PTransform(transform, input, options)
[1m[31mapache_beam/runners/runner.py[0m:207: in apply_PTransform
return transform.expand(input)
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2241: in expand
| "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2540: in __init__
expansion_service or _default_io_expansion_service())
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2480: in _default_io_expansion_service
return BeamJarExpansionService(
[1m[31mapache_beam/transforms/external.py[0m:983: in __init__
path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'
@classmethod
def path_to_beam_jar(
cls,
gradle_target,
appendix=None,
version=beam_version,
artifact_id=None):
if gradle_target in cls._BEAM_SERVICES.replacements:
return cls._BEAM_SERVICES.replacements[gradle_target]
gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
if not artifact_id:
artifact_id = 'beam-' + gradle_package.replace(':', '-')
project_root = os.path.sep.join(
os.path.abspath(__file__).split(os.path.sep)[:-5])
local_path = os.path.join(
project_root,
gradle_package.replace(':', os.path.sep),
'build',
'libs',
cls.jar_name(
artifact_id,
version.replace('.dev', ''),
classifier='SNAPSHOT',
appendix=appendix))
if os.path.exists(local_path):
_LOGGER.info('Using pre-built snapshot at %s', local_path)
return local_path
elif '.dev' in version:
# TODO: Attempt to use nightly snapshots?
> raise RuntimeError(
(
'%s not found. '
'Please build the server with \n cd %s; ./gradlew %s') %
(local_path, os.path.abspath(project_root), gradle_target))
[1m[31mE RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with [0m
[1m[31mE cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build[0m
[1m[31mapache_beam/utils/subprocess_server.py[0m:243: RuntimeError
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 19 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/examples/snippets/snippets_test.py::[1mSnippetsTest::test_model_bigqueryio_xlang[0m - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with
cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
[31m= [31m[1m1 failed[0m, [32m13 passed[0m, [33m17 skipped[0m, [33m7149 deselected[0m, [33m76 warnings[0m[31m in 314.31s (0:05:14)[0m[31m =[0m
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 1875336.
Skipping invalid pid: 1875337.
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 1875270
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 6s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/ckavbswrrekby
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #655
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/655/display/redirect>
Changes:
------------------------------------------
[...truncated 957.44 KB...]
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694054509-a28ffd, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@1eb7eae1}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@6a87107b, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@29b380c4, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@85751d2, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@aeae54, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694054610
nanos: 779000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694054610
nanos: 780000000
}
message: "Hanged up for url: \"localhost:39689\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"
58fe3badda521582ac138df61dfae44442e01fa90d0dfd6cc5f18116ef524a6e
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694054595-5492ba]
[32mPASSED[0m
[1m------------------------------ live log teardown -------------------------------[0m
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694054509-a28ffd]
=================================== FAILURES ===================================
[31m[1m___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________[0m
self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>
@pytest.mark.uses_gcp_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
def test_model_bigqueryio_xlang(self):
p = TestPipeline()
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
> snippets.model_bigqueryio_xlang(p)
[1m[31mapache_beam/examples/snippets/snippets_test.py[0m:768:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31mapache_beam/examples/snippets/snippets.py[0m:1065: in model_bigqueryio_xlang
quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
[1m[31mapache_beam/pvalue.py[0m:137: in __or__
return self.pipeline.apply(ptransform, self)
[1m[31mapache_beam/pipeline.py[0m:655: in apply
return self.apply(
[1m[31mapache_beam/pipeline.py[0m:666: in apply
return self.apply(transform, pvalueish)
[1m[31mapache_beam/pipeline.py[0m:712: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
[1m[31mapache_beam/runners/runner.py[0m:203: in apply
return self.apply_PTransform(transform, input, options)
[1m[31mapache_beam/runners/runner.py[0m:207: in apply_PTransform
return transform.expand(input)
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2241: in expand
| "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2540: in __init__
expansion_service or _default_io_expansion_service())
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2480: in _default_io_expansion_service
return BeamJarExpansionService(
[1m[31mapache_beam/transforms/external.py[0m:983: in __init__
path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'
@classmethod
def path_to_beam_jar(
cls,
gradle_target,
appendix=None,
version=beam_version,
artifact_id=None):
if gradle_target in cls._BEAM_SERVICES.replacements:
return cls._BEAM_SERVICES.replacements[gradle_target]
gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
if not artifact_id:
artifact_id = 'beam-' + gradle_package.replace(':', '-')
project_root = os.path.sep.join(
os.path.abspath(__file__).split(os.path.sep)[:-5])
local_path = os.path.join(
project_root,
gradle_package.replace(':', os.path.sep),
'build',
'libs',
cls.jar_name(
artifact_id,
version.replace('.dev', ''),
classifier='SNAPSHOT',
appendix=appendix))
if os.path.exists(local_path):
_LOGGER.info('Using pre-built snapshot at %s', local_path)
return local_path
elif '.dev' in version:
# TODO: Attempt to use nightly snapshots?
> raise RuntimeError(
(
'%s not found. '
'Please build the server with \n cd %s; ./gradlew %s') %
(local_path, os.path.abspath(project_root), gradle_target))
[1m[31mE RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with [0m
[1m[31mE cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build[0m
[1m[31mapache_beam/utils/subprocess_server.py[0m:243: RuntimeError
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 19 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/examples/snippets/snippets_test.py::[1mSnippetsTest::test_model_bigqueryio_xlang[0m - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with
cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
[31m= [31m[1m1 failed[0m, [32m13 passed[0m, [33m17 skipped[0m, [33m7149 deselected[0m, [33m76 warnings[0m[31m in 312.69s (0:05:12)[0m[31m =[0m
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 1510899.
Skipping invalid pid: 1510900.
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 1510833
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 10s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/vdfj6uwdlrtcm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #654
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/654/display/redirect>
Changes:
------------------------------------------
[...truncated 959.24 KB...]
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694033821-64118d, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@4eb4d98c}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@7f65ad1d, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@4576a971, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@3e9cec87, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@2bf54ca0, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694033954
nanos: 828000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694033954
nanos: 834000000
}
message: "Hanged up for url: \"localhost:41903\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"
8c6602e65049fbcea9396b42e519de845c6f3b9c0e8846e9f09b929b1a65ad56
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694033930-11e685]
[32mPASSED[0m
[1m------------------------------ live log teardown -------------------------------[0m
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694033821-64118d]
=================================== FAILURES ===================================
[31m[1m___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________[0m
self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>
@pytest.mark.uses_gcp_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
def test_model_bigqueryio_xlang(self):
p = TestPipeline()
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
> snippets.model_bigqueryio_xlang(p)
[1m[31mapache_beam/examples/snippets/snippets_test.py[0m:768:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31mapache_beam/examples/snippets/snippets.py[0m:1065: in model_bigqueryio_xlang
quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
[1m[31mapache_beam/pvalue.py[0m:137: in __or__
return self.pipeline.apply(ptransform, self)
[1m[31mapache_beam/pipeline.py[0m:655: in apply
return self.apply(
[1m[31mapache_beam/pipeline.py[0m:666: in apply
return self.apply(transform, pvalueish)
[1m[31mapache_beam/pipeline.py[0m:712: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
[1m[31mapache_beam/runners/runner.py[0m:203: in apply
return self.apply_PTransform(transform, input, options)
[1m[31mapache_beam/runners/runner.py[0m:207: in apply_PTransform
return transform.expand(input)
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2241: in expand
| "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2540: in __init__
expansion_service or _default_io_expansion_service())
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2480: in _default_io_expansion_service
return BeamJarExpansionService(
[1m[31mapache_beam/transforms/external.py[0m:983: in __init__
path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'
@classmethod
def path_to_beam_jar(
cls,
gradle_target,
appendix=None,
version=beam_version,
artifact_id=None):
if gradle_target in cls._BEAM_SERVICES.replacements:
return cls._BEAM_SERVICES.replacements[gradle_target]
gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
if not artifact_id:
artifact_id = 'beam-' + gradle_package.replace(':', '-')
project_root = os.path.sep.join(
os.path.abspath(__file__).split(os.path.sep)[:-5])
local_path = os.path.join(
project_root,
gradle_package.replace(':', os.path.sep),
'build',
'libs',
cls.jar_name(
artifact_id,
version.replace('.dev', ''),
classifier='SNAPSHOT',
appendix=appendix))
if os.path.exists(local_path):
_LOGGER.info('Using pre-built snapshot at %s', local_path)
return local_path
elif '.dev' in version:
# TODO: Attempt to use nightly snapshots?
> raise RuntimeError(
(
'%s not found. '
'Please build the server with \n cd %s; ./gradlew %s') %
(local_path, os.path.abspath(project_root), gradle_target))
[1m[31mE RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with [0m
[1m[31mE cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build[0m
[1m[31mapache_beam/utils/subprocess_server.py[0m:243: RuntimeError
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 19 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/examples/snippets/snippets_test.py::[1mSnippetsTest::test_model_bigqueryio_xlang[0m - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with
cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
[31m= [31m[1m1 failed[0m, [32m13 passed[0m, [33m17 skipped[0m, [33m7149 deselected[0m, [33m76 warnings[0m[31m in 465.96s (0:07:45)[0m[31m =[0m
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 3187618.
Skipping invalid pid: 3187619.
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 3187110
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 11m 59s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/b5ni2zhhrax46
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #653
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/653/display/redirect?page=changes>
Changes:
[noreply] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#28324)
------------------------------------------
[...truncated 940.79 KB...]
timestamp {
seconds: 1694011411
nanos: 846000000
}
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694011322-c1ce59, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@3b39e915}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@478684e8, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@75953038, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@262eef0a, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@2833be68, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694011414
nanos: 122000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"
[33mWARNING [0m root:worker_handlers.py:415 severity: WARN
timestamp {
seconds: 1694011414
nanos: 148000000
}
message: "Hanged up for url: \"localhost:43019\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"
b45627f424a4a30c0034e93814837a6d69384b9d79ad3d01cbe5edefc9cf4939
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694011398-d6743d]
[32mPASSED[0m
[1m------------------------------ live log teardown -------------------------------[0m
[32mINFO [0m apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694011322-c1ce59]
=================================== FAILURES ===================================
[31m[1m___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________[0m
self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>
@pytest.mark.uses_gcp_java_expansion_service
@unittest.skipUnless(
os.environ.get('EXPANSION_PORT'),
"EXPANSION_PORT environment var is not provided.")
def test_model_bigqueryio_xlang(self):
p = TestPipeline()
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
> snippets.model_bigqueryio_xlang(p)
[1m[31mapache_beam/examples/snippets/snippets_test.py[0m:768:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31mapache_beam/examples/snippets/snippets.py[0m:1065: in model_bigqueryio_xlang
quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
[1m[31mapache_beam/pvalue.py[0m:137: in __or__
return self.pipeline.apply(ptransform, self)
[1m[31mapache_beam/pipeline.py[0m:655: in apply
return self.apply(
[1m[31mapache_beam/pipeline.py[0m:666: in apply
return self.apply(transform, pvalueish)
[1m[31mapache_beam/pipeline.py[0m:712: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
[1m[31mapache_beam/runners/runner.py[0m:203: in apply
return self.apply_PTransform(transform, input, options)
[1m[31mapache_beam/runners/runner.py[0m:207: in apply_PTransform
return transform.expand(input)
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2241: in expand
| "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2540: in __init__
expansion_service or _default_io_expansion_service())
[1m[31mapache_beam/io/gcp/bigquery.py[0m:2480: in _default_io_expansion_service
return BeamJarExpansionService(
[1m[31mapache_beam/transforms/external.py[0m:983: in __init__
path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'
@classmethod
def path_to_beam_jar(
cls,
gradle_target,
appendix=None,
version=beam_version,
artifact_id=None):
if gradle_target in cls._BEAM_SERVICES.replacements:
return cls._BEAM_SERVICES.replacements[gradle_target]
gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
if not artifact_id:
artifact_id = 'beam-' + gradle_package.replace(':', '-')
project_root = os.path.sep.join(
os.path.abspath(__file__).split(os.path.sep)[:-5])
local_path = os.path.join(
project_root,
gradle_package.replace(':', os.path.sep),
'build',
'libs',
cls.jar_name(
artifact_id,
version.replace('.dev', ''),
classifier='SNAPSHOT',
appendix=appendix))
if os.path.exists(local_path):
_LOGGER.info('Using pre-built snapshot at %s', local_path)
return local_path
elif '.dev' in version:
# TODO: Attempt to use nightly snapshots?
> raise RuntimeError(
(
'%s not found. '
'Please build the server with \n cd %s; ./gradlew %s') %
(local_path, os.path.abspath(project_root), gradle_target))
[1m[31mE RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with [0m
[1m[31mE cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build[0m
[1m[31mapache_beam/utils/subprocess_server.py[0m:243: RuntimeError
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 20 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/examples/snippets/snippets_test.py::[1mSnippetsTest::test_model_bigqueryio_xlang[0m - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with
cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
[31m= [31m[1m1 failed[0m, [32m13 passed[0m, [33m17 skipped[0m, [33m7148 deselected[0m, [33m76 warnings[0m[31m in 320.32s (0:05:20)[0m[31m =[0m
> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguageCleanup
Stopping expansion service pid: 2950885.
Skipping invalid pid: 2950886.
> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 2950920
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 7m 15s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/dvngpfqc2mamg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org