You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/09/06 08:43:54 UTC

Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #652

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/652/display/redirect>

Changes:


------------------------------------------
[...truncated 938.35 KB...]
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1693989731-8fb57c, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@7fedc1a3}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@5613ac8f, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@6ad1874, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@69b47354, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@1eaaef3b, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1693989827
  nanos: 190000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1693989827
  nanos: 191000000
}
message: "Hanged up for url: \"localhost:42457\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"

586a93e08123a9440c28d5cff11fa23909fdbc2a8e28532ecccc3eb6031597ff
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1693989812-909df0]
PASSED
------------------------------ live log teardown -------------------------------
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1693989731-8fb57c]


=================================== FAILURES ===================================
___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________

self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>

    @pytest.mark.uses_gcp_java_expansion_service
    @unittest.skipUnless(
        os.environ.get('EXPANSION_PORT'),
        "EXPANSION_PORT environment var is not provided.")
    def test_model_bigqueryio_xlang(self):
      p = TestPipeline()
      p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
>     snippets.model_bigqueryio_xlang(p)

apache_beam/examples/snippets/snippets_test.py:768: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/examples/snippets/snippets.py:1065: in model_bigqueryio_xlang
    quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
apache_beam/pvalue.py:137: in __or__
    return self.pipeline.apply(ptransform, self)
apache_beam/pipeline.py:655: in apply
    return self.apply(
apache_beam/pipeline.py:666: in apply
    return self.apply(transform, pvalueish)
apache_beam/pipeline.py:712: in apply
    pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/runner.py:203: in apply
    return self.apply_PTransform(transform, input, options)
apache_beam/runners/runner.py:207: in apply_PTransform
    return transform.expand(input)
apache_beam/io/gcp/bigquery.py:2241: in expand
    | "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
apache_beam/io/gcp/bigquery.py:2540: in __init__
    expansion_service or _default_io_expansion_service())
apache_beam/io/gcp/bigquery.py:2480: in _default_io_expansion_service
    return BeamJarExpansionService(
apache_beam/transforms/external.py:983: in __init__
    path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'

    @classmethod
    def path_to_beam_jar(
        cls,
        gradle_target,
        appendix=None,
        version=beam_version,
        artifact_id=None):
      if gradle_target in cls._BEAM_SERVICES.replacements:
        return cls._BEAM_SERVICES.replacements[gradle_target]
    
      gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
      if not artifact_id:
        artifact_id = 'beam-' + gradle_package.replace(':', '-')
      project_root = os.path.sep.join(
          os.path.abspath(__file__).split(os.path.sep)[:-5])
      local_path = os.path.join(
          project_root,
          gradle_package.replace(':', os.path.sep),
          'build',
          'libs',
          cls.jar_name(
              artifact_id,
              version.replace('.dev', ''),
              classifier='SNAPSHOT',
              appendix=appendix))
      if os.path.exists(local_path):
        _LOGGER.info('Using pre-built snapshot at %s', local_path)
        return local_path
      elif '.dev' in version:
        # TODO: Attempt to use nightly snapshots?
>       raise RuntimeError(
            (
                '%s not found. '
                'Please build the server with \n  cd %s; ./gradlew %s') %
            (local_path, os.path.abspath(project_root), gradle_target))
E       RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
E         cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build

apache_beam/utils/subprocess_server.py:243: RuntimeError
=============================== warnings summary ===============================
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 20 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self._expansion_service, pipeline.options)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
  cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
= 1 failed, 13 passed, 17 skipped, 7147 deselected, 77 warnings in 325.50s (0:05:25) =

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 3795342.
Skipping invalid pid: 3795343.

> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 3795277

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 16s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date

Publishing build scan...
https://ge.apache.org/s/63a3v6obtx6e4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_Xlang_Gcp_Direct #658

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/658/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #657

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/657/display/redirect?page=changes>

Changes:

[noreply] Add buffered logger to the Python bootloader (#28317)


------------------------------------------
[...truncated 937.28 KB...]
timestamp {
  seconds: 1694097844
  nanos: 990000000
}
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694097735-6b75b2, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@22ea20d9}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@79592b6b, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@49be5bac, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@451f6e2e, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@42a66094, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694097847
  nanos: 281000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694097847
  nanos: 283000000
}
message: "Hanged up for url: \"localhost:45299\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"

f77f3d3fe823b6074876619d3e46c2fd6b1ccc6b08c2ef6f3a720aa12073a6e0
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694097824-6f5d1b]
PASSED
------------------------------ live log teardown -------------------------------
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694097735-6b75b2]


=================================== FAILURES ===================================
___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________

self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>

    @pytest.mark.uses_gcp_java_expansion_service
    @unittest.skipUnless(
        os.environ.get('EXPANSION_PORT'),
        "EXPANSION_PORT environment var is not provided.")
    def test_model_bigqueryio_xlang(self):
      p = TestPipeline()
      p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
>     snippets.model_bigqueryio_xlang(p)

apache_beam/examples/snippets/snippets_test.py:768: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/examples/snippets/snippets.py:1065: in model_bigqueryio_xlang
    quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
apache_beam/pvalue.py:137: in __or__
    return self.pipeline.apply(ptransform, self)
apache_beam/pipeline.py:655: in apply
    return self.apply(
apache_beam/pipeline.py:666: in apply
    return self.apply(transform, pvalueish)
apache_beam/pipeline.py:712: in apply
    pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/runner.py:203: in apply
    return self.apply_PTransform(transform, input, options)
apache_beam/runners/runner.py:207: in apply_PTransform
    return transform.expand(input)
apache_beam/io/gcp/bigquery.py:2241: in expand
    | "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
apache_beam/io/gcp/bigquery.py:2540: in __init__
    expansion_service or _default_io_expansion_service())
apache_beam/io/gcp/bigquery.py:2480: in _default_io_expansion_service
    return BeamJarExpansionService(
apache_beam/transforms/external.py:983: in __init__
    path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'

    @classmethod
    def path_to_beam_jar(
        cls,
        gradle_target,
        appendix=None,
        version=beam_version,
        artifact_id=None):
      if gradle_target in cls._BEAM_SERVICES.replacements:
        return cls._BEAM_SERVICES.replacements[gradle_target]
    
      gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
      if not artifact_id:
        artifact_id = 'beam-' + gradle_package.replace(':', '-')
      project_root = os.path.sep.join(
          os.path.abspath(__file__).split(os.path.sep)[:-5])
      local_path = os.path.join(
          project_root,
          gradle_package.replace(':', os.path.sep),
          'build',
          'libs',
          cls.jar_name(
              artifact_id,
              version.replace('.dev', ''),
              classifier='SNAPSHOT',
              appendix=appendix))
      if os.path.exists(local_path):
        _LOGGER.info('Using pre-built snapshot at %s', local_path)
        return local_path
      elif '.dev' in version:
        # TODO: Attempt to use nightly snapshots?
>       raise RuntimeError(
            (
                '%s not found. '
                'Please build the server with \n  cd %s; ./gradlew %s') %
            (local_path, os.path.abspath(project_root), gradle_target))
E       RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
E         cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build

apache_beam/utils/subprocess_server.py:243: RuntimeError
=============================== warnings summary ===============================
../../build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 19 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 16 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self._expansion_service, pipeline.options)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
  cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
= 1 failed, 13 passed, 17 skipped, 7149 deselected, 75 warnings in 352.08s (0:05:52) =

> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava FAILED

> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguageCleanup
Stopping expansion service pid: 2546212.
Skipping invalid pid: 2546213.

> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 2546309

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 59s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date

Publishing build scan...
https://ge.apache.org/s/hyos6i7g3nywe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #656

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/656/display/redirect>

Changes:


------------------------------------------
[...truncated 949.90 KB...]

> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguageCleanup
Stopping expansion service pid: 1875218.
Skipping invalid pid: 1875219.

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava
WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694076207
  nanos: 730000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694076207
  nanos: 731000000
}
message: "Hanged up for url: \"localhost:34857\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"

782d5e5245195f9126ce240b49804aee954f3c6b2ad6a74e7549c5f7a1b16634
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694076191-25bbbf]
PASSED
------------------------------ live log teardown -------------------------------
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694076110-33e740]


=================================== FAILURES ===================================
___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________

self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>

    @pytest.mark.uses_gcp_java_expansion_service
    @unittest.skipUnless(
        os.environ.get('EXPANSION_PORT'),
        "EXPANSION_PORT environment var is not provided.")
    def test_model_bigqueryio_xlang(self):
      p = TestPipeline()
      p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
>     snippets.model_bigqueryio_xlang(p)

apache_beam/examples/snippets/snippets_test.py:768: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/examples/snippets/snippets.py:1065: in model_bigqueryio_xlang
    quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
apache_beam/pvalue.py:137: in __or__
    return self.pipeline.apply(ptransform, self)
apache_beam/pipeline.py:655: in apply
    return self.apply(
apache_beam/pipeline.py:666: in apply
    return self.apply(transform, pvalueish)
apache_beam/pipeline.py:712: in apply
    pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/runner.py:203: in apply
    return self.apply_PTransform(transform, input, options)
apache_beam/runners/runner.py:207: in apply_PTransform
    return transform.expand(input)
apache_beam/io/gcp/bigquery.py:2241: in expand
    | "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
apache_beam/io/gcp/bigquery.py:2540: in __init__
    expansion_service or _default_io_expansion_service())
apache_beam/io/gcp/bigquery.py:2480: in _default_io_expansion_service
    return BeamJarExpansionService(
apache_beam/transforms/external.py:983: in __init__
    path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'

    @classmethod
    def path_to_beam_jar(
        cls,
        gradle_target,
        appendix=None,
        version=beam_version,
        artifact_id=None):
      if gradle_target in cls._BEAM_SERVICES.replacements:
        return cls._BEAM_SERVICES.replacements[gradle_target]
    
      gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
      if not artifact_id:
        artifact_id = 'beam-' + gradle_package.replace(':', '-')
      project_root = os.path.sep.join(
          os.path.abspath(__file__).split(os.path.sep)[:-5])
      local_path = os.path.join(
          project_root,
          gradle_package.replace(':', os.path.sep),
          'build',
          'libs',
          cls.jar_name(
              artifact_id,
              version.replace('.dev', ''),
              classifier='SNAPSHOT',
              appendix=appendix))
      if os.path.exists(local_path):
        _LOGGER.info('Using pre-built snapshot at %s', local_path)
        return local_path
      elif '.dev' in version:
        # TODO: Attempt to use nightly snapshots?
>       raise RuntimeError(
            (
                '%s not found. '
                'Please build the server with \n  cd %s; ./gradlew %s') %
            (local_path, os.path.abspath(project_root), gradle_target))
E       RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
E         cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build

apache_beam/utils/subprocess_server.py:243: RuntimeError
=============================== warnings summary ===============================
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 19 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self._expansion_service, pipeline.options)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
  cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
= 1 failed, 13 passed, 17 skipped, 7149 deselected, 76 warnings in 314.31s (0:05:14) =

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 1875336.
Skipping invalid pid: 1875337.

> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 1875270

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 6s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date

Publishing build scan...
https://ge.apache.org/s/ckavbswrrekby

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #655

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/655/display/redirect>

Changes:


------------------------------------------
[...truncated 957.44 KB...]
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694054509-a28ffd, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@1eb7eae1}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@6a87107b, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@29b380c4, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@85751d2, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@aeae54, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694054610
  nanos: 779000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694054610
  nanos: 780000000
}
message: "Hanged up for url: \"localhost:39689\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"

58fe3badda521582ac138df61dfae44442e01fa90d0dfd6cc5f18116ef524a6e
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694054595-5492ba]
PASSED
------------------------------ live log teardown -------------------------------
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694054509-a28ffd]


=================================== FAILURES ===================================
___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________

self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>

    @pytest.mark.uses_gcp_java_expansion_service
    @unittest.skipUnless(
        os.environ.get('EXPANSION_PORT'),
        "EXPANSION_PORT environment var is not provided.")
    def test_model_bigqueryio_xlang(self):
      p = TestPipeline()
      p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
>     snippets.model_bigqueryio_xlang(p)

apache_beam/examples/snippets/snippets_test.py:768: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/examples/snippets/snippets.py:1065: in model_bigqueryio_xlang
    quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
apache_beam/pvalue.py:137: in __or__
    return self.pipeline.apply(ptransform, self)
apache_beam/pipeline.py:655: in apply
    return self.apply(
apache_beam/pipeline.py:666: in apply
    return self.apply(transform, pvalueish)
apache_beam/pipeline.py:712: in apply
    pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/runner.py:203: in apply
    return self.apply_PTransform(transform, input, options)
apache_beam/runners/runner.py:207: in apply_PTransform
    return transform.expand(input)
apache_beam/io/gcp/bigquery.py:2241: in expand
    | "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
apache_beam/io/gcp/bigquery.py:2540: in __init__
    expansion_service or _default_io_expansion_service())
apache_beam/io/gcp/bigquery.py:2480: in _default_io_expansion_service
    return BeamJarExpansionService(
apache_beam/transforms/external.py:983: in __init__
    path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'

    @classmethod
    def path_to_beam_jar(
        cls,
        gradle_target,
        appendix=None,
        version=beam_version,
        artifact_id=None):
      if gradle_target in cls._BEAM_SERVICES.replacements:
        return cls._BEAM_SERVICES.replacements[gradle_target]
    
      gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
      if not artifact_id:
        artifact_id = 'beam-' + gradle_package.replace(':', '-')
      project_root = os.path.sep.join(
          os.path.abspath(__file__).split(os.path.sep)[:-5])
      local_path = os.path.join(
          project_root,
          gradle_package.replace(':', os.path.sep),
          'build',
          'libs',
          cls.jar_name(
              artifact_id,
              version.replace('.dev', ''),
              classifier='SNAPSHOT',
              appendix=appendix))
      if os.path.exists(local_path):
        _LOGGER.info('Using pre-built snapshot at %s', local_path)
        return local_path
      elif '.dev' in version:
        # TODO: Attempt to use nightly snapshots?
>       raise RuntimeError(
            (
                '%s not found. '
                'Please build the server with \n  cd %s; ./gradlew %s') %
            (local_path, os.path.abspath(project_root), gradle_target))
E       RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
E         cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build

apache_beam/utils/subprocess_server.py:243: RuntimeError
=============================== warnings summary ===============================
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 19 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self._expansion_service, pipeline.options)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
  cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
= 1 failed, 13 passed, 17 skipped, 7149 deselected, 76 warnings in 312.69s (0:05:12) =

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 1510899.
Skipping invalid pid: 1510900.

> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 1510833

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 10s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date

Publishing build scan...
https://ge.apache.org/s/vdfj6uwdlrtcm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #654

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/654/display/redirect>

Changes:


------------------------------------------
[...truncated 959.24 KB...]
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694033821-64118d, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[DEADLINE_EXCEEDED, UNAVAILABLE, ABORTED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@4eb4d98c}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@7f65ad1d, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@4576a971, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@3e9cec87, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@2bf54ca0, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694033954
  nanos: 828000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694033954
  nanos: 834000000
}
message: "Hanged up for url: \"localhost:41903\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"

8c6602e65049fbcea9396b42e519de845c6f3b9c0e8846e9f09b929b1a65ad56
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694033930-11e685]
PASSED
------------------------------ live log teardown -------------------------------
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694033821-64118d]


=================================== FAILURES ===================================
___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________

self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>

    @pytest.mark.uses_gcp_java_expansion_service
    @unittest.skipUnless(
        os.environ.get('EXPANSION_PORT'),
        "EXPANSION_PORT environment var is not provided.")
    def test_model_bigqueryio_xlang(self):
      p = TestPipeline()
      p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
>     snippets.model_bigqueryio_xlang(p)

apache_beam/examples/snippets/snippets_test.py:768: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/examples/snippets/snippets.py:1065: in model_bigqueryio_xlang
    quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
apache_beam/pvalue.py:137: in __or__
    return self.pipeline.apply(ptransform, self)
apache_beam/pipeline.py:655: in apply
    return self.apply(
apache_beam/pipeline.py:666: in apply
    return self.apply(transform, pvalueish)
apache_beam/pipeline.py:712: in apply
    pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/runner.py:203: in apply
    return self.apply_PTransform(transform, input, options)
apache_beam/runners/runner.py:207: in apply_PTransform
    return transform.expand(input)
apache_beam/io/gcp/bigquery.py:2241: in expand
    | "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
apache_beam/io/gcp/bigquery.py:2540: in __init__
    expansion_service or _default_io_expansion_service())
apache_beam/io/gcp/bigquery.py:2480: in _default_io_expansion_service
    return BeamJarExpansionService(
apache_beam/transforms/external.py:983: in __init__
    path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'

    @classmethod
    def path_to_beam_jar(
        cls,
        gradle_target,
        appendix=None,
        version=beam_version,
        artifact_id=None):
      if gradle_target in cls._BEAM_SERVICES.replacements:
        return cls._BEAM_SERVICES.replacements[gradle_target]
    
      gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
      if not artifact_id:
        artifact_id = 'beam-' + gradle_package.replace(':', '-')
      project_root = os.path.sep.join(
          os.path.abspath(__file__).split(os.path.sep)[:-5])
      local_path = os.path.join(
          project_root,
          gradle_package.replace(':', os.path.sep),
          'build',
          'libs',
          cls.jar_name(
              artifact_id,
              version.replace('.dev', ''),
              classifier='SNAPSHOT',
              appendix=appendix))
      if os.path.exists(local_path):
        _LOGGER.info('Using pre-built snapshot at %s', local_path)
        return local_path
      elif '.dev' in version:
        # TODO: Attempt to use nightly snapshots?
>       raise RuntimeError(
            (
                '%s not found. '
                'Please build the server with \n  cd %s; ./gradlew %s') %
            (local_path, os.path.abspath(project_root), gradle_target))
E       RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
E         cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build

apache_beam/utils/subprocess_server.py:243: RuntimeError
=============================== warnings summary ===============================
../../build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 19 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 16 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

../../build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/417525524/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self._expansion_service, pipeline.options)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
  cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
= 1 failed, 13 passed, 17 skipped, 7149 deselected, 76 warnings in 465.96s (0:07:45) =

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava FAILED

> Task :sdks:python:test-suites:direct:py311:gcpCrossLanguageCleanup
Stopping expansion service pid: 3187618.
Skipping invalid pid: 3187619.

> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 3187110

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 11m 59s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date

Publishing build scan...
https://ge.apache.org/s/b5ni2zhhrax46

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Xlang_Gcp_Direct #653

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/653/display/redirect?page=changes>

Changes:

[noreply] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#28324)


------------------------------------------
[...truncated 940.79 KB...]
timestamp {
  seconds: 1694011411
  nanos: 846000000
}
message: "Started Bigtable service with settings BigtableDataSettings{stubSettings=EnhancedBigtableStubSettings{projectId=apache-beam-testing, instanceId=bt-write-xlang-1694011322-c1ce59, appProfileId=, isRefreshingChannel=true, primedTableIds=[], jwtAudienceMapping={batch-bigtable.googleapis.com=https://bigtable.googleapis.com/}, readRowsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT5M, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT30M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT30M}}, readRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, sampleRowKeysSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT5M}}, mutateRowSettings=UnaryCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT1M}}, bulkMutateRowsSettings=BigtableBatchingCallSettings{batchingCallSettings=BatchingCallSettings{retryableCodes=[UNAVAILABLE, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT6M, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT6M}, batchingSettings=BatchingSettings{elementCountThreshold=100, requestByteThreshold=20971520, delayThreshold=PT1S, isEnabled=true, flowControlSettings=FlowControlSettings{maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, limitExceededBehavior=Block}}}, isLatencyBasedThrottlingEnabled=false, targetRpcLatency=null, dynamicFlowControlSettings=DynamicFlowControlSettings{initialOutstandingElementCount=20000, initialOutstandingRequestBytes=104857600, maxOutstandingElementCount=20000, maxOutstandingRequestBytes=104857600, minOutstandingElementCount=20000, minOutstandingRequestBytes=104857600, limitExceededBehavior=Block}, isServerInitiatedFlowControlEnabled=false}, bulkReadRowsSettings=BigtableBulkReadRowsCallSettings{retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT10M, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, checkAndMutateRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, readModifyWriteRowSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT20S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=0, jittered=true, initialRpcTimeout=PT20S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT20S}}, generateInitialChangeStreamPartitionsSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT1H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT1M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT10M}}, readChangeStreamSettings=ServerStreamingCallSettings{idleTimeout=PT5M, waitTimeout=PT0S, retryableCodes=[UNAVAILABLE, ABORTED, DEADLINE_EXCEEDED], retrySettings=RetrySettings{totalTimeout=PT12H, initialRetryDelay=PT0.01S, retryDelayMultiplier=2.0, maxRetryDelay=PT1M, maxAttempts=10, jittered=true, initialRpcTimeout=PT5M, rpcTimeoutMultiplier=2.0, maxRpcTimeout=PT5M}}, pingAndWarmSettings=UnaryCallSettings{retryableCodes=[], retrySettings=RetrySettings{totalTimeout=PT30S, initialRetryDelay=PT0S, retryDelayMultiplier=1.0, maxRetryDelay=PT0S, maxAttempts=1, jittered=true, initialRpcTimeout=PT30S, rpcTimeoutMultiplier=1.0, maxRpcTimeout=PT30S}}, parent=EnhancedBigtableStubSettings{backgroundExecutorProvider=InstantiatingExecutorProvider{executorThreadCount=16, threadFactory=com.google.api.gax.core.InstantiatingExecutorProvider$1@3b39e915}, transportChannelProvider=com.google.api.gax.grpc.InstantiatingGrpcChannelProvider@478684e8, credentialsProvider=FixedCredentialsProvider{credentials=ComputeEngineCredentials{transportFactoryClassName=com.google.auth.oauth2.OAuth2Utils$DefaultHttpTransportFactory}}, headerProvider=FixedHeaderProvider{headers={user-agent=Apache_Beam_SDK_for_Java/2.51.0-SNAPSHOT-SNAPSHOT}}, internalHeaderProvider=FixedHeaderProvider{headers={x-goog-api-client=gl-java/1.8.0_382 gapic/ gax/2.32.0 grpc/, user-agent=bigtable-java/2.26.0, bigtable-features=CAEgAQ==}}, clock=com.google.api.core.NanoClock@75953038, endpoint=bigtable.googleapis.com:443, mtlsEndpoint=bigtable.mtls.googleapis.com:443, switchToMtlsEndpointAllowed=false, quotaProjectId=null, streamWatchdogProvider=com.google.api.gax.rpc.InstantiatingWatchdogProvider@262eef0a, streamWatchdogCheckInterval=PT10S, tracerFactory=com.google.api.gax.tracing.BaseApiTracerFactory@2833be68, gdchApiAudience=null}}}"
instruction_id: "bundle_64"
transform_id: "WriteToBigTable/SchemaAwareExternalTransform/ExternalTransform(beam:expansion:payload:schematransform:v1)/BigtableIO.Write/BigtableIO.WriteWithResults/ParDo(BigtableWriter)/ParMultiDo(BigtableWriter)"
log_location: "org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl"
thread: "30"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694011414
  nanos: 122000000
}
message: "Reporting metrics are not supported in the current execution environment."
log_location: "org.apache.beam.sdk.metrics.MetricsEnvironment"
thread: "1"

WARNING  root:worker_handlers.py:415 severity: WARN
timestamp {
  seconds: 1694011414
  nanos: 148000000
}
message: "Hanged up for url: \"localhost:43019\"\n."
log_location: "org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer"
thread: "22"

b45627f424a4a30c0034e93814837a6d69384b9d79ad3d01cbe5edefc9cf4939
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:190 Deleting table [test-table-1694011398-d6743d]
PASSED
------------------------------ live log teardown -------------------------------
INFO     apache_beam.io.gcp.bigtableio_it_test:bigtableio_it_test.py:198 Deleting instance [bt-write-xlang-1694011322-c1ce59]


=================================== FAILURES ===================================
___________________ SnippetsTest.test_model_bigqueryio_xlang ___________________

self = <apache_beam.examples.snippets.snippets_test.SnippetsTest testMethod=test_model_bigqueryio_xlang>

    @pytest.mark.uses_gcp_java_expansion_service
    @unittest.skipUnless(
        os.environ.get('EXPANSION_PORT'),
        "EXPANSION_PORT environment var is not provided.")
    def test_model_bigqueryio_xlang(self):
      p = TestPipeline()
      p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'
>     snippets.model_bigqueryio_xlang(p)

apache_beam/examples/snippets/snippets_test.py:768: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
apache_beam/examples/snippets/snippets.py:1065: in model_bigqueryio_xlang
    quotes | "StorageWriteAPIWithFrequency" >> beam.io.WriteToBigQuery(
apache_beam/pvalue.py:137: in __or__
    return self.pipeline.apply(ptransform, self)
apache_beam/pipeline.py:655: in apply
    return self.apply(
apache_beam/pipeline.py:666: in apply
    return self.apply(transform, pvalueish)
apache_beam/pipeline.py:712: in apply
    pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/runner.py:203: in apply
    return self.apply_PTransform(transform, input, options)
apache_beam/runners/runner.py:207: in apply_PTransform
    return transform.expand(input)
apache_beam/io/gcp/bigquery.py:2241: in expand
    | "StorageWriteToBigQuery" >> StorageWriteToBigQuery(
apache_beam/io/gcp/bigquery.py:2540: in __init__
    expansion_service or _default_io_expansion_service())
apache_beam/io/gcp/bigquery.py:2480: in _default_io_expansion_service
    return BeamJarExpansionService(
apache_beam/transforms/external.py:983: in __init__
    path_to_jar = subprocess_server.JavaJarServer.path_to_beam_jar(
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'apache_beam.utils.subprocess_server.JavaJarServer'>
gradle_target = 'sdks:java:io:google-cloud-platform:expansion-service:build'
appendix = None, version = '2.51.0.dev'
artifact_id = 'beam-sdks-java-io-google-cloud-platform-expansion-service'

    @classmethod
    def path_to_beam_jar(
        cls,
        gradle_target,
        appendix=None,
        version=beam_version,
        artifact_id=None):
      if gradle_target in cls._BEAM_SERVICES.replacements:
        return cls._BEAM_SERVICES.replacements[gradle_target]
    
      gradle_package = gradle_target.strip(':').rsplit(':', 1)[0]
      if not artifact_id:
        artifact_id = 'beam-' + gradle_package.replace(':', '-')
      project_root = os.path.sep.join(
          os.path.abspath(__file__).split(os.path.sep)[:-5])
      local_path = os.path.join(
          project_root,
          gradle_package.replace(':', os.path.sep),
          'build',
          'libs',
          cls.jar_name(
              artifact_id,
              version.replace('.dev', ''),
              classifier='SNAPSHOT',
              appendix=appendix))
      if os.path.exists(local_path):
        _LOGGER.info('Using pre-built snapshot at %s', local_path)
        return local_path
      elif '.dev' in version:
        # TODO: Attempt to use nightly snapshots?
>       raise RuntimeError(
            (
                '%s not found. '
                'Please build the server with \n  cd %s; ./gradlew %s') %
            (local_path, os.path.abspath(project_root), gradle_target))
E       RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
E         cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build

apache_beam/utils/subprocess_server.py:243: RuntimeError
=============================== warnings summary ===============================
../../build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 20 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 16 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/build/gradleenv/1398941892/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/examples/snippets/snippets_test.py>:767: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location = 'gs://mylocation'

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_all_types
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_nested_records_and_lists
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_at_least_once
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_streaming_with_auto_sharding
apache_beam/io/external/xlang_bigqueryio_it_test.py::BigQueryXlangStorageWriteIT::test_with_at_least_once_semantics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/io/external/xlang_bigqueryio_it_test.py: 10 warnings
apache_beam/io/gcp/bigtableio_it_test.py: 6 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:679: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self._expansion_service, pipeline.options)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/python/pytest_gcpCrossLanguage.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/snippets/snippets_test.py::SnippetsTest::test_model_bigqueryio_xlang - RuntimeError: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.51.0-SNAPSHOT.jar> not found. Please build the server with 
  cd <https://ci-beam.apache.org/job/beam_PostCommit_Python_Xlang_Gcp_Direct/ws/src;> ./gradlew sdks:java:io:google-cloud-platform:expansion-service:build
= 1 failed, 13 passed, 17 skipped, 7148 deselected, 76 warnings in 320.32s (0:05:20) =

> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava FAILED

> Task :sdks:python:test-suites:direct:py38:gcpCrossLanguageCleanup
Stopping expansion service pid: 2950885.
Skipping invalid pid: 2950886.

> Task :sdks:python:test-suites:xlang:fnApiJobServerCleanup
Killing process at 2950920

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py311:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py38:gcpCrossLanguagePythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 15s
115 actionable tasks: 79 executed, 32 from cache, 4 up-to-date

Publishing build scan...
https://ge.apache.org/s/dvngpfqc2mamg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org