You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/10/23 08:33:10 UTC
Build failed in Jenkins: beam_PostCommit_Python39 #2464
See <https://ci-beam.apache.org/job/beam_PostCommit_Python39/2464/display/redirect>
Changes:
------------------------------------------
[...truncated 12.14 MB...]
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction_rows
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction
apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
apache_beam/io/gcp/bigquery_read_it_test.py::ReadInteractiveRunnerTests::test_read_in_interactive_runner
[gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadInteractiveRunnerTests::test_read_in_interactive_runner
=================================== FAILURES ===================================
[31m[1m___________________ BigtableIOWriteTest.test_bigtable_write ____________________[0m
[gw5] linux -- Python 3.9.10 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/-1734967050/bin/python3.9>
args = (parent: "projects/apache-beam-testing"
instance_id: "python-test-934ac50d"
instance {
display_name: "python-test-93...d10"
value {
location: "projects/apache-beam-testing/locations/us-east1-b"
default_storage_type: HDD
}
}
,)
kwargs = {'metadata': [('x-goog-request-params', 'parent=projects/apache-beam-testing'), ('x-goog-api-client', 'gl-python/3.9.10 grpc/1.59.0 gax/2.12.0 gapic/2.21.0')], 'timeout': 300.0}
@functools.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
try:
> return callable_(*args, **kwargs)
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py[0m:75:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/grpc/_channel.py[0m:1161: in __call__
return _end_unary_response_blocking(state, call, False, None)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
state = <grpc._channel._RPCState object at 0x7f555c0f2d30>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f555c0ad7c0>
with_call = False, deadline = None
def _end_unary_response_blocking(
state: _RPCState,
call: cygrpc.SegregatedCall,
with_call: bool,
deadline: Optional[float],
) -> Union[ResponseType, Tuple[ResponseType, grpc.Call]]:
if state.code is grpc.StatusCode.OK:
if with_call:
rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
return state.response, rendezvous
else:
return state.response
else:
> raise _InactiveRpcError(state) # pytype: disable=not-instantiable
[1m[31mE grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:[0m
[1m[31mE status = StatusCode.RESOURCE_EXHAUSTED[0m
[1m[31mE details = "Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:844138762903'."[0m
[1m[31mE debug_error_string = "UNKNOWN:Error received from peer ipv4:142.251.6.95:443 {grpc_message:"Quota exceeded for quota metric \'Instance and cluster metadata write requests\' and limit \'Instance and cluster metadata write requests per day\' of service \'bigtableadmin.googleapis.com\' for consumer \'project_number:844138762903\'.", grpc_status:8, created_time:"2023-10-23T06:23:51.173674961+00:00"}"[0m
[1m[31mE >[0m
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/grpc/_channel.py[0m:1004: _InactiveRpcError
[33mThe above exception was the direct cause of the following exception:[0m
self = <apache_beam.examples.cookbook.bigtableio_it_test.BigtableIOWriteTest testMethod=test_bigtable_write>
def setUp(self):
try:
from google.cloud.bigtable import enums
self.STORAGE_TYPE = enums.StorageType.HDD
self.INSTANCE_TYPE = enums.Instance.Type.DEVELOPMENT
except ImportError:
self.STORAGE_TYPE = 2
self.INSTANCE_TYPE = 2
self.test_pipeline = TestPipeline(is_integration_test=True)
self.runner_name = type(self.test_pipeline.runner).__name__
self.project = self.test_pipeline.get_option('project')
self.client = Client(project=self.project, admin=True)
self._delete_old_instances()
self.instance = self.client.instance(
self.instance_id, instance_type=self.INSTANCE_TYPE, labels=LABELS)
if not self.instance.exists():
cluster = self.instance.cluster(
self.cluster_id,
self.LOCATION_ID,
default_storage_type=self.STORAGE_TYPE)
> operation = self.instance.create(clusters=[cluster])
[1m[31mapache_beam/examples/cookbook/bigtableio_it_test.py[0m:143:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigtable/instance.py[0m:334: in create
return self._client.instance_admin_client.create_instance(
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigtable_admin_v2/services/bigtable_instance_admin/client.py[0m:684: in create_instance
response = rpc(
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/gapic_v1/method.py[0m:131: in __call__
return wrapped_func(*args, **kwargs)
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/timeout.py[0m:120: in func_with_timeout
return func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
args = (parent: "projects/apache-beam-testing"
instance_id: "python-test-934ac50d"
instance {
display_name: "python-test-93...d10"
value {
location: "projects/apache-beam-testing/locations/us-east1-b"
default_storage_type: HDD
}
}
,)
kwargs = {'metadata': [('x-goog-request-params', 'parent=projects/apache-beam-testing'), ('x-goog-api-client', 'gl-python/3.9.10 grpc/1.59.0 gax/2.12.0 gapic/2.21.0')], 'timeout': 300.0}
@functools.wraps(callable_)
def error_remapped_callable(*args, **kwargs):
try:
return callable_(*args, **kwargs)
except grpc.RpcError as exc:
> raise exceptions.from_grpc_error(exc) from exc
[1m[31mE google.api_core.exceptions.ResourceExhausted: 429 Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:844138762903'. [reason: "RATE_LIMIT_EXCEEDED"[0m
[1m[31mE domain: "googleapis.com"[0m
[1m[31mE metadata {[0m
[1m[31mE key: "service"[0m
[1m[31mE value: "bigtableadmin.googleapis.com"[0m
[1m[31mE }[0m
[1m[31mE metadata {[0m
[1m[31mE key: "quota_metric"[0m
[1m[31mE value: "bigtableadmin.googleapis.com/instances_write_requests"[0m
[1m[31mE }[0m
[1m[31mE metadata {[0m
[1m[31mE key: "quota_location"[0m
[1m[31mE value: "global"[0m
[1m[31mE }[0m
[1m[31mE metadata {[0m
[1m[31mE key: "quota_limit"[0m
[1m[31mE value: "InstancesWriteRequestsPerDayPerProject"[0m
[1m[31mE }[0m
[1m[31mE metadata {[0m
[1m[31mE key: "quota_limit_value"[0m
[1m[31mE value: "500"[0m
[1m[31mE }[0m
[1m[31mE metadata {[0m
[1m[31mE key: "consumer"[0m
[1m[31mE value: "projects/844138762903"[0m
[1m[31mE }[0m
[1m[31mE ][0m
[1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py[0m:77: ResourceExhausted
[33m=============================== warnings summary ===============================[0m
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:706: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/pytest_postCommitIT-df-py39.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/examples/cookbook/bigtableio_it_test.py::[1mBigtableIOWriteTest::test_bigtable_write[0m - google.api_core.exceptions.ResourceExhausted: 429 Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com' for consumer 'project_number:844138762903'. [reason: "RATE_LIMIT_EXCEEDED"
domain: "googleapis.com"
metadata {
key: "service"
value: "bigtableadmin.googleapis.com"
}
metadata {
key: "quota_metric"
value: "bigtableadmin.googleapis.com/instances_write_requests"
}
metadata {
key: "quota_location"
value: "global"
}
metadata {
key: "quota_limit"
value: "InstancesWriteRequestsPerDayPerProject"
}
metadata {
key: "quota_limit_value"
value: "500"
}
metadata {
key: "consumer"
value: "projects/844138762903"
}
]
[31m====== [31m[1m1 failed[0m, [32m87 passed[0m, [33m50 skipped[0m, [33m9 warnings[0m[31m in 8113.97s (2:15:13)[0m[31m =======[0m
> Task :sdks:python:test-suites:dataflow:py39:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 139
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 2h 21m 40s
219 actionable tasks: 155 executed, 60 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/26yb7pvkx33sy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python39 #2465
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python39/2465/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org