You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/02/05 18:42:35 UTC
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6862
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6862/display/redirect>
Changes:
------------------------------------------
[...truncated 17.32 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.0 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f6abc0eb010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f6abc0eb130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f6abc0eb640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f6abc0eb6d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f6abc0eb880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f6abc0eb910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f6abc0eba30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f6abc0ebac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f6abc0ebb50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f6abc0ebbe0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f6abc0ebe20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f6abc0ebf40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f6abc0ebd90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f6abc0ebeb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f6abc0b4160> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27763: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63dff879e9882d4b61727c24, topology_type: Single, servers: [<ServerDescription ('localhost', 27763) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27763: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27763: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63dff879e9882d4b61727c24, topology_type: Single, servers: [<ServerDescription ('localhost', 27763) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27763: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jkjwuldbyrxjk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_MongoDBIO_IT #6875
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6875/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6874
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6874/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Minor updates to typescript generation.
[noreply] [Spark runner] Removal of Spark 2 runner support (closes #25259)
[noreply] Add TensorRT runinference example for Text Classification (#25226)
[noreply] Bump cryptography from 39.0.0 to 39.0.1 in /sdks/python/container/py39
[noreply] Playground Frontend Test workflow (#24728) (#25254)
[noreply] Simpify composite literal in metrics_test.go (#25384)
[noreply] Replace use of deprecated strings.Title function (#25385)
------------------------------------------
[...truncated 17.67 KB...]
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f5efed9f0a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f5efed9f1c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f5efed9f6d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f5efed9f760> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f5efed9f910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f5efed9f9a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f5efed9fac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f5efed9fb50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f5efed9fbe0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f5efed9fc70> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f5efed9feb0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f5efedc8040> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f5efed9fe20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f5efed9ff40> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f5efed39060> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27953: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e3f1c93c1715e5061b4a1d, topology_type: Single, servers: [<ServerDescription ('localhost', 27953) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27953: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1026, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 228, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27953: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e3f1c93c1715e5061b4a1d, topology_type: Single, servers: [<ServerDescription ('localhost', 27953) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27953: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 35s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o7343y4huxp54
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6873
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6873/display/redirect>
Changes:
------------------------------------------
[...truncated 17.58 KB...]
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f02d57cb0a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f02d57cb1c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f02d57cb6d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f02d57cb760> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f02d57cb910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f02d57cb9a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f02d57cbac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f02d57cbb50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f02d57cbbe0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f02d57cbc70> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f02d57cbeb0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f02d5778040> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f02d57cbe20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f02d57cbf40> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f02d5653610> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27293: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e398a985de4ce7782d2883, topology_type: Single, servers: [<ServerDescription ('localhost', 27293) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27293: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1026, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 228, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27293: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e398a985de4ce7782d2883, topology_type: Single, servers: [<ServerDescription ('localhost', 27293) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27293: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4rrxmwmgkcady
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6872
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6872/display/redirect>
Changes:
------------------------------------------
[...truncated 17.58 KB...]
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f20782c70a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f20782c71c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f20782c76d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f20782c7760> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f20782c7910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f20782c79a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f20782c7ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f20782c7b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f20782c7be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f20782c7c70> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f20782c7eb0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f2078328040> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f20782c7e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f20782c7f40> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f20781ed0f0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27713: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e34439d9575d38914ee6a7, topology_type: Single, servers: [<ServerDescription ('localhost', 27713) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27713: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1026, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 228, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27713: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e34439d9575d38914ee6a7, topology_type: Single, servers: [<ServerDescription ('localhost', 27713) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27713: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gsv3ml4dzhem6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6871
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6871/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Better batching for higher fixed costs.
[Robert Bradshaw] Add an option to get the old behavior.
[Robert Bradshaw] lint
[noreply] [BEAM-12164] Enforced only positive state transitions from CREATED ->
[noreply] Added Role-based access control integration tests for Spanner Change
[noreply] Fail the pipeline when a mismatched Python or Beam version is detected.
------------------------------------------
[...truncated 17.77 KB...]
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f163439b0a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f163439b1c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f163439b6d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f163439b760> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f163439b910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f163439b9a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f163439bac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f163439bb50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f163439bbe0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f163439bc70> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f163439beb0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f163441c040> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f163439be20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f163439bf40> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f163438d060> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27858: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e2efcd4998e17970aaa83d, topology_type: Single, servers: [<ServerDescription ('localhost', 27858) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27858: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1026, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 228, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27858: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e2efcd4998e17970aaa83d, topology_type: Single, servers: [<ServerDescription ('localhost', 27858) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27858: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4mdpovtnmuha4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6870
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6870/display/redirect>
Changes:
------------------------------------------
[...truncated 17.39 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f61406c7010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f61406c7130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f61406c7640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f61406c76d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f61406c7880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f61406c7910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f61406c7a30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f61406c7ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f61406c7b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f61406c7be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f61406c7e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f61406c7f40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f61406c7d90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f61406c7eb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f6140630160> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27614: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e29b7f096b207554610dd3, topology_type: Single, servers: [<ServerDescription ('localhost', 27614) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27614: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27614: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e29b7f096b207554610dd3, topology_type: Single, servers: [<ServerDescription ('localhost', 27614) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27614: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mzzkawzep5sji
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6869
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6869/display/redirect>
Changes:
------------------------------------------
[...truncated 17.49 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f81b4d77010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f81b4d77130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f81b4d77640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f81b4d776d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f81b4d77880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f81b4d77910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f81b4d77a30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f81b4d77ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f81b4d77b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f81b4d77be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f81b4d77e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f81b4d77f40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f81b4d77d90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f81b4d77eb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f81b4cd0160> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27326: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e247326405e8d75060cc60, topology_type: Single, servers: [<ServerDescription ('localhost', 27326) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27326: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27326: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e247326405e8d75060cc60, topology_type: Single, servers: [<ServerDescription ('localhost', 27326) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27326: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 15s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4mdxc67eendig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6868
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6868/display/redirect>
Changes:
------------------------------------------
[...truncated 17.49 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f69fdfc3010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f69fdfc3130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f69fdfc3640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f69fdfc36d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f69fdfc3880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f69fdfc3910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f69fdfc3a30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f69fdfc3ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f69fdfc3b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f69fdfc3be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f69fdfc3e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f69fdfc3f40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f69fdfc3d90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f69fdfc3eb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f69fdf3c1f0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27024: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e1f2b48adf3f30cc98273d, topology_type: Single, servers: [<ServerDescription ('localhost', 27024) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27024: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27024: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e1f2b48adf3f30cc98273d, topology_type: Single, servers: [<ServerDescription ('localhost', 27024) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27024: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rfqhny3vkophg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6867
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6867/display/redirect?page=changes>
Changes:
[noreply] Change UnboundedScheduledExecutorService to avoid creating threads when
[noreply] Upgrading spring-expression to latest patch version (#25348)
------------------------------------------
[...truncated 17.39 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f07bb6b7010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f07bb6b7130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f07bb6b7640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f07bb6b76d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f07bb6b7880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f07bb6b7910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f07bb6b7a30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f07bb6b7ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f07bb6b7b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f07bb6b7be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f07bb6b7e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f07bb6b7f40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f07bb6b7d90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f07bb6b7eb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f07bb6bc160> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27808: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e19e631a239b527efd948f, topology_type: Single, servers: [<ServerDescription ('localhost', 27808) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27808: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27808: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e19e631a239b527efd948f, topology_type: Single, servers: [<ServerDescription ('localhost', 27808) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27808: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tzfexl3w3wjek
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6866
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6866/display/redirect?page=changes>
Changes:
[Andrew Pilloud] Don't discard output column names
[noreply] Allow for setMaxRetryJobs in BigQueryIO to be configurable (#25224)
[noreply] delete file used in internal testing (#25339)
[noreply] Fix output timestamp for multi output receiver in FnApiDoFnRunner #25344
------------------------------------------
[...truncated 17.35 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f0718dff010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f0718dff130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f0718dff640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f0718dff6d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f0718dff880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f0718dff910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f0718dffa30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f0718dffac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f0718dffb50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f0718dffbe0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f0718dffe20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f0718dfff40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f0718dffd90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f0718dffeb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f0718e08880> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27177: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e149ffc8eefd54d0298743, topology_type: Single, servers: [<ServerDescription ('localhost', 27177) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27177: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27177: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e149ffc8eefd54d0298743, topology_type: Single, servers: [<ServerDescription ('localhost', 27177) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27177: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 4s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ke2mqynjlajrc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6865
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6865/display/redirect>
Changes:
------------------------------------------
[...truncated 17.32 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7fce916b3010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7fce916b3130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fce916b3640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fce916b36d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7fce916b3880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7fce916b3910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7fce916b3a30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7fce916b3ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7fce916b3b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7fce916b3be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fce916b3e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7fce916b3f40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7fce916b3d90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7fce916b3eb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7fce91638160> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27159: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e0f5998ae771823a4a13c6, topology_type: Single, servers: [<ServerDescription ('localhost', 27159) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27159: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27159: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e0f5998ae771823a4a13c6, topology_type: Single, servers: [<ServerDescription ('localhost', 27159) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27159: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7o3woewc2gpxi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6864
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6864/display/redirect>
Changes:
------------------------------------------
[...truncated 17.32 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7f0b2f4d7010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7f0b2f4d7130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f0b2f4d7640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f0b2f4d76d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7f0b2f4d7880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7f0b2f4d7910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7f0b2f4d7a30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7f0b2f4d7ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7f0b2f4d7b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7f0b2f4d7be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f0b2f4d7e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7f0b2f4d7f40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7f0b2f4d7d90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7f0b2f4d7eb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f0b2f50c1f0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27540: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e0a132e2eb57f4aae60757, topology_type: Single, servers: [<ServerDescription ('localhost', 27540) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27540: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27540: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e0a132e2eb57f4aae60757, topology_type: Single, servers: [<ServerDescription ('localhost', 27540) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27540: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hphiqiq44wlpk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_MongoDBIO_IT #6863
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6863/display/redirect?page=changes>
Changes:
[noreply] Clarify llm download/loading instructions (#25145)
------------------------------------------
[...truncated 17.47 KB...]
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting attrs>=19.2.0
Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting exceptiongroup>=1.0.0
Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting pbr>=0.11
Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting iniconfig
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (198 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting scipy>=1.3.2
Using cached scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 MB)
Collecting threadpoolctl>=2.0.0
Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 kB)
Collecting wrapt
Using cached wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (77 kB)
Collecting docker>=4.0.0
Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql
Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in <https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages> (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, pytest-xdist, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-39.0.0 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76: FutureWarning: WriteToMongoDB is experimental.
| 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function annotate_downstream_side_inputs at 0x7fbb43587010> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function fix_side_input_pcoll_coders at 0x7fbb43587130> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fbb43587640> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fbb435876d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_sdf at 0x7fbb43587880> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function expand_gbk at 0x7fbb43587910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sink_flattens at 0x7fbb43587a30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function greedily_fuse at 0x7fbb43587ac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function read_to_impulse at 0x7fbb43587b50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function impulse_to_input at 0x7fbb43587be0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fbb43587e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function add_impulse_to_dangling_transforms at 0x7fbb43587f40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function setup_timer_mapping at 0x7fbb43587d90> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function populate_data_channel_coders at 0x7fbb43587eb0> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7fbb435c4880> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27414: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e04cd1561d80234fc9b77c, topology_type: Single, servers: [<ServerDescription ('localhost', 27414) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27414: [Errno 111] Connection refused')>]>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 170, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py",> line 69, in run
with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 112, in run
result = super().run(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 553, in run
self._options).run(False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py",> line 131, in run_pipeline
return runner.run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 201, in run_pipeline
self._latest_run_result = self.run_via_runner_api(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 222, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 453, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 781, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1010, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1346, in process_bundle
result_future = self._worker_handler.control_conn.push(process_bundle_req)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 379, in push
response = self.worker.do_instruction(request)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
return getattr(self, request_type)(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
self.output(decoded_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
_cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
raise exn
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
self.output_handler.handle_process_outputs(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
self._write_value_to_tag(tag, windowed_value, watermark_estimator)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
self.main_receivers.receive(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
self.consumer.process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
delayed_applications = self.dofn_runner.process(o)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
self._reraise_augmented(exn)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
raise new_exn.with_traceback(tb)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
return self.do_fn_invoker.invoke_process(windowed_value)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 757, in process
self._flush()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 763, in _flush
sink.write(self.batch)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py",> line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py",> line 527, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 557, in execute
return self.execute_command(generator, write_concern, session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py",> line 366, in execute_command
with client._tmp_session(session) as s:
File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
return next(self.gen)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2040, in _tmp_session
s = self._ensure_session(session)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2027, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 1976, in __start_session
server_session = self._get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py",> line 2013, in _get_server_session
return self._topology.get_server_session()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 525, in get_server_session
session_timeout = self._check_session_support()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 507, in _check_session_support
self._select_servers_loop(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py",> line 226, in _select_servers_loop
raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27414: [Errno 111] Connection refused, Timeout: 30s, Topology Description: <TopologyDescription id: 63e04cd1561d80234fc9b77c, topology_type: Single, servers: [<ServerDescription ('localhost', 27414) server_type: Unknown, rtt: None, error=AutoReconnect('localhost:27414: [Errno 111] Connection refused')>]> [while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']
> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 120
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 1m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/23dly7x3j3aru
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org