You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2020/10/12 16:05:00 UTC
[jira] [Commented] (BEAM-10567) PythonDocker precommit seems flaky
[ https://issues.apache.org/jira/browse/BEAM-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212469#comment-17212469 ]
Brian Hulette commented on BEAM-10567:
--------------------------------------
PythonDocker PreCommit looks much more stable now. I only see one recent failure (https://ci-beam.apache.org/job/beam_PreCommit_PythonDocker_Cron/757) with a different error (copied below). I think this can be closed.
{code}
11:09:59 Collecting pyarrow==0.16.0
11:09:59 Downloading pyarrow-0.16.0-cp38-cp38-manylinux2014_x86_64.whl (63.2 MB)
11:09:59 ERROR: Exception:
11:09:59 Traceback (most recent call last):
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher
11:09:59 yield
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 519, in read
11:09:59 data = self._fp.read(amt) if not fp_closed else b""
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read
11:09:59 data = self.__fp.read(amt)
11:09:59 File "/usr/local/lib/python3.8/http/client.py", line 458, in read
11:09:59 n = self.readinto(b)
11:09:59 File "/usr/local/lib/python3.8/http/client.py", line 502, in readinto
11:09:59 n = self.fp.readinto(b)
11:09:59 File "/usr/local/lib/python3.8/socket.py", line 669, in readinto
11:09:59 return self._sock.recv_into(b)
11:09:59 File "/usr/local/lib/python3.8/ssl.py", line 1241, in recv_into
11:09:59 return self.read(nbytes, buffer)
11:09:59 File "/usr/local/lib/python3.8/ssl.py", line 1099, in read
11:09:59 return self._sslobj.read(len, buffer)
11:09:59 ConnectionResetError: [Errno 104] Connection reset by peer
11:09:59
11:09:59 During handling of the above exception, another exception occurred:
11:09:59
11:09:59 Traceback (most recent call last):
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 228, in _main
11:09:59 status = self.run(options, args)
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
11:09:59 return func(self, options, args)
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/commands/install.py", line 323, in run
11:09:59 requirement_set = resolver.resolve(
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/resolution/legacy/resolver.py", line 183, in resolve
11:09:59 discovered_reqs.extend(self._resolve_one(requirement_set, req))
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/resolution/legacy/resolver.py", line 388, in _resolve_one
11:09:59 abstract_dist = self._get_abstract_dist_for(req_to_install)
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/resolution/legacy/resolver.py", line 340, in _get_abstract_dist_for
11:09:59 abstract_dist = self.preparer.prepare_linked_requirement(req)
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 467, in prepare_linked_requirement
11:09:59 local_file = unpack_url(
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 255, in unpack_url
11:09:59 file = get_http_url(
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 129, in get_http_url
11:09:59 from_path, content_type = _download_http_url(
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/operations/prepare.py", line 282, in _download_http_url
11:09:59 for chunk in download.chunks:
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/cli/progress_bars.py", line 168, in iter
11:09:59 for x in it:
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_internal/network/utils.py", line 64, in response_chunks
11:09:59 for chunk in response.raw.stream(
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 576, in stream
11:09:59 data = self.read(amt=amt, decode_content=decode_content)
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 541, in read
11:09:59 raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
11:09:59 File "/usr/local/lib/python3.8/contextlib.py", line 131, in __exit__
11:09:59 self.gen.throw(type, value, traceback)
11:09:59 File "/usr/local/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 455, in _error_catcher
11:09:59 raise ProtocolError("Connection broken: %r" % e, e)
11:09:59 pip._vendor.urllib3.exceptions.ProtocolError: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer'))
11:10:02 The command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt' returned a non-zero code: 2
11:10:02
11:10:02 > Task :sdks:python:container:py38:docker FAILED
11:10:02 :sdks:python:container:py38:docker (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 1 mins 3.255 secs.
{code}
> PythonDocker precommit seems flaky
> ----------------------------------
>
> Key: BEAM-10567
> URL: https://issues.apache.org/jira/browse/BEAM-10567
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Udi Meiri
> Priority: P1
> Labels: flake
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
> I've been getting these failures recently:
> {code}
> 08:53:23 > Task :sdks:python:container:py2:docker FAILED
> 08:53:23 The command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip' returned a non-zero code: 2
> 08:53:23 :sdks:python:container:py2:docker (Thread[Execution worker for ':' Thread 11,5,main]) completed. Took 2 mins 32.762 secs.
> {code}
> https://ci-beam.apache.org/job/beam_PreCommit_PythonDocker_Commit/1746/consoleFull
--
This message was sent by Atlassian Jira
(v8.3.4#803005)