You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Valentyn Tymofieiev (Jira)" <ji...@apache.org> on 2020/09/17 22:02:00 UTC
[jira] [Created] (BEAM-10923) Python requirements installation in
docker container is flaky
Valentyn Tymofieiev created BEAM-10923:
------------------------------------------
Summary: Python requirements installation in docker container is flaky
Key: BEAM-10923
URL: https://issues.apache.org/jira/browse/BEAM-10923
Project: Beam
Issue Type: Bug
Components: test-failures
Reporter: Valentyn Tymofieiev
{noformat}
39133 ---> 4d9c74917b64
39134 Step 7/22 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation. _default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip
39135 ---> Running in 0422f8365726
39136 Ignoring avro: markers 'python_version <= "2.7"' don't match your environment
39137 Ignoring futures: markers 'python_version < "3.0"' don't match your environment
39138 Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment
39139 Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment
39140 Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment
39141 Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment
39142 Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment
39143 Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment
39144 Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment
39145 Collecting avro-python3==1.8.2
39146 Downloading avro-python3-1.8.2.tar.gz (36 kB)
39147 Collecting fastavro==0.23.3
39148 Downloading fastavro-0.23.3-cp37-cp37m-manylinux2010_x86_64.whl (1.4 MB)
39149 Collecting crcmod==1.7
39150 Downloading crcmod-1.7.tar.gz (89 kB)
39151 Collecting dill==0.3.1.1
39152 Downloading dill-0.3.1.1.tar.gz (151 kB)
39153 Collecting future==0.18.2
39154 Downloading future-0.18.2.tar.gz (829 kB)
39155 Collecting grpcio==1.29.0
39156 Downloading grpcio-1.29.0-cp37-cp37m-manylinux2010_x86_64.whl (3.0 MB)
39157 Collecting hdfs==2.5.8
39158 Downloading hdfs-2.5.8.tar.gz (41 kB)
39159 Collecting httplib2==0.12.0
39160 Downloading httplib2-0.12.0.tar.gz (218 kB)
39161 Collecting mock==2.0.0
39162 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
39163 Collecting oauth2client==3.0.0
39164 Downloading oauth2client-3.0.0.tar.gz (77 kB)
39165 Collecting protobuf==3.12.2
39166 Downloading protobuf-3.12.2-cp37-cp37m-manylinux1_x86_64.whl (1.3 MB)
39167 Collecting pyarrow==0.16.0
39168 Downloading pyarrow-0.16.0-cp37-cp37m-manylinux2014_x86_64.whl (63.1 MB)
39169 ^[[91mERROR: Exception:
39170 Traceback (most recent call last):
39171 File "/usr/local/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher
39172 yield
39173 File "/usr/local/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 519, in read
39174 data = self._fp.read(amt) if not fp_closed else b""
39175 File "/usr/local/lib/python3.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read
39176 data = self.__fp.read(amt)
39177 File "/usr/local/lib/python3.7/http/client.py", line 461, in read
39178 n = self.readinto(b)
39179 File "/usr/local/lib/python3.7/http/client.py", line 505, in readinto
39180 n = self.fp.readinto(b)
39181 File "/usr/local/lib/python3.7/socket.py", line 589, in readinto
39182 return self._sock.recv_into(b)
39183 File "/usr/local/lib/python3.7/ssl.py", line 1071, in recv_into
39184 return self.read(nbytes, buffer)
39185 File "/usr/local/lib/python3.7/ssl.py", line 929, in read
39186 return self._sslobj.read(len, buffer)
39187 ConnectionResetError: [Errno 104] Connection reset by peer
39188
{noformat}
We should try to make it more resilient either during the build or restart the container build if it was unsuccessful for a few times.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)