You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2021/03/13 04:59:00 UTC
[jira] [Updated] (BEAM-10923) Python requirements installation in
docker container is flaky
[ https://issues.apache.org/jira/browse/BEAM-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-10923:
-----------------------------------
Component/s: sdk-py-harness
> Python requirements installation in docker container is flaky
> -------------------------------------------------------------
>
> Key: BEAM-10923
> URL: https://issues.apache.org/jira/browse/BEAM-10923
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-harness, test-failures
> Reporter: Valentyn Tymofieiev
> Priority: P1
> Labels: currently-failing
>
> {noformat}
> 39133 ---> 4d9c74917b64
> 39134 Step 7/22 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation. _default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip
> 39135 ---> Running in 0422f8365726
> 39136 Ignoring avro: markers 'python_version <= "2.7"' don't match your environment
> 39137 Ignoring futures: markers 'python_version < "3.0"' don't match your environment
> 39138 Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment
> 39139 Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment
> 39140 Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment
> 39141 Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment
> 39142 Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment
> 39143 Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment
> 39144 Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment
> 39145 Collecting avro-python3==1.8.2
> 39146 Downloading avro-python3-1.8.2.tar.gz (36 kB)
> 39147 Collecting fastavro==0.23.3
> 39148 Downloading fastavro-0.23.3-cp37-cp37m-manylinux2010_x86_64.whl (1.4 MB)
> 39149 Collecting crcmod==1.7
> 39150 Downloading crcmod-1.7.tar.gz (89 kB)
> 39151 Collecting dill==0.3.1.1
> 39152 Downloading dill-0.3.1.1.tar.gz (151 kB)
> 39153 Collecting future==0.18.2
> 39154 Downloading future-0.18.2.tar.gz (829 kB)
> 39155 Collecting grpcio==1.29.0
> 39156 Downloading grpcio-1.29.0-cp37-cp37m-manylinux2010_x86_64.whl (3.0 MB)
> 39157 Collecting hdfs==2.5.8
> 39158 Downloading hdfs-2.5.8.tar.gz (41 kB)
> 39159 Collecting httplib2==0.12.0
> 39160 Downloading httplib2-0.12.0.tar.gz (218 kB)
> 39161 Collecting mock==2.0.0
> 39162 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
> 39163 Collecting oauth2client==3.0.0
> 39164 Downloading oauth2client-3.0.0.tar.gz (77 kB)
> 39165 Collecting protobuf==3.12.2
> 39166 Downloading protobuf-3.12.2-cp37-cp37m-manylinux1_x86_64.whl (1.3 MB)
> 39167 Collecting pyarrow==0.16.0
> 39168 Downloading pyarrow-0.16.0-cp37-cp37m-manylinux2014_x86_64.whl (63.1 MB)
> 39169 ^[[91mERROR: Exception:
> 39170 Traceback (most recent call last):
> 39171 File "/usr/local/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher
> 39172 yield
> 39173 File "/usr/local/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 519, in read
> 39174 data = self._fp.read(amt) if not fp_closed else b""
> 39175 File "/usr/local/lib/python3.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read
> 39176 data = self.__fp.read(amt)
> 39177 File "/usr/local/lib/python3.7/http/client.py", line 461, in read
> 39178 n = self.readinto(b)
> 39179 File "/usr/local/lib/python3.7/http/client.py", line 505, in readinto
> 39180 n = self.fp.readinto(b)
> 39181 File "/usr/local/lib/python3.7/socket.py", line 589, in readinto
> 39182 return self._sock.recv_into(b)
> 39183 File "/usr/local/lib/python3.7/ssl.py", line 1071, in recv_into
> 39184 return self.read(nbytes, buffer)
> 39185 File "/usr/local/lib/python3.7/ssl.py", line 929, in read
> 39186 return self._sslobj.read(len, buffer)
> 39187 ConnectionResetError: [Errno 104] Connection reset by peer
> 39188
> {noformat}
> We should try to make it more resilient either during the build or restart the container build if it was unsuccessful for a few times.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)