You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Valentyn Tymofieiev (Jira)" <ji...@apache.org> on 2020/09/17 22:02:00 UTC

[jira] [Created] (BEAM-10923) Python requirements installation in docker container is flaky

Valentyn Tymofieiev created BEAM-10923:
------------------------------------------

             Summary: Python requirements installation in docker container is flaky
                 Key: BEAM-10923
                 URL: https://issues.apache.org/jira/browse/BEAM-10923
             Project: Beam
          Issue Type: Bug
          Components: test-failures
            Reporter: Valentyn Tymofieiev


{noformat}
39133  ---> 4d9c74917b64                                                              
 39134 Step 7/22 : RUN     pip install -r /tmp/base_image_requirements.txt &&     python -c "from google.protobuf.internal import api_implementation; assert api_implementation.                      _default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" &&     rm -rf /root/.cache/pip
 39135  ---> Running in 0422f8365726                                                   
 39136 Ignoring avro: markers 'python_version <= "2.7"' don't match your environment   
 39137 Ignoring futures: markers 'python_version < "3.0"' don't match your environment 
 39138 Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment   
 39139 Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment
 39140 Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment  
 39141 Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment  
 39142 Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment  
 39143 Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment 
 39144 Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment
 39145 Collecting avro-python3==1.8.2                                                  
 39146   Downloading avro-python3-1.8.2.tar.gz (36 kB)                                 
 39147 Collecting fastavro==0.23.3                                                     
 39148   Downloading fastavro-0.23.3-cp37-cp37m-manylinux2010_x86_64.whl (1.4 MB)      
 39149 Collecting crcmod==1.7                                                          
 39150   Downloading crcmod-1.7.tar.gz (89 kB)                                         
 39151 Collecting dill==0.3.1.1                                                        
 39152   Downloading dill-0.3.1.1.tar.gz (151 kB)                                      
 39153 Collecting future==0.18.2                                                       
 39154   Downloading future-0.18.2.tar.gz (829 kB)                                     
 39155 Collecting grpcio==1.29.0                                                       
 39156   Downloading grpcio-1.29.0-cp37-cp37m-manylinux2010_x86_64.whl (3.0 MB)        
 39157 Collecting hdfs==2.5.8                                                          
 39158   Downloading hdfs-2.5.8.tar.gz (41 kB)                                         
 39159 Collecting httplib2==0.12.0                                                     
 39160   Downloading httplib2-0.12.0.tar.gz (218 kB)                                   
 39161 Collecting mock==2.0.0                                                          
 39162   Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)                           
 39163 Collecting oauth2client==3.0.0                                                  
 39164   Downloading oauth2client-3.0.0.tar.gz (77 kB)                                 
 39165 Collecting protobuf==3.12.2                                                     
 39166   Downloading protobuf-3.12.2-cp37-cp37m-manylinux1_x86_64.whl (1.3 MB)         
 39167 Collecting pyarrow==0.16.0                                                      
 39168   Downloading pyarrow-0.16.0-cp37-cp37m-manylinux2014_x86_64.whl (63.1 MB)      
 39169 ^[[91mERROR: Exception:                                                         
 39170 Traceback (most recent call last):                                              
 39171   File "/usr/local/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher
 39172     yield                                                                       
 39173   File "/usr/local/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 519, in read
 39174     data = self._fp.read(amt) if not fp_closed else b""                         
 39175   File "/usr/local/lib/python3.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read
 39176     data = self.__fp.read(amt)                                                  
 39177   File "/usr/local/lib/python3.7/http/client.py", line 461, in read             
 39178     n = self.readinto(b)                                                        
 39179   File "/usr/local/lib/python3.7/http/client.py", line 505, in readinto         
 39180     n = self.fp.readinto(b)                                                     
 39181   File "/usr/local/lib/python3.7/socket.py", line 589, in readinto              
 39182     return self._sock.recv_into(b)                                              
 39183   File "/usr/local/lib/python3.7/ssl.py", line 1071, in recv_into               
 39184     return self.read(nbytes, buffer)                                            
 39185   File "/usr/local/lib/python3.7/ssl.py", line 929, in read                     
 39186     return self._sslobj.read(len, buffer)                                       
 39187 ConnectionResetError: [Errno 104] Connection reset by peer                      
 39188                                                                      
{noformat}

We should try to make it more resilient either during the build or restart the container build if it was unsuccessful for a few times.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)