[jira] [Commented] (BEAM-10567) PythonDocker precommit seems flaky

["Brian Hulette (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189617#comment-17189617 ] 

Brian Hulette commented on BEAM-10567:
--------------------------------------

Still happening:
https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Phrase/712/consoleFull#gradle-task-229
https://ci-beam.apache.org/job/beam_PreCommit_PythonDocker_Phrase/63/consoleFull

Same failure as the description, except exit code = 1

The first one doesn't seem to have any additional debugging, and only py2 failed. The second one py{2,3.5,3.6,3.7,3.8} all failed with some additional logging:
{code}
7:40:22 > Task :sdks:python:container:py35:docker FAILED
17:40:22 Skip pulling license for  apache-beam
17:40:22 Traceback (most recent call last):
17:40:22   File "/tmp/license_scripts/pull_licenses_py.py", line 151, in <module>
17:40:22     how_to=how_to))
17:40:22 RuntimeError: Could not retrieve licences for packages ['pbr'] in Python3.5 environment. 
17:40:22  These licenses were not able to be pulled automatically. Please search code source of the dependencies on the internet and add urls to RAW license file at sdks/python/container/license_scripts/dep_urls_py.yaml for each missing license and rerun the test. If no such urls can be found, you need to manually add LICENSE and NOTICE (if available) files at sdks/python/container/license_scripts/manual_licenses/{dep}/ and add entries to sdks/python/container/license_scripts/dep_urls_py.yaml.
17:40:22 The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then     pip install 'pip-licenses<3.0.0;python_version>="3.5"' &&     pip install 'pip-licenses==1.18.0;python_version<="2.7"' &&     python /tmp/license_scripts/pull_licenses_py.py &&     pip uninstall -y pip-licenses &&     rm -rf /root/.cache/pip ;    else     rm -rf /opt/apache/beam/third_party_licenses ;    fi' returned a non-zero code: 1
{code}

> PythonDocker precommit seems flaky
> ----------------------------------
>
>                 Key: BEAM-10567
>                 URL: https://issues.apache.org/jira/browse/BEAM-10567
>             Project: Beam
>          Issue Type: Bug
>          Components: test-failures
>            Reporter: Udi Meiri
>            Priority: P2
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> I've been getting these failures recently:
> {code}
> 08:53:23 > Task :sdks:python:container:py2:docker FAILED
> 08:53:23 The command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt &&     python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" &&     rm -rf /root/.cache/pip' returned a non-zero code: 2
> 08:53:23 :sdks:python:container:py2:docker (Thread[Execution worker for ':' Thread 11,5,main]) completed. Took 2 mins 32.762 secs.
> {code}
> https://ci-beam.apache.org/job/beam_PreCommit_PythonDocker_Commit/1746/consoleFull



--
This message was sent by Atlassian Jira
(v8.3.4#803005)