You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/01/15 22:39:00 UTC

[jira] [Work logged] (BEAM-6318) beam-sdks-python:setupVirtualenv pluggy flaky

     [ https://issues.apache.org/jira/browse/BEAM-6318?focusedWorklogId=185461&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185461 ]

ASF GitHub Bot logged work on BEAM-6318:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 15/Jan/19 22:38
            Start Date: 15/Jan/19 22:38
    Worklog Time Spent: 10m 
      Work Description: tvalentyn commented on pull request #7519: [BEAM-6318] Increase the amount of pip download retries to 10 from a default 5
URL: https://github.com/apache/beam/pull/7519
 
 
   In BEAM-6318 we suspect that Beam test suites sometimes become flaky during PyPi outages, and we are exploring adding retries as a mitigation. This PR increases the number of retries used by `pip` from 5(default) to 10. In `pip`, retries happen with a back-off. I verified on a VM without internet access that with 10 retries `pip` attempts to download a package throughout 4 minutes, while first 5 attempts happen within 5 seconds.
   
   If pip retry mechanism proves not sufficient to mitigate BEAM-6318, we can issue multiple calls to `pip`, also with a back-off.
   
   ------------------------
   
   Post-Commit Tests Status (on master branch)
   ------------------------------------------------------------------------------------------------
   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---
   Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)
   Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | ---
   
   
   
   
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 185461)
            Time Spent: 10m
    Remaining Estimate: 0h

> beam-sdks-python:setupVirtualenv pluggy flaky
> ---------------------------------------------
>
>                 Key: BEAM-6318
>                 URL: https://issues.apache.org/jira/browse/BEAM-6318
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Andrew Pilloud
>            Assignee: Valentyn Tymofieiev
>            Priority: Major
>             Fix For: 2.11.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PreCommit_Python_Cron/752/
> {code}
> 16:00:43 Collecting pluggy<1.0,>=0.3.0 (from tox==3.0.0)
> 16:00:43   Could not find a version that satisfies the requirement pluggy<1.0,>=0.3.0 (from tox==3.0.0) (from versions: )
> 16:00:43 No matching distribution found for pluggy<1.0,>=0.3.0 (from tox==3.0.0)
> 16:00:46 
> 16:00:46 > Task :beam-sdks-python:setupVirtualenv FAILED
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)