[GitHub] [airflow] potiuk commented on pull request #21825: Add CI jobs and tooling to aid with tracking backtracking pip issues

[GitBox <gi...@apache.org>]

potiuk commented on pull request #21825:
URL: https://github.com/apache/airflow/pull/21825#issuecomment-1052132664


   I think this one is ready for review and it should be really helpful in the future when analysing `pip resolver` issues.
   
   You can see an example of what happens, here: https://github.com/potiuk/airflow/actions/runs/1903230054
   
   If there is a sudden problem with backtracking, there is a "failure" handler in the Build Image step and will produce candidates of packages that have been updated in the last 1 day:
   
   <img width="1612" alt="Screenshot 2022-02-26 at 14 47 16" src="https://user-images.githubusercontent.com/595491/155845696-bb07f46b-b689-4026-88b9-2816574cd6db.png">
   
   This will not only produce the list and information about those "candidates" but also a `pip install` command that we should use to iterate in order to find the problem. Detailed instruction on what to do is added in this PR and should be avaliable under the link when we merge it.
   
   Also I improved something that we knew needs fixing  (@ashb) - cancelling the "waiting" job in case Building Image fails. Rather than finding and cancelling job, I simply build and push empty images, which is properly detected by the "waiting for image" job:
   
   <img width="1510" alt="Screenshot 2022-02-26 at 14 48 32" src="https://user-images.githubusercontent.com/595491/155845795-3f3b0117-c1fa-4b07-aca8-ff5db471adf2.png">
   
   
   
   
   
   
   
   
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org