You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/08/22 13:53:05 UTC

[GitHub] [airflow] potiuk opened a new pull request #10476: Optimise production image building during k8s tests on CI

potiuk opened a new pull request #10476:
URL: https://github.com/apache/airflow/pull/10476


   We do not have to rebuild PROD images now because we changed
   the strategy of preparing the image for k8s tests instead of
   embedding dags during build with EMBEDDED_DAGS build arg we
   are now extending the image with FROM: clause and add dags
   on top of the PROD base image. We've been rebuilding the
   image twice during each k8s run - once in Prepare PROD image
   and once in "Deploy airflow to cluster" both are not needed
   and both lasted ~ 2m 30s, so we should save around 5m for every
   K8S jobi (~30% as the while K8S test job is around 15m).
   
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more information.
   In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in [UPDATING.md](https://github.com/apache/airflow/blob/master/UPDATING.md).
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk merged pull request #10476: Optimise production image building during k8s tests on CI

Posted by GitBox <gi...@apache.org>.
potiuk merged pull request #10476:
URL: https://github.com/apache/airflow/pull/10476


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk commented on pull request #10476: Optimise production image building during k8s tests on CI

Posted by GitBox <gi...@apache.org>.
potiuk commented on pull request #10476:
URL: https://github.com/apache/airflow/pull/10476#issuecomment-678649190


   Confirmed. We have 9-10 mins now instead of 14-15m previously. @dimberman Looks like we are pretty ready to add more tests and even more combinations of Kubernetes versions.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] kaxil commented on pull request #10476: Optimise production image building during k8s tests on CI

Posted by GitBox <gi...@apache.org>.
kaxil commented on pull request #10476:
URL: https://github.com/apache/airflow/pull/10476#issuecomment-678684255


   Nice, good work Jarek on the optimizations 👍


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org