You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/08/22 13:53:05 UTC
[GitHub] [airflow] potiuk opened a new pull request #10476: Optimise production image building during k8s tests on CI
potiuk opened a new pull request #10476:
URL: https://github.com/apache/airflow/pull/10476
We do not have to rebuild PROD images now because we changed
the strategy of preparing the image for k8s tests instead of
embedding dags during build with EMBEDDED_DAGS build arg we
are now extending the image with FROM: clause and add dags
on top of the PROD base image. We've been rebuilding the
image twice during each k8s run - once in Prepare PROD image
and once in "Deploy airflow to cluster" both are not needed
and both lasted ~ 2m 30s, so we should save around 5m for every
K8S jobi (~30% as the while K8S test job is around 15m).
---
**^ Add meaningful description above**
Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines)** for more information.
In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed.
In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x).
In case of backwards incompatible changes please leave a note in [UPDATING.md](https://github.com/apache/airflow/blob/master/UPDATING.md).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk merged pull request #10476: Optimise production image building during k8s tests on CI
Posted by GitBox <gi...@apache.org>.
potiuk merged pull request #10476:
URL: https://github.com/apache/airflow/pull/10476
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on pull request #10476: Optimise production image building during k8s tests on CI
Posted by GitBox <gi...@apache.org>.
potiuk commented on pull request #10476:
URL: https://github.com/apache/airflow/pull/10476#issuecomment-678649190
Confirmed. We have 9-10 mins now instead of 14-15m previously. @dimberman Looks like we are pretty ready to add more tests and even more combinations of Kubernetes versions.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] kaxil commented on pull request #10476: Optimise production image building during k8s tests on CI
Posted by GitBox <gi...@apache.org>.
kaxil commented on pull request #10476:
URL: https://github.com/apache/airflow/pull/10476#issuecomment-678684255
Nice, good work Jarek on the optimizations 👍
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org