You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/05/28 08:28:28 UTC

[GitHub] [airflow] potiuk opened a new pull request, #23980: Add better diagnostics capabilities for pre-commits run via CI image

potiuk opened a new pull request, #23980:
URL: https://github.com/apache/airflow/pull/23980

   The pre-commits that require CI image run docker command under
   the hood that is highly optimized for performance (only mounts
   files that are necessary to be mounted) - in order to improve
   performance on Mac OS and make sure that artifacts are not left
   in the source code of Airflow.
   
   However that makes the command slightly more difficult to debug
   because they generate dynamically the docker command used,
   including the volumens that should be mounted when the docker
   command is run.
   
   This PR adds better diagnostics to the pre-commit scripts
   allowing VERBOSE="true" and DRY_RUN="true" variables that can
   help with diagnosing problems such as running the scripts on
   WSL2.
   
   It also fixes a few documentation bugs that have been missed
   after changing names of the image-related static checks.
   
   <!--
   Thank you for contributing! Please make sure that your code changes
   are covered with tests. And in case of new features or big changes
   remember to adjust the documentation.
   
   Feel free to ping committers for the review!
   
   In case of existing issue, reference it using one of the following:
   
   closes: #ISSUE
   related: #ISSUE
   
   How to write a good git commit message:
   http://chris.beams.io/posts/git-commit/
   -->
   
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information.
   In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in a newsfragement file, named `{pr_number}.significant.rst`, in [newsfragments](https://github.com/apache/airflow/tree/main/newsfragments).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] potiuk commented on pull request #23980: Add better diagnostics capabilities for pre-commits run via CI image

Posted by GitBox <gi...@apache.org>.
potiuk commented on PR #23980:
URL: https://github.com/apache/airflow/pull/23980#issuecomment-1140225414

   Ah cool. I just used the new DRY_RUN feature to debug it :) 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] potiuk commented on pull request #23980: Add better diagnostics capabilities for pre-commits run via CI image

Posted by GitBox <gi...@apache.org>.
potiuk commented on PR #23980:
URL: https://github.com/apache/airflow/pull/23980#issuecomment-1140215819

   This is a result of https://apache-airflow.slack.com/archives/CCPRP7943/p1653687219387939 discussion in slack where WSL2 user had problems with running pre-commits.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] potiuk commented on pull request #23980: Add better diagnostics capabilities for pre-commits run via CI image

Posted by GitBox <gi...@apache.org>.
potiuk commented on PR #23980:
URL: https://github.com/apache/airflow/pull/23980#issuecomment-1140268493

   Green now :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] github-actions[bot] commented on pull request #23980: Add better diagnostics capabilities for pre-commits run via CI image

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #23980:
URL: https://github.com/apache/airflow/pull/23980#issuecomment-1140357182

   The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest main at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] eladkal commented on pull request #23980: Add better diagnostics capabilities for pre-commits run via CI image

Posted by GitBox <gi...@apache.org>.
eladkal commented on PR #23980:
URL: https://github.com/apache/airflow/pull/23980#issuecomment-1140218983

   static checks fail :( 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] potiuk merged pull request #23980: Add better diagnostics capabilities for pre-commits run via CI image

Posted by GitBox <gi...@apache.org>.
potiuk merged PR #23980:
URL: https://github.com/apache/airflow/pull/23980


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org