You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2022/11/01 22:27:30 UTC

[airflow] branch main updated: Fix cleanup of multi-processing behaviour for pyc cleanup (#27454)

This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 79896191f6 Fix cleanup of multi-processing behaviour for pyc cleanup (#27454)
79896191f6 is described below

commit 79896191f6e61984667077cc68a87524b9b24c4a
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Tue Nov 1 23:27:23 2022 +0100

    Fix cleanup of multi-processing behaviour for pyc cleanup (#27454)
    
    The recently introduced (in #27426i) for .pyc files cleaning caused
    problem on multi-processing/parallel tests when parallel tests were
    removing the same files at the same time.
    
    This PR moves cleanup to before parallelising.
---
 dev/breeze/src/airflow_breeze/commands/testing_commands.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/dev/breeze/src/airflow_breeze/commands/testing_commands.py b/dev/breeze/src/airflow_breeze/commands/testing_commands.py
index 2f267d1f6e..33781e3373 100644
--- a/dev/breeze/src/airflow_breeze/commands/testing_commands.py
+++ b/dev/breeze/src/airflow_breeze/commands/testing_commands.py
@@ -153,7 +153,6 @@ def _run_test(
         "--remove-orphans",
     ]
     run_command(down_cmd, env=env_variables, output=output, check=False)
-    cleanup_python_generated_files()
     run_cmd = [
         *DOCKER_COMPOSE_COMMAND,
         "--project-name",
@@ -410,6 +409,7 @@ def tests(
         forward_ports=False,
         test_type=test_type,
     )
+    cleanup_python_generated_files()
     if run_in_parallel:
         run_tests_in_parallel(
             exec_shell_params=exec_shell_params,