[airflow] branch main updated: Hard-remove parallell locks at cleanup (#17514)

[po...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 414dc17  Hard-remove parallell locks at cleanup (#17514)
414dc17 is described below

commit 414dc17f1b7a09266b83bdbba66e8191c726d743
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Tue Aug 10 06:36:23 2021 +0200

    Hard-remove parallell locks at cleanup (#17514)
    
    Some stale parallel locks might be a reason for hanging tests
    This is an attempt to hard-remove all the .parallel remnant
    directories in hope that it will avoid some of the hangs.
    
    Unfortunately in our approach we try to reuse runners between
    runs which might cause some remnants from the previous runs to
    impact subsequent runs. When we move to GCP we will try to spin
    off a new runner for every job to make sure the real "true clean
    state" is used when running a job.
---
 scripts/ci/libraries/_parallel.sh | 1 +
 1 file changed, 1 insertion(+)

diff --git a/scripts/ci/libraries/_parallel.sh b/scripts/ci/libraries/_parallel.sh
index 8125866..d5b99c7 100644
--- a/scripts/ci/libraries/_parallel.sh
+++ b/scripts/ci/libraries/_parallel.sh
@@ -52,6 +52,7 @@ function parallel::kill_stale_semaphore_locks() {
             rm -f "${s}" 2>/dev/null
         fi
     done
+    rm -rf "${HOME}/.parallel"
 }