You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/11/26 18:31:48 UTC

(spark) branch branch-4.1 updated: [SPARK-54520][INFRA] Ignore Missing Packages in CI free_disk_space Step

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-4.1 by this push:
     new d2f35f5ddc2f [SPARK-54520][INFRA] Ignore Missing Packages in CI free_disk_space Step
d2f35f5ddc2f is described below

commit d2f35f5ddc2fd01a99425ef279aec8f49800406d
Author: Yicong-Huang <17...@users.noreply.github.com>
AuthorDate: Wed Nov 26 11:14:29 2025 +0900

    [SPARK-54520][INFRA] Ignore Missing Packages in CI free_disk_space Step
    
    ### What changes were proposed in this pull request?
    Allow the CI `free_disk_space` step to ignore missing packages during `apt-get remove`.
    
    ### Why are the changes needed?
    Intermittent network or upstream issues can cause apt-get to fail when certain packages cannot be located. This failure blocks the `apt-get remove` operations in `free_disk_space`. Since these packages are optional for cleanup and their absence is harmless, we can safely ignore missing-package errors and let the step continue.
    
    Example CI failure: [https://github.com/Yicong-Huang/spark/actions/runs/19686762867/job/56398651193](https://github.com/Yicong-Huang/spark/actions/runs/19686762867/job/56398651193)
    
    ### Does this PR introduce _any_ user-facing change?
    No
    
    ### How was this patch tested?
    CI
    
    ### Was this patch authored or co-authored using generative AI tooling?
    No
    
    Closes #53226 from Yicong-Huang/fix/ignore-unfound-packages.
    
    Authored-by: Yicong-Huang <17...@users.noreply.github.com>
    Signed-off-by: Hyukjin Kwon <gu...@apache.org>
    (cherry picked from commit 78e911826d648b491732e032576d13958efa1fc3)
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 dev/free_disk_space | 1 +
 1 file changed, 1 insertion(+)

diff --git a/dev/free_disk_space b/dev/free_disk_space
index 2e6621045901..d0916a32f301 100755
--- a/dev/free_disk_space
+++ b/dev/free_disk_space
@@ -44,6 +44,7 @@ sudo rm -rf /opt/hostedtoolcache/go
 sudo rm -rf /opt/hostedtoolcache/node
 du -sh /opt/*
 
+sudo apt-get update --fix-missing
 sudo apt-get remove --purge -y '^aspnet.*'
 sudo apt-get remove --purge -y '^dotnet-.*'
 sudo apt-get remove --purge -y '^llvm-.*'


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org