(spark) branch master updated: [SPARK-49869][INFRA] Add NumPy in Python 3.13 image

[do...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new a38505c9455f [SPARK-49869][INFRA] Add NumPy in Python 3.13 image
a38505c9455f is described below

commit a38505c9455f42f986f9d315eac30516d907135b
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Thu Oct 3 17:39:56 2024 -0700

    [SPARK-49869][INFRA] Add NumPy in Python 3.13 image
    
    ### What changes were proposed in this pull request?
    
    This PR add NumPy in Python 3.13 image. Note that this is different from SPARK-49862 because NumPy is a required dependency for ML in Python.
    
    ### Why are the changes needed?
    
    To fix Python 3.13 (https://github.com/apache/spark/actions/runs/11168860784/job/31048343334).
    
    ### Does this PR introduce _any_ user-facing change?
    
    No, dev-only.
    
    ### How was this patch tested?
    
    Will monitor the build.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No.
    
    Closes #48342 from HyukjinKwon/SPARK-49869.
    
    Authored-by: Hyukjin Kwon <gu...@apache.org>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 dev/infra/Dockerfile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/dev/infra/Dockerfile b/dev/infra/Dockerfile
index 24f858a234dd..1619b009e936 100644
--- a/dev/infra/Dockerfile
+++ b/dev/infra/Dockerfile
@@ -148,7 +148,7 @@ RUN apt-get update && apt-get install -y \
 RUN curl -sS https://bootstrap.pypa.io/get-pip.py | python3.13
 # TODO(SPARK-49862) Add BASIC_PIP_PKGS and CONNECT_PIP_PKGS to Python 3.13 image when it supports Python 3.13
 RUN python3.13 -m pip install --ignore-installed blinker>=1.6.2 # mlflow needs this
-RUN python3.13 -m pip install lxml && \
+RUN python3.13 -m pip install lxml numpy>=2.1 && \
     python3.13 -m pip cache purge
 
 # Remove unused installation packages to free up disk space


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org