You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by nc...@apache.org on 2026/09/04 13:36:40 UTC

(spark) branch master updated: [MINOR][INFRA][DOC] Merge conflicting specification of PySpark Python version in `docs` job

This is an automated email from the ASF dual-hosted git repository.

nchammas pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 5e21a099d230 [MINOR][INFRA][DOC] Merge conflicting specification of PySpark Python version in `docs` job
5e21a099d230 is described below

commit 5e21a099d230a535cfa6ca7acde3fbdc929ba9ac
Author: Nicholas Chammas <ni...@gmail.com>
AuthorDate: Fri Sep 4 09:36:25 2026 -0400

    [MINOR][INFRA][DOC] Merge conflicting specification of PySpark Python version in `docs` job
    
    ### What changes were proposed in this pull request?
    
    Merge the inline shell specification of PySpark Python up into the job-level `env` block. Inline specifies Python 3.12 and overrides the job-level specification of Python 3.9.
    
    ### Why are the changes needed?
    
    I believe the conflict of 3.9 vs. 3.12 on the same job is an unintentional oversight from #54310.
    
    ### Does this PR introduce _any_ user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    CI ran the affected `docs` job [successfully](https://github.com/nchammas/spark/actions/runs/33769150677/job/100696029564#step:12:33).
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No.
    
    Closes #58497 from nchammas/docs-py3.12.
    
    Authored-by: Nicholas Chammas <ni...@gmail.com>
    Signed-off-by: Nicholas Chammas <ni...@gmail.com>
---
 .github/workflows/build_and_test.yml | 6 ++----
 1 file changed, 2 insertions(+), 4 deletions(-)

diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 6fe395279951..e28aaa6ca48f 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -1080,8 +1080,8 @@ jobs:
     env:
       LC_ALL: C.UTF-8
       LANG: C.UTF-8
-      PYSPARK_DRIVER_PYTHON: python3.9
-      PYSPARK_PYTHON: python3.9
+      PYSPARK_DRIVER_PYTHON: python3.12
+      PYSPARK_PYTHON: python3.12
       GITHUB_PREV_SHA: ${{ github.event.before }}
     container:
       image: ${{ needs.precondition.outputs.image_docs_url_link }}
@@ -1152,8 +1152,6 @@ jobs:
           if [ `./dev/is-changed.py -m $pyspark_modules` = false ]; then export SKIP_PYTHONDOC=1; fi
           if [ `./dev/is-changed.py -m sparkr` = false ]; then export SKIP_RDOC=1; fi
         fi
-        export PYSPARK_DRIVER_PYTHON=python3.12
-        export PYSPARK_PYTHON=python3.12
         # Print the values of environment variables `SKIP_ERRORDOC`, `SKIP_SCALADOC`, `SKIP_PYTHONDOC`, `SKIP_RDOC` and `SKIP_SQLDOC`
         echo "SKIP_ERRORDOC: $SKIP_ERRORDOC"
         echo "SKIP_SCALADOC: $SKIP_SCALADOC"


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org