You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2026/05/07 18:22:04 UTC

(spark-docker) branch master updated: [SPARK-56783] Disable `volcano` profile in K8S IT

This is an automated email from the ASF dual-hosted git repository.

dongjoon-hyun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark-docker.git


The following commit(s) were added to refs/heads/master by this push:
     new 273ff8c  [SPARK-56783] Disable `volcano` profile in K8S IT
273ff8c is described below

commit 273ff8c23da6c03cd76fe41570ff66c8be8b4ba1
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Thu May 7 11:21:58 2026 -0700

    [SPARK-56783] Disable `volcano` profile in K8S IT
    
    ### What changes were proposed in this pull request?
    
    This PR aims to disable the `volcano` profile during Kubernetes integration tests by appending `-P!volcano` to the sbt invocation in `.github/workflows/main.yml`.
    
    ### Why are the changes needed?
    
    Starting from Apache Spark `v4.2.0-preview5`, the `volcano` profile is enabled by default.
    
    - https://github.com/apache/spark/pull/53693
    
    Because this repository's K8S IT workflow runs on a `minikube` cluster without a Volcano scheduler installed, the auto-activated profile pulls in the `volcano-client` dependency and Volcano-specific test sources, which can fail the test step. Adding `-P!volcano` (Maven's standard profile-deactivation syntax) explicitly disables the profile.
    
    For previous versions (3.5.x / 4.0.x / 4.1.x), `volcano` is not active by default, so `-P!volcano` is a no-op and does not affect their builds.
    
    ### Does this PR introduce _any_ user-facing change?
    
    No. This is a CI-only change.
    
    ### How was this patch tested?
    
    Pass the CIs.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    Generated-by: Claude Code (claude-opus-4-7)
    
    Closes #111 from dongjoon-hyun/dongjoon/goofy-hellman-d99e62.
    
    Authored-by: Dongjoon Hyun <do...@apache.org>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 .github/workflows/main.yml | 1 +
 1 file changed, 1 insertion(+)

diff --git a/.github/workflows/main.yml b/.github/workflows/main.yml
index 08e4074..52dedec 100644
--- a/.github/workflows/main.yml
+++ b/.github/workflows/main.yml
@@ -284,6 +284,7 @@ jobs:
 
           eval $(minikube docker-env)
           OPTS="-Pkubernetes -Pkubernetes-integration-tests "
+          OPTS+='-P!volcano '
           OPTS+="-Dspark.kubernetes.test.driverRequestCores=0.5 -Dspark.kubernetes.test.executorRequestCores=0.2 "
           OPTS+="-Dspark.kubernetes.test.deployMode=minikube "
           OPTS+="-Dspark.kubernetes.test.imageRepo=${TEST_REPO} -Dspark.kubernetes.test.imageTag=${UNIQUE_IMAGE_TAG} "


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org