You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 04:50:21 UTC
[PR] [SPARK-55829][INFRA] Skip PySpark/SparkR/TPC-DS CI for static-resource-only changes [spark]
yaooqinn opened a new pull request, #54616:
URL: https://github.com/apache/spark/pull/54616
### What changes were proposed in this pull request?
When a PR only modifies static UI resources (JS, CSS, HTML files), skip PySpark, SparkR, TPC-DS, and Docker integration tests in CI.
Adds a `static_only` check in the precondition job of `build_and_test.yml`. After `is-changed.py` determines affected modules, it iterates all changed files. If every file matches `*/resources/*/static/*`, `*.css`, `*.js`, or `*.html`, it overrides:
- `pyspark` → `false`
- `pandas` → `false`
- `sparkr` → `false`
- `tpcds` → `false`
- `docker` → `false`
Build and lint jobs still run (needed for compilation check and lint-js).
### Why are the changes needed?
UI modernization PRs (SPARK-55760) change only JS/CSS/HTML files but currently trigger the full CI matrix (~30 jobs). PySpark, SparkR, TPC-DS, and Docker tests are completely unaffected by static resource changes. Skipping them saves ~20 CI jobs per UI-only PR.
### Does this PR introduce _any_ user-facing change?
No. Only affects CI pipeline behavior for static-resource-only PRs.
### How was this patch tested?
Logic verified by inspecting `is-changed.py` module system — `core/` changes trigger all downstream modules because `is-changed.py` does not distinguish source code from static resources within a module.
### Was this patch authored or co-authored using generative AI tooling?
Yes, co-authored with GitHub Copilot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-55829][INFRA] Skip PySpark/SparkR/TPC-DS CI for static-resource-only changes [spark]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn closed pull request #54616: [SPARK-55829][INFRA] Skip PySpark/SparkR/TPC-DS CI for static-resource-only changes
URL: https://github.com/apache/spark/pull/54616
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-55829][INFRA] Skip PySpark/SparkR/TPC-DS CI for static-resource-only changes [spark]
Posted by "yaooqinn (via GitHub)" <gi...@apache.org>.
yaooqinn commented on PR #54616:
URL: https://github.com/apache/spark/pull/54616#issuecomment-3998528140
Thank you @dongjoon-hyun.
Merged to master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org