You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "rdtr (via GitHub)" <gi...@apache.org> on 2026/10/13 05:55:21 UTC

[PR] [GLUTEN-13180][VL] Re-enable the Spark 4.2 bucketed scan and ADD JAR tests [gluten]

rdtr opened a new pull request, #13261:
URL: https://github.com/apache/gluten/pull/13261

   ## What changes are proposed in this pull request?
   
   Re-enables 6 of the 11 Spark 4.2 tests in #13180 that #13163 disabled. This is a test-only change.
   
   - `GlutenDisableUnnecessaryBucketedScanWithoutHiveSupportSuiteAE`: "Aggregates with no groupby over tables having 1 BUCKET, return multiple rows" and the 4 "SPARK-32859: disable unnecessary bucketed table scan" tests. Since SPARK-54301, `checkNumBucketedScan` collects the query before it inspects the plan, so with AQE it inspects the final plan. Under Gluten that plan has `FileSourceScanExecTransformer` instead of `FileSourceScanExec`, and the check found no bucketed scan. The Gluten suite now overrides `checkNumBucketedScan` to count bucketed scans of both classes.
   - `GlutenHiveQuerySuite` "ADD JAR command 2": SPARK-56353 removed the `assume` on `TestUDTF.jar`, so the test now runs. It loads a data file through `TestHive.getHiveFile`, which resolves to a path inside the spark-hive test jar that `LOAD DATA` cannot read. The Gluten version of the test loads the file from the Hive test resources instead, as the existing Gluten "ADD FILE command" test does.
   
   The other 5 tests stay disabled until their fixes land:
   
   - `GlutenParquetIOSuite` "SPARK-54220: NullType": https://github.com/facebookincubator/velox/pull/19461
   - "SPARK-55857: Enabling/disabling ignoreMissingFiles" in the Parquet and ORC V1/V2 query suites: #13207
   
   Part of #13180.
   
   ## How was this patch tested?
   
   The changed tests compile on Spark 4.2. The Spark 4.2 UT CI runs the re-enabled tests.
   
   ## Was this patch authored or co-authored using generative AI tooling?
   
   Generated-by: Claude Code (Claude Opus 5.5)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-13180][VL] Re-enable the Spark 4.2 bucketed scan and ADD JAR tests [gluten]

Posted by "rdtr (via GitHub) via commits" <co...@gluten.apache.org>.
rdtr commented on PR #13261:
URL: https://github.com/apache/gluten/pull/13261#issuecomment-6646831760

   Closing as superseded by #13432, which re-enabled the same bucketed scan and ADD JAR tests. See #13181.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-13180][VL] Re-enable the Spark 4.2 bucketed scan and ADD JAR tests [gluten]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #13261:
URL: https://github.com/apache/gluten/pull/13261#issuecomment-6155256766

   Run Gluten Clickhouse CI on x86


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-13180][VL] Re-enable the Spark 4.2 bucketed scan and ADD JAR tests [gluten]

Posted by "rdtr (via GitHub) via commits" <co...@gluten.apache.org>.
rdtr closed pull request #13261: [GLUTEN-13180][VL] Re-enable the Spark 4.2 bucketed scan and ADD JAR tests
URL: https://github.com/apache/gluten/pull/13261


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-13180][VL] Re-enable the Spark 4.2 bucketed scan and ADD JAR tests [gluten]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #13261:
URL: https://github.com/apache/gluten/pull/13261#issuecomment-6139260406

   Run Gluten Clickhouse CI on x86


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org