You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zhouyuan (via GitHub)" <gi...@apache.org> on 2025/11/14 09:24:31 UTC
[I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
zhouyuan opened a new issue, #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088
### Backend
VL (Velox)
### Bug description
After #10725 the general framework of unit tests are merged. We still have failed unit tests left here:
```
backends-velox/src/test/scala/org/apache/gluten/benchmarks/NativeBenchmarkPlanGenerator.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/execution/MiscOperatorSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/execution/MiscOperatorSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/execution/MiscOperatorSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/execution/python/ArrowEvalPythonExecSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/execution/python/ArrowEvalPythonExecSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/execution/python/ArrowEvalPythonExecSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/ArithmeticAnsiValidateSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/ArithmeticAnsiValidateSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/DateFunctionsValidateSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/JsonFunctionsValidateSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/JsonFunctionsValidateSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/JsonFunctionsValidateSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/ScalarFunctionsValidateSuite.scala: // TODO: fix on spark-4.0
backends-velox/src/test/scala/org/apache/gluten/functions/ScalarFunctionsValidateSuite.scala: // TODO: fix on spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/gluten/utils/velox/VeloxTestSettings.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/GlutenColumnExpressionSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/GlutenColumnExpressionSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/GlutenDataFrameSuite.scala: // TODO: fix in spark-4.0
src/test/scala/org/apache/spark/sql/GlutenDataFrameSuite.scala: // TODO: fix in spark-4.0
src/test/scala/org/apache/spark/sql/GlutenDynamicPartitionPruningSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/GlutenDynamicPartitionPruningSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/GlutenDynamicPartitionPruningSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/GlutenDynamicPartitionPruningSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/GlutenLateralColumnAliasSuite.scala:// TODO: fix in Spark-4.0 change back to LateralColumnAliasSuite
src/test/scala/org/apache/spark/sql/GlutenSubquerySuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/catalyst/expressions/GlutenDateExpressionsSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/catalyst/expressions/GlutenDateExpressionsSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/catalyst/expressions/GlutenDateExpressionsSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/GlutenSQLAggregateFunctionSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/GlutenSQLAggregateFunctionSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/GlutenSQLWindowFunctionSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/GlutenSQLWindowFunctionSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/GlutenSQLWindowFunctionSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/GlutenSortSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/datasources/GlutenV1WriteCommandSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/execution/datasources/GlutenV1WriteCommandSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/sources/GlutenInsertSuite.scala: // TODO: fix in Spark-4.0
src/test/scala/org/apache/spark/sql/sources/GlutenInsertSuite.scala: // TODO: fix in Spark-4.0
```
### Gluten version
_No response_
### Spark version
None
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
```bash
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3570542514
related: https://github.com/apache/incubator-gluten/issues/10072
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "FelixYBW (via GitHub)" <gi...@apache.org>.
FelixYBW commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3658714270
> Do you know the current state of ANSI support in Velox? I checked this thread ([#10387](https://github.com/apache/incubator-gluten/issues/10387)), and it seems only the try method is supported so far. Is this still the most recent status?
#10387 is the recent status. No one is working on it now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "baibaichen (via GitHub)" <gi...@apache.org>.
baibaichen closed issue #11088: [VL] Track on Spark-4.0 failed unit tests
URL: https://github.com/apache/incubator-gluten/issues/11088
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "baibaichen (via GitHub)" <gi...@apache.org>.
baibaichen commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3568686028
| 测试套件 / 文件 | Owner / 关联 PR |
|-----------------|-----------------|
| backends-velox/src/test/scala/org/apache/gluten/benchmarks/NativeBenchmarkPlanGenerator.scala | |
| MiscOperatorSuite | |
| ArrowEvalPythonExecSuite | |
| ArithmeticAnsiValidateSuite | |
| JsonFunctionsValidateSuite | |
| DateFunctionsValidateSuite | |
| ScalarFunctionsValidateSuite | |
| GlutenSQLQueryTestSuite | |
| GlutenKeyGroupedPartitioningSuite | |
| GlutenQueryExecutionErrorsSuite (CONVERSION_INVALID_INPUT: to_binary base64) | |
| GlutenCastSuite (Casting to char/varchar) | |
| GlutenTryCastSuite (cast from array III) | |
| GlutenTryCastSuite (cast from struct III) | |
| GlutenTryCastSuite (Casting to char/varchar) | |
| GlutenJsonExpressionsSuite (get_json_object 相关) | |
| GlutenCSVv1Suite | |
| GlutenCSVv2Suite | |
| GlutenCSVLegacyTimeParserSuite | |
| GlutenCSVReadSchemaSuite | |
| GlutenHeaderCSVReadSchemaSuite | |
| GlutenParquetV1FilterSuite (SPARK-47120) | |
| GlutenParquetV2FilterSuite (SPARK-47120) | |
| GlutenParquetIOSuite (多处 exclude) | |
| GlutenParquetSchemaSuite (excludeByPrefix SPARK-46056) | |
| GlutenParquetReadSchemaSuite (float/double) | |
| GlutenVectorizedParquetReadSchemaSuite (float/double) | |
| GlutenCoalesceShufflePartitionsSuite | |
| GlutenTakeOrderedAndProjectSuite (SPARK-47104) | |
| GlutenInsertSuite (多处 out-of-range/ANSI) | |
| GlutenFileSourceCharVarcharTestSuite | |
| GlutenDataFrameFunctionsSuite (map_concat / transform keys) | |
| GlutenDataFrameStatSuite (Bloom filter) | |
| GlutenDatasetSuite (SPARK-23627) | |
| GlutenDynamicPartitionPruningV1SuiteAEOn | |
| GlutenSQLQuerySuite (SPARK-47939) | |
| GlutenCollapseProjectExecTransformerSuite | |
| GlutenDeltaBasedMergeIntoTableSuite (merge cardinality prefix) | |
| GlutenDeltaBasedMergeIntoTableUpdateAsDeleteAndInsertSuite (merge cardinality prefix) | |
| GlutenGroupBasedMergeIntoTableSuite (merge cardinality prefix) | |
| GlutenStreamingQuerySuite (SPARK-49905 / 41199 / 41198) | |
| GlutenQueryExecutionSuite (SPARK-47289) | |
| GlutenDateExpressionsSuite (SPARK-50669, #11152) | |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3556920279
ANSI related work: https://github.com/apache/incubator-gluten/issues/10134
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "rdtr (via GitHub)" <gi...@apache.org>.
rdtr commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3655063445
Thanks for the suggestion. I can take on both #10072 and #10134 in that order—let me start with Hive.
Do you know the current state of ANSI support in Velox? I checked this thread (https://github.com/apache/incubator-gluten/issues/10387), and it seems only the try method is supported so far. Is this still the most recent status?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "FelixYBW (via GitHub)" <gi...@apache.org>.
FelixYBW commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3537075970
@baibaichen @weiting-chen FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "rdtr (via GitHub)" <gi...@apache.org>.
rdtr commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3643575662
I am interested in this work stream. Can I pick up any suites that don't have a check box above?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "baibaichen (via GitHub)" <gi...@apache.org>.
baibaichen commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3568746331
Hi @zhouyuan , I’ve updated the tracking.
Please @ yourself next to any suite you start or fix so we avoid duplication. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "FelixYBW (via GitHub)" <gi...@apache.org>.
FelixYBW commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3652547446
Hive UT is a good choice. It's commonly used. Most of the functions work but a few conor cases still fails.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] Track on Spark-4.0 failed unit tests [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on issue #11088:
URL: https://github.com/apache/incubator-gluten/issues/11088#issuecomment-3652513486
@rdtr Great, currently most of test suites are done/picked(the issue description is not up to date previously). The gap is to enable hive relate and ANSI tests. Please leave a comment if you would like to contribute:
- https://github.com/apache/incubator-gluten/issues/10072
- https://github.com/apache/incubator-gluten/issues/10134
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org