You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zhouyuan (via GitHub)" <gi...@apache.org> on 2025/03/11 10:44:39 UTC
[I] [VL] deprecated Spark-3.2 unit tests [incubator-gluten]
zhouyuan opened a new issue, #8960:
URL: https://github.com/apache/incubator-gluten/issues/8960
### Description
Gluten will gradually deprecate Spark-3.2 support. Discussions in below link:
https://lists.apache.org/thread/fgnv7v5sf9ol14lkssd9v47h6cvorcxc
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] deprecated Spark-3.2 unit tests [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on issue #8960:
URL: https://github.com/apache/incubator-gluten/issues/8960#issuecomment-3705292864
@QCLyu great! we may also need to migrate some important tests in velox backends running with spark32 to recent spark.
https://github.com/apache/incubator-gluten/blob/main/backends-velox/src/test/scala/org/apache/gluten/execution/VeloxHashJoinSuite.scala#L77
for the detail plan, we also need to remove the spark unit tests
https://github.com/apache/incubator-gluten/blob/main/.github/workflows/velox_backend_x86.yml#L647-L732
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] deprecated Spark-3.2 unit tests [incubator-gluten]
Posted by "QCLyu (via GitHub)" <gi...@apache.org>.
QCLyu commented on issue #8960:
URL: https://github.com/apache/incubator-gluten/issues/8960#issuecomment-3704061345
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] deprecated Spark-3.2 unit tests [incubator-gluten]
Posted by "QCLyu (via GitHub)" <gi...@apache.org>.
QCLyu commented on issue #8960:
URL: https://github.com/apache/incubator-gluten/issues/8960#issuecomment-3706675216
Thanks @zhouyuan . Roger that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] deprecated Spark-3.2 unit tests [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan closed issue #8960: [VL] deprecated Spark-3.2 unit tests
URL: https://github.com/apache/incubator-gluten/issues/8960
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] deprecated Spark-3.2 unit tests [incubator-gluten]
Posted by "QCLyu (via GitHub)" <gi...@apache.org>.
QCLyu commented on issue #8960:
URL: https://github.com/apache/incubator-gluten/issues/8960#issuecomment-3701562634
Hi @zhouyuan , I'm working on this. My plan is to:
*Remove the shims/spark32 directory.
*Remove the spark-3.2 profile from the root and submodule pom.xml files.
*Update GitHub Action workflows to remove Spark 3.2 from the test matrix.
*Verify that the build still succeeds for Spark 3.5 on my ARM64 environment.
Does this align with the deprecation strategy?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org