You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by GitBox <gi...@apache.org> on 2023/01/09 03:59:14 UTC
[GitHub] [incubator-uniffle] kaijchen opened a new issue, #461: [FEATURE] Spark 3.3 support
kaijchen opened a new issue, #461:
URL: https://github.com/apache/incubator-uniffle/issues/461
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.
### Describe the feature
Support Spark 3.3 in Uniffle.
### Motivation
Spark 3.3 has been released for a few months.
Users are going to migrate to Spark 3.3 sooner or later.
### Describe the solution
_No response_
### Additional context
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #461: [FEATURE] Spark 3.3 support
Posted by GitBox <gi...@apache.org>.
zuston commented on issue #461:
URL: https://github.com/apache/incubator-uniffle/issues/461#issuecomment-1375422440
Make sense.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] kaijchen commented on issue #461: [FEATURE] Spark 3.3 support
Posted by GitBox <gi...@apache.org>.
kaijchen commented on issue #461:
URL: https://github.com/apache/incubator-uniffle/issues/461#issuecomment-1375485900
I'm not sure if I added the profile correctly, seems spark 3.3 requires some test code change:
https://github.com/kaijchen/incubator-uniffle/actions/runs/3873117861/jobs/6602763685#step:8:8
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] advancedxy commented on issue #461: [FEATURE] Spark 3.3 support
Posted by GitBox <gi...@apache.org>.
advancedxy commented on issue #461:
URL: https://github.com/apache/incubator-uniffle/issues/461#issuecomment-1375301393
Would you like to submit a PR here? Or do you encounter some issues?
I was expected we can simply use spark 3.2 support to run spark 3.3 apps as Spark 3.3 doesn't change the APIs..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] kaijchen closed issue #461: [FEATURE] Spark 3.3 support
Posted by GitBox <gi...@apache.org>.
kaijchen closed issue #461: [FEATURE] Spark 3.3 support
URL: https://github.com/apache/incubator-uniffle/issues/461
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] kaijchen commented on issue #461: [FEATURE] Spark 3.3 support
Posted by GitBox <gi...@apache.org>.
kaijchen commented on issue #461:
URL: https://github.com/apache/incubator-uniffle/issues/461#issuecomment-1377084921
Closed by #463.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] kaijchen commented on issue #461: [FEATURE] Spark 3.3 support
Posted by GitBox <gi...@apache.org>.
kaijchen commented on issue #461:
URL: https://github.com/apache/incubator-uniffle/issues/461#issuecomment-1375466211
Plus: we may need to create a patch for spark 3.3 in https://github.com/apache/incubator-uniffle/tree/master/spark-patches
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] kaijchen commented on issue #461: [FEATURE] Spark 3.3 support
Posted by GitBox <gi...@apache.org>.
kaijchen commented on issue #461:
URL: https://github.com/apache/incubator-uniffle/issues/461#issuecomment-1375305375
> Would you like to submit a PR here? Or do you encounter some issues?
I'm not sure.
> I was expected we can simply use spark 3.2 support to run spark 3.3 apps as Spark 3.3 doesn't change the APIs..
In this case, we should add test profile for Spark 3.3 and enable them in CI.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org