You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/29 12:53:40 UTC
[GitHub] [beam] mosche opened a new pull request, #22097: Deprecate runner support for Spark 2.4 (closes #22094)
mosche opened a new pull request, #22097:
URL: https://github.com/apache/beam/pull/22097
It is time to deprecate the Spark 2 runner in Beam, see this [discussion](https://lists.apache.org/thread/opfhg3xjb9nptv878sygwj9gjx38rmco). Databricks is also dropping support for runtimes using Spark 2 by the end of June 2022.
------------------------
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
- [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`).
- [ ] Mention the appropriate issue in your description (for example: `addresses #123`), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment `fixes #<ISSUE NUMBER>` instead.
- [ ] Update `CHANGES.md` with noteworthy changes.
- [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier).
To check the build health, please visit [https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md](https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md)
GitHub Actions Tests Status (on master branch)
------------------------------------------------------------------------------------------------
[](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule)
See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for more information about GitHub Actions CI.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] echauchot merged pull request #22097: Deprecate runner support for Spark 2.4 (closes #22094)
Posted by GitBox <gi...@apache.org>.
echauchot merged PR #22097:
URL: https://github.com/apache/beam/pull/22097
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] mosche commented on pull request #22097: Deprecate runner support for Spark 2.4 (closes #22094)
Posted by GitBox <gi...@apache.org>.
mosche commented on PR #22097:
URL: https://github.com/apache/beam/pull/22097#issuecomment-1172190895
Hmm, having seen the maven download stats, I'm a bit skeptical if Spark 2.4 should be deprecated in fact.
The numbers of the last month:
beam-runners-spark-3
2.30.0 22
2.31.0 22
2.32.0 16
2.33.0 18
2.34.0 17
2.35.0 47
2.36.0 160
2.37.0 17
2.38.0 114
2.39.0 23
All 472
beam-runners-spark
2.30.0 26
2.31.0 24
2.32.0 69
2.33.0 403
2.34.0 352
2.35.0 1543
2.36.0 50
2.37.0 19
2.38.0 420
2.39.0 86
All 5224
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] mosche commented on pull request #22097: Deprecate runner support for Spark 2.4 (closes #22094)
Posted by GitBox <gi...@apache.org>.
mosche commented on PR #22097:
URL: https://github.com/apache/beam/pull/22097#issuecomment-1169944761
R: @echauchot
R: @aromanenko-dev
R: @jbonofre
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] aromanenko-dev commented on pull request #22097: Deprecate runner support for Spark 2.4 (closes #22094)
Posted by GitBox <gi...@apache.org>.
aromanenko-dev commented on PR #22097:
URL: https://github.com/apache/beam/pull/22097#issuecomment-1170239151
CC: @iemejia
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org