You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2025/05/22 15:24:30 UTC
[I] Drop support for Java 8 [datafusion-comet]
andygrove opened a new issue, #1775:
URL: https://github.com/apache/datafusion-comet/issues/1775
### What is the problem the feature request solves?
The version of arrow-java that we are using has a pretty serious [bug](https://github.com/apache/arrow-java/issues/704) that is fixed in version 18.3.0, but that version does not support Java 8, so we cannot upgrade.
This issue is to discuss dropping support for Java 8 in Comet.
Spark drops support for Java 8 starting with version 4.0.0
Iceberg drops support for Java 8 starting with version 1.7.0
The downside is that we will no longer be able to support users who are using Java 8 with Spark 3.4/3.5 or users with versions of Iceberg before 1.7.0, but if we cannot fix the arrow-java bug then it is probably not safe to run in production anyway.
### Describe the potential solution
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Drop support for Java 8 [datafusion-comet]
Posted by "Kontinuation (via GitHub)" <gi...@apache.org>.
Kontinuation commented on issue #1775:
URL: https://github.com/apache/datafusion-comet/issues/1775#issuecomment-2903027908
Another Spark extension projection I am working on is also upgrading to Java 11: https://github.com/apache/sedona/pull/1942. The main consideration is that major cloud vendors all provide hosted Spark service with Java 11 in at least 1 LTS version, and on-premise users can upgrade their JDK version on their own, so upgrading to Java 11 won't pose too much friction to the users.
I think it is OK to stick to `zulu`, as it was the default distribution in setup-java V1 and today lots of projects are still using it, including [Apache Iceberg](https://github.com/apache/iceberg/blob/main/.github/workflows/java-ci.yml).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Drop support for Java 8 [datafusion-comet]
Posted by "mbutrovich (via GitHub)" <gi...@apache.org>.
mbutrovich commented on issue #1775:
URL: https://github.com/apache/datafusion-comet/issues/1775#issuecomment-2901826068
I'm a +1 for dropping Java 8 to bump java-arrow dependency. In addition to picking up important bug fixes, we need a newer release to benefit from Utf8View/StringView Arrow types as discussed in #1403.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Drop support for Java 8 [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #1775: Drop support for Java 8
URL: https://github.com/apache/datafusion-comet/issues/1775
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Drop support for Java 8 [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove commented on issue #1775:
URL: https://github.com/apache/datafusion-comet/issues/1775#issuecomment-2901908056
I see this comment in the github actions:
```
- name: Install JDK ${{inputs.jdk-version}}
uses: actions/setup-java@v4
with:
# distribution is chosen to be zulu as it still offers JDK 8 with Silicon support, which
# is not available in the adopt distribution
distribution: 'zulu'
java-version: ${{inputs.jdk-version}}
```
I don't know if we want to change this to use `adopt` rather than `zulu`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org