You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "mbutrovich (via GitHub)" <gi...@apache.org> on 2026/05/26 13:23:42 UTC
[I] change default Maven profile to Spark 4.0 [datafusion-comet]
mbutrovich opened a new issue, #4434:
URL: https://github.com/apache/datafusion-comet/issues/4434
#4140 changed the default profile to Spark 4.1, but I think that was premature considering we don't have Iceberg support on 4.1 yet. Iceberg 1.11 only released last week with Spark 4.1 support, and #4381 tracks Comet supporting Iceberg 1.11.
In the meantime, I manually set my environment to 4.0 locally for development, and would prefer others do the same to hopefully avoid breaking Iceberg compatibility accidentally.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] change default Maven profile to Spark 4.0 [datafusion-comet]
Posted by "dwsmith1983 (via GitHub)" <gi...@apache.org>.
dwsmith1983 commented on issue #4434:
URL: https://github.com/apache/datafusion-comet/issues/4434#issuecomment-5976368088
The concern here was that Spark 4.1 had no Iceberg support yet (#4381). #4840 added Iceberg 1.11, and Iceberg 1.11 on Spark 4.1 now runs in CI (the `iceberg_1_11` job in `ci.yml`, in the merge queue and on PRs with `run-iceberg-tests`), so keeping 4.1 as the default no longer leaves Iceberg untested. I think this can be closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org