You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Robert Stupp <sn...@snazy.de> on 2024/07/01 07:46:49 UTC
Iceberg build improvements: all Scala versions, build cache, clean all
Heads up: I've drafted a couple PRs to improve the Iceberg build:
1. Enabling the Gradle build cache improves local build performance
quite a bit, especially if you change from one branch to another. See
https://github.com/apache/iceberg/pull/10602
2. Let the Iceberg build run against all Scala versions for each Spark
version. This change, together with the existing `allModules` flag,
allows building and releasing all artifacts in one shot. The defaults of
the command-line build and IDE import are not changed. Given that there
was already one Iceberg release that was broken due to wrong build
artifacts, I think this change is justified. See
https://github.com/apache/iceberg/pull/10606
3. Clean all artifacts: The Iceberg build can accumulate a lot of stuff
on disk over time, this change "enhances" the Gradle `clean` task to get
rid of this. See https://github.com/apache/iceberg/pull/10602
--
Robert Stupp
@snazy
Re: Iceberg build improvements: all Scala versions, build cache, clean all
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Robert
Thanks for that !
I will take a look on each PR.
I propose to wait after 1.6.0 release anyway.
Regards
JB
Le lun. 1 juil. 2024 à 09:46, Robert Stupp <sn...@snazy.de> a écrit :
> Heads up: I've drafted a couple PRs to improve the Iceberg build:
>
> 1. Enabling the Gradle build cache improves local build performance
> quite a bit, especially if you change from one branch to another. See
> https://github.com/apache/iceberg/pull/10602
>
> 2. Let the Iceberg build run against all Scala versions for each Spark
> version. This change, together with the existing `allModules` flag,
> allows building and releasing all artifacts in one shot. The defaults of
> the command-line build and IDE import are not changed. Given that there
> was already one Iceberg release that was broken due to wrong build
> artifacts, I think this change is justified. See
> https://github.com/apache/iceberg/pull/10606
>
> 3. Clean all artifacts: The Iceberg build can accumulate a lot of stuff
> on disk over time, this change "enhances" the Gradle `clean` task to get
> rid of this. See https://github.com/apache/iceberg/pull/10602
>
> --
> Robert Stupp
> @snazy
>
>