You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Robert Stupp <sn...@snazy.de> on 2024/07/01 07:46:49 UTC

Iceberg build improvements: all Scala versions, build cache, clean all

Heads up: I've drafted a couple PRs to improve the Iceberg build:

1. Enabling the Gradle build cache improves local build performance 
quite a bit, especially if you change from one branch to another. See 
https://github.com/apache/iceberg/pull/10602

2. Let the Iceberg build run against all Scala versions for each Spark 
version. This change, together with the existing `allModules` flag, 
allows building and releasing all artifacts in one shot. The defaults of 
the command-line build and IDE import are not changed. Given that there 
was already one Iceberg release that was broken due to wrong build 
artifacts, I think this change is justified. See 
https://github.com/apache/iceberg/pull/10606

3. Clean all artifacts: The Iceberg build can accumulate a lot of stuff 
on disk over time, this change "enhances" the Gradle `clean` task to get 
rid of this. See https://github.com/apache/iceberg/pull/10602

-- 
Robert Stupp
@snazy


Re: Iceberg build improvements: all Scala versions, build cache, clean all

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Robert

Thanks for that !

I will take a look on each PR.
I propose to wait after 1.6.0 release anyway.

Regards
JB

Le lun. 1 juil. 2024 à 09:46, Robert Stupp <sn...@snazy.de> a écrit :

> Heads up: I've drafted a couple PRs to improve the Iceberg build:
>
> 1. Enabling the Gradle build cache improves local build performance
> quite a bit, especially if you change from one branch to another. See
> https://github.com/apache/iceberg/pull/10602
>
> 2. Let the Iceberg build run against all Scala versions for each Spark
> version. This change, together with the existing `allModules` flag,
> allows building and releasing all artifacts in one shot. The defaults of
> the command-line build and IDE import are not changed. Given that there
> was already one Iceberg release that was broken due to wrong build
> artifacts, I think this change is justified. See
> https://github.com/apache/iceberg/pull/10606
>
> 3. Clean all artifacts: The Iceberg build can accumulate a lot of stuff
> on disk over time, this change "enhances" the Gradle `clean` task to get
> rid of this. See https://github.com/apache/iceberg/pull/10602
>
> --
> Robert Stupp
> @snazy
>
>