You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/06 10:08:00 UTC
[jira] [Work logged] (HIVE-27225) Speedup build by skipping SBOM generation by default
[ https://issues.apache.org/jira/browse/HIVE-27225?focusedWorklogId=855257&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-855257 ]
ASF GitHub Bot logged work on HIVE-27225:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 06/Apr/23 10:07
Start Date: 06/Apr/23 10:07
Worklog Time Spent: 10m
Work Description: zabetak opened a new pull request, #4205:
URL: https://github.com/apache/hive/pull/4205
### What changes were proposed in this pull request?
Run SBOM generation only during release (dist profile) to speed-up every-day builds.
### Why are the changes needed?
The SBOM generation is costly and profiling shows that it consumes ~30% of CPU. Moreover, it is not necessary to run it in every build; it is sufficient to run it only during the release.
After the changes here the time for the default build drops from 14 minutes to 8 (measured locally).
### Does this PR introduce _any_ user-facing change?
Developers will notice a significantly faster build.
### How was this patch tested?
Before
```
mvn clean install -DskipTests -Pitests
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14:15 min
```
After
```
mvn clean install -DskipTests -Pitests
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 08:19 min
```
After with dist profile activated
```
mvn clean install -DskipTests -Pitests -Pdist
INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 13:32 min
```
Issue Time Tracking
-------------------
Worklog Id: (was: 855257)
Remaining Estimate: 0h
Time Spent: 10m
> Speedup build by skipping SBOM generation by default
> ----------------------------------------------------
>
> Key: HIVE-27225
> URL: https://issues.apache.org/jira/browse/HIVE-27225
> Project: Hive
> Issue Type: Improvement
> Components: Build Infrastructure
> Reporter: Stamatis Zampetakis
> Assignee: Stamatis Zampetakis
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> A full build of Hive locally in my environment takes ~15 minutes.
> {noformat}
> mvn clean install -DskipTests -Pitests
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 14:15 min
> {noformat}
> Profiling the build shows that we are spending roughly 30% of CPU in org.cyclonedx.maven plugin which is used to generate SBOM artifacts (HIVE-26912).
> The SBOM generation does not need run in every single build and probably needs to be active only during the release build. To speed-up every-day builds I propose to activate the cyclonedx plugin only in the dist (release) profile.
> After this change, the default build drops from 14 minutes to 8.
> {noformat}
> mvn clean install -DskipTests -Pitests
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 08:19 min
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)