You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Joe McDonnell (Code Review)" <ge...@cloudera.org> on 2019/11/16 01:24:12 UTC

[Impala-ASF-CR] IMPALA-9107 (part 1): Add scripts to produce an m2 archive

Joe McDonnell has uploaded a new patch set (#9). ( http://gerrit.cloudera.org:8080/14562 )

Change subject: IMPALA-9107 (part 1): Add scripts to produce an m2 archive
......................................................................

IMPALA-9107 (part 1): Add scripts to produce an m2 archive

The maven build downloads a large number of artifacts from
various maven repositories. When starting with an empty .m2
directory (like most upstream Jenkins jobs), downloading
all the artifacts can take up to 30 minutes. This has been
slowing down our precommit builds by 15-20 minutes.

This adds a script to archive the .m2 directory into a
tarball while excluding artifacts from impala.cdp.repo
and impala.cdh.repo. This will later be used to prepopulate
the .m2 directory for Jenkins jobs.

This adds a script to parse the maven log and output how
many maven artifacts are downloaded from each repository.
It also prints how many downloads were attempted for each
repository. This might aid in diagnosing slowness.

This also changes mvn-quiet.sh to add logging that prints
a timestamp. It also adds the -B flag to mvn, which causes
maven to run in batch mode. This makes the output easier
to parse, because maven omits special console formatting
characters such as ^M (carriange return).

This changes build-all-flag-combinations.sh to print the
maven statistics after each part of the build and call the
script to produce an m2 archive at the end.

Change-Id: I043912f5fbc7cf24ee80b2855354656aa587ca9f
---
A bin/jenkins/archive_m2_directory.sh
M bin/jenkins/build-all-flag-combinations.sh
A bin/jenkins/get_maven_statistics.sh
M bin/mvn-quiet.sh
M impala-parent/pom.xml
5 files changed, 137 insertions(+), 1 deletion(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/62/14562/9
-- 
To view, visit http://gerrit.cloudera.org:8080/14562
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I043912f5fbc7cf24ee80b2855354656aa587ca9f
Gerrit-Change-Number: 14562
Gerrit-PatchSet: 9
Gerrit-Owner: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <ta...@cloudera.com>