You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2023/04/20 16:00:00 UTC
[jira] [Commented] (IMPALA-12065) Use pigz when compression the tarballs for native-toolchain
[ https://issues.apache.org/jira/browse/IMPALA-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714655#comment-17714655 ]
Joe McDonnell commented on IMPALA-12065:
----------------------------------------
Toolchain change: [https://github.com/cloudera/native-toolchain/commit/234fad80361302acf8392a483cc144ccb03ee6dd]
{noformat}
commit 234fad80361302acf8392a483cc144ccb03ee6dd
Author: Joe McDonnell <jo...@cloudera.com>
Date: Fri Apr 14 18:03:26 2023 -0700 IMPALA-12065: Use pigz when compressing tarballs
This switches to using pigz to speed up the compression
of the final tarballs to be uploaded to the s3 bucket.
This helps mostly for large tarballs like LLVM, Kudu,
GCC, etc.
Testing:
- Ran toolchain build
Change-Id: I841d3b8e0cdd74811a9e53a23c12897a1f2fea8c
Reviewed-on: http://gerrit.cloudera.org:8080/19754
Reviewed-by: Michael Smith <mi...@cloudera.com>
Reviewed-by: Wenzhe Zhou <wz...@cloudera.com>
Tested-by: Joe McDonnell <jo...@cloudera.com>
{noformat}
> Use pigz when compression the tarballs for native-toolchain
> -----------------------------------------------------------
>
> Key: IMPALA-12065
> URL: https://issues.apache.org/jira/browse/IMPALA-12065
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Affects Versions: Impala 4.3.0
> Reporter: Joe McDonnell
> Priority: Major
>
> This code in native-toolchain should be changed to use pigz:
> {noformat}
> tar zcf ${PACKAGE_FINAL_TGZ}\
> --directory=${BUILD_DIR} \
> ${PACKAGE_STRING}${PATCH_VERSION}{noformat}
> [https://github.com/cloudera/native-toolchain/blob/master/functions.sh#L392-L394]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org