You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/05/24 21:10:00 UTC
[jira] [Commented] (IMPALA-10199) Need to update bootstrap_toolchain.py with the 20.04 version of toolchain file when available
[ https://issues.apache.org/jira/browse/IMPALA-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541713#comment-17541713 ]
ASF subversion and git services commented on IMPALA-10199:
----------------------------------------------------------
Commit d0cfdd139fe81a52f420c7878b5e90c6e30ea6fe in impala's branch refs/heads/master from Joe McDonnell
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=d0cfdd139 ]
IMPALA-10199: Add Ubuntu 20 toolchain configuration
Ubuntu 20 has been using the toolchain from Ubuntu 18.
Since Ubuntu 20 has been added to the toolchain, this
switches Impala to use a toolchain with Ubuntu 20 support
and uses the Ubuntu 20 bits. This is expected to help
with IMPALA-10962.
Testing:
- Ran a core build on Ubuntu 20
Change-Id: If2394b668ef3c56b1a4c0773fd5e4ff92be4a846
Reviewed-on: http://gerrit.cloudera.org:8080/18559
Reviewed-by: Joe McDonnell <jo...@cloudera.com>
Reviewed-by: Michael Smith <mi...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Need to update bootstrap_toolchain.py with the 20.04 version of toolchain file when available
> ---------------------------------------------------------------------------------------------
>
> Key: IMPALA-10199
> URL: https://issues.apache.org/jira/browse/IMPALA-10199
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Reporter: Qifan Chen
> Assignee: Joe McDonnell
> Priority: Critical
>
> Currently, for Ubuntu 20.04, the impala development environment uses the toolchain of 18.04, since the toolchain for 20.04 does not exist in EC2, in bin/bootstrap_toolchain.py.
>
> {code:java}
> Maps return values from 'lsb_release -irs' to the corresponding OS labels for both the
> # toolchain and the CDP components.
> OsMapping = namedtuple('OsMapping', ['lsb_release', 'toolchain', 'cdh'])
> OS_MAPPING = [
> OsMapping("centos5", "ec2-package-centos-5", None),
> OsMapping("centos6", "ec2-package-centos-6", "redhat6"),
> OsMapping("centos7", "ec2-package-centos-7", "redhat7"),
> OsMapping("centos8", "ec2-package-centos-8", "redhat8"),
> OsMapping("redhatenterpriseserver5", "ec2-package-centos-5", None),
> OsMapping("redhatenterpriseserver6", "ec2-package-centos-6", "redhat6"),
> OsMapping("redhatenterpriseserver7", "ec2-package-centos-7", "redhat7"),
> OsMapping("redhatenterpriseserver8", "ec2-package-centos-8", "redhat8"),
> OsMapping("debian6", "ec2-package-debian-6", None),
> OsMapping("debian7", "ec2-package-debian-7", None),
> OsMapping("debian8", "ec2-package-debian-8", "debian8"),
> OsMapping("suselinux11", "ec2-package-sles-11", None),
> OsMapping("suselinux12", "ec2-package-sles-12", "sles12"),
> OsMapping("suse12", "ec2-package-sles-12", "sles12"),
> OsMapping("ubuntu12.04", "ec2-package-ubuntu-12-04", None),
> OsMapping("ubuntu14.04", "ec2-package-ubuntu-14-04", None),
> OsMapping("ubuntu15.04", "ec2-package-ubuntu-14-04", None),
> OsMapping("ubuntu15.10", "ec2-package-ubuntu-14-04", None),
> OsMapping('ubuntu16.04', "ec2-package-ubuntu-16-04", "ubuntu1604"),
> OsMapping('ubuntu18.04', "ec2-package-ubuntu-18-04", "ubuntu1804"),
> OsMapping('ubuntu20.04', "ec2-package-ubuntu-18-04", "ubuntu1804")
> ]{code}
>
> Error was retured otherwise.
>
> {code:java}
> 2020-09-28 11:09:16,660 Thread-3 INFO: Downloading https://native-toolchain.s3.amazonaws.com/build/55-dcf54c8601/gcc/7.5.0-gcc-7.5.0/gcc-7.5.0-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz to /home/qchen/Impala/toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz (attempt 1)
> 2020-09-28 11:09:16,667 Thread-4 INFO: Downloading https://native-toolchain.s3.amazonaws.com/build/55-dcf54c8601/llvm/5.0.1-asserts-p3-gcc-7.5.0/llvm-5.0.1-asserts-p3-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz to /home/qchen/Impala/toolchain/toolchain-packages-gcc7.5.0/llvm-5.0.1-asserts-p3-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz (attempt 1)
> 2020-09-28 11:09:16,668 Thread-2 INFO: Downloading https://native-toolchain.s3.amazonaws.com/build/55-dcf54c8601/llvm/5.0.1-p3-gcc-7.5.0/llvm-5.0.1-p3-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz to /home/qchen/Impala/toolchain/toolchain-packages-gcc7.5.0/llvm-5.0.1-p3-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz (attempt 1)
> 2020-09-28 11:09:17,002 Thread-1 ERROR: Download failed; retrying after sleep: Command with args '['wget', 'https://native-toolchain.s3.amazonaws.com/build/55-dcf54c8601/avro/1.7.4-p5-gcc-7.5.0/avro-1.7.4-p5-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz', '--directory-prefix=/home/qchen/Impala/toolchain/toolchain-packages-gcc7.5.0']' failed with exit code 8:
> --2020-09-28 11:09:16-- https://native-toolchain.s3.amazonaws.com/build/55-dcf54c8601/avro/1.7.4-p5-gcc-7.5.0/avro-1.7.4-p5-gcc-7.5.0-ec2-package-ubuntu-20-04.tar.gz
> Resolving native-toolchain.s3.amazonaws.com (native-toolchain.s3.amazonaws.com)... 52.219.116.82
> Connecting to native-toolchain.s3.amazonaws.com (native-toolchain.s3.amazonaws.com)|52.219.116.82|:443... connected.{code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org