You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2022/09/30 15:01:33 UTC
[GitHub] [hadoop] steveloughran commented on pull request #4953: HADOOP-18401. No ARM binaries in branch-3.3.x releases.
steveloughran commented on PR #4953:
URL: https://github.com/apache/hadoop/pull/4953#issuecomment-1263688844
brought up container and did build from inside it
```
mvn install -Pdist -Pnative -Pyarn-ui -DskipTests -Dmaven.javadoc.skip=true
mvn package -Pdist -Pnative -Pyarn-ui -DskipTests -Dmaven.javadoc.skip=true
...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Apache Hadoop Main 3.3.9-SNAPSHOT:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 1.494 s]
[INFO] Apache Hadoop Build Tools .......................... SUCCESS [ 7.522 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 1.002 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 0.709 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.108 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 0.718 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 1.799 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 0.489 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 2.939 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 1.306 s]
[INFO] Apache Hadoop Common ............................... SUCCESS [ 35.524 s]
[INFO] Apache Hadoop NFS .................................. SUCCESS [ 2.033 s]
[INFO] Apache Hadoop KMS .................................. SUCCESS [ 2.258 s]
[INFO] Apache Hadoop Registry ............................. SUCCESS [ 2.670 s]
[INFO] Apache Hadoop Common Project ....................... SUCCESS [ 0.037 s]
[INFO] Apache Hadoop HDFS Client .......................... SUCCESS [ 14.874 s]
[INFO] Apache Hadoop HDFS ................................. SUCCESS [ 32.769 s]
[INFO] Apache Hadoop HDFS Native Client ................... SUCCESS [01:33 min]
[INFO] Apache Hadoop HttpFS ............................... SUCCESS [ 3.492 s]
[INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [ 1.889 s]
[INFO] Apache Hadoop HDFS-RBF ............................. SUCCESS [ 7.042 s]
[INFO] Apache Hadoop HDFS Project ......................... SUCCESS [ 0.059 s]
[INFO] Apache Hadoop YARN ................................. SUCCESS [ 0.034 s]
[INFO] Apache Hadoop YARN API ............................. SUCCESS [ 8.773 s]
[INFO] Apache Hadoop YARN Common .......................... SUCCESS [ 11.154 s]
[INFO] Apache Hadoop YARN Server .......................... SUCCESS [ 0.036 s]
[INFO] Apache Hadoop YARN Server Common ................... SUCCESS [ 6.330 s]
[INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [ 9.498 s]
[INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [ 1.596 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [ 2.825 s]
[INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [ 2.141 s]
[INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [ 15.877 s]
[INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [ 1.853 s]
[INFO] Apache Hadoop YARN Client .......................... SUCCESS [ 3.065 s]
[INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [ 1.474 s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [ 1.430 s]
[INFO] Apache Hadoop YARN TimelineService HBase Backend ... SUCCESS [ 0.032 s]
[INFO] Apache Hadoop YARN TimelineService HBase Common .... SUCCESS [ 1.976 s]
[INFO] Apache Hadoop YARN TimelineService HBase Client .... SUCCESS [ 2.650 s]
[INFO] Apache Hadoop YARN TimelineService HBase Servers ... SUCCESS [ 0.034 s]
[INFO] Apache Hadoop YARN TimelineService HBase Server 1.2 SUCCESS [ 3.514 s]
[INFO] Apache Hadoop YARN TimelineService HBase tests ..... SUCCESS [ 2.564 s]
[INFO] Apache Hadoop YARN Router .......................... SUCCESS [ 2.041 s]
[INFO] Apache Hadoop YARN TimelineService DocumentStore ... SUCCESS [ 1.599 s]
[INFO] Apache Hadoop YARN Applications .................... SUCCESS [ 0.032 s]
[INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [ 1.656 s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [ 1.192 s]
[INFO] Apache Hadoop MapReduce Client ..................... SUCCESS [ 0.549 s]
[INFO] Apache Hadoop MapReduce Core ....................... SUCCESS [ 6.982 s]
[INFO] Apache Hadoop MapReduce Common ..................... SUCCESS [ 3.507 s]
[INFO] Apache Hadoop MapReduce Shuffle .................... SUCCESS [ 2.075 s]
[INFO] Apache Hadoop MapReduce App ........................ SUCCESS [ 4.769 s]
[INFO] Apache Hadoop MapReduce HistoryServer .............. SUCCESS [ 2.947 s]
[INFO] Apache Hadoop MapReduce JobClient .................. SUCCESS [ 5.496 s]
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [ 1.389 s]
[INFO] Apache Hadoop YARN Services ........................ SUCCESS [ 0.031 s]
[INFO] Apache Hadoop YARN Services Core ................... SUCCESS [ 4.177 s]
[INFO] Apache Hadoop YARN Services API .................... SUCCESS [ 2.397 s]
[INFO] Apache Hadoop YARN Application Catalog ............. SUCCESS [ 0.033 s]
[INFO] Apache Hadoop YARN Application Catalog Webapp ...... SUCCESS [ 8.285 s]
[INFO] Apache Hadoop YARN Application Catalog Docker Image SUCCESS [ 0.058 s]
[INFO] Apache Hadoop YARN Application MaWo ................ SUCCESS [ 0.030 s]
[INFO] Apache Hadoop YARN Application MaWo Core ........... SUCCESS [ 1.092 s]
[INFO] Apache Hadoop YARN Site ............................ SUCCESS [ 0.049 s]
[INFO] Apache Hadoop YARN Registry ........................ SUCCESS [ 0.599 s]
[INFO] Apache Hadoop YARN UI .............................. SUCCESS [01:23 min]
[INFO] Apache Hadoop YARN CSI ............................. SUCCESS [ 4.619 s]
[INFO] Apache Hadoop YARN Project ......................... SUCCESS [ 22.600 s]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins ...... SUCCESS [ 1.060 s]
[INFO] Apache Hadoop MapReduce NativeTask ................. SUCCESS [ 8.127 s]
[INFO] Apache Hadoop MapReduce Uploader ................... SUCCESS [ 1.196 s]
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [ 2.067 s]
[INFO] Apache Hadoop MapReduce ............................ SUCCESS [ 4.184 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [ 2.240 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [ 2.559 s]
[INFO] Apache Hadoop Client Aggregator .................... SUCCESS [ 2.440 s]
[INFO] Apache Hadoop Dynamometer Workload Simulator ....... SUCCESS [ 1.592 s]
[INFO] Apache Hadoop Dynamometer Cluster Simulator ........ SUCCESS [ 2.511 s]
[INFO] Apache Hadoop Dynamometer Block Listing Generator .. SUCCESS [ 1.442 s]
[INFO] Apache Hadoop Dynamometer Dist ..................... SUCCESS [ 4.362 s]
[INFO] Apache Hadoop Dynamometer .......................... SUCCESS [ 0.033 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [ 1.349 s]
[INFO] Apache Hadoop Archive Logs ......................... SUCCESS [ 1.555 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [ 2.493 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [ 2.320 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [ 1.539 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [ 1.662 s]
[INFO] Apache Hadoop Pipes ................................ SUCCESS [ 0.385 s]
[INFO] Apache Hadoop OpenStack support .................... SUCCESS [ 1.543 s]
[INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [ 5.894 s]
[INFO] Apache Hadoop Kafka Library support ................ SUCCESS [ 1.027 s]
[INFO] Apache Hadoop Azure support ........................ SUCCESS [ 5.207 s]
[INFO] Apache Hadoop Aliyun OSS support ................... SUCCESS [ 1.213 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [ 2.062 s]
[INFO] Apache Hadoop Resource Estimator Service ........... SUCCESS [ 1.763 s]
[INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [ 1.270 s]
[INFO] Apache Hadoop Image Generation Tool ................ SUCCESS [ 1.325 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [ 3.302 s]
[INFO] Apache Hadoop Common Benchmark ..................... SUCCESS [02:41 min]
[INFO] Apache Hadoop Tools ................................ SUCCESS [ 0.079 s]
[INFO] Apache Hadoop Client API ........................... SUCCESS [01:01 min]
[INFO] Apache Hadoop Client Runtime ....................... SUCCESS [ 56.989 s]
[INFO] Apache Hadoop Client Packaging Invariants .......... SUCCESS [ 0.182 s]
[INFO] Apache Hadoop Client Test Minicluster .............. SUCCESS [01:32 min]
[INFO] Apache Hadoop Client Packaging Invariants for Test . SUCCESS [ 0.121 s]
[INFO] Apache Hadoop Client Packaging Integration Tests ... SUCCESS [ 0.096 s]
[INFO] Apache Hadoop Distribution ......................... SUCCESS [01:25 min]
[INFO] Apache Hadoop Client Modules ....................... SUCCESS [ 0.058 s]
[INFO] Apache Hadoop Tencent COS Support .................. SUCCESS [ 1.381 s]
[INFO] Apache Hadoop Cloud Storage ........................ SUCCESS [ 0.532 s]
[INFO] Apache Hadoop Cloud Storage Project ................ SUCCESS [ 0.027 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 16:24 min
[INFO] Finished at: 2022-09-30T13:59:45Z
[INFO] ------------------------------------------------------------------------
stevel@4ed2b9e0c7da:~/hadoop$ ls -l hadoop-dist/target/
total 691928
drwxr-xr-x 3 stevel users 96 Sep 29 16:50 antrun
drwxr-xr-x 3 stevel users 96 Sep 29 16:50 classes
drwxr-xr-x 15 stevel users 480 Sep 30 13:58 hadoop-3.3.9-SNAPSHOT
-rw-r--r-- 1 stevel users 36391566 Sep 29 16:52 hadoop-3.3.9-SNAPSHOT-src.tar.gz
-rw-r--r-- 1 stevel users 666689305 Sep 30 13:59 hadoop-3.3.9-SNAPSHOT.tar.gz
drwxr-xr-x 3 stevel users 96 Sep 29 16:43 hadoop-tools-deps
drwxr-xr-x 3 stevel users 96 Sep 29 16:50 maven-shared-archive-resources
-rw-r--r-- 1 stevel users 698 Sep 29 16:17 rat.txt
drwxr-xr-x 3 stevel users 96 Sep 29 16:50 test-classes
drwxr-xr-x 2 stevel users 64 Sep 29 16:50 test-dir
```
that should be enough to get the native libs built up in the tarball, which is the only thing we'd want to sign and publish.
now trying `dev-support/bin/create-release --docker`
that does not work, still trying to use the old file. any ideas?
```
dev-support/bin/create-release --docker
[+] Building 12.8s (14/21)
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 5.99kB 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/library/ubuntu:bionic 0.6s
=> [ 1/18] FROM docker.io/library/ubuntu:bionic@sha256:6fec50623d6d37b7f3c14c5b6fc36c73fd04aa8173d59d54dba00da0e7ac50ee 0.0s
=> CACHED [ 2/18] WORKDIR /root 0.0s
=> CACHED [ 3/18] RUN echo APT::Install-Recommends "0"; > /etc/apt/apt.conf.d/10disableextras 0.0s
=> CACHED [ 4/18] RUN echo APT::Install-Suggests "0"; >> /etc/apt/apt.conf.d/10disableextras 0.0s
=> CACHED [ 5/18] RUN apt-get -q update && apt-get -q install -y --no-install-recommends apt-utils b 0.0s
=> CACHED [ 6/18] RUN locale-gen en_US.UTF-8 0.0s
=> CACHED [ 7/18] RUN mkdir -p /opt/spotbugs && curl -L -s -S https://github.com/spotbugs/spotbugs/releases/download 0.0s
=> CACHED [ 8/18] RUN apt-get -q update && apt-get -q install -y --no-install-recommends openjdk-8-jdk libbcprov-jav 0.0s
=> CACHED [ 9/18] RUN mkdir -p /opt/protobuf-src && curl -L -s -S https://github.com/protocolbuffers/protobuf/ 0.0s
=> CACHED [10/18] RUN apt-get -q update && apt-get -q install -y --no-install-recommends maven && apt-get clean 0.0s
=> CANCELED [11/18] RUN pip3 install pylint==2.6.0 python-dateutil==2.8.1 12.1s^C^C^C
context canceled
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org