You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/13 09:11:00 UTC

[jira] [Commented] (HADOOP-18970) Upgrade hadoop2 docker scripts to latest 2.10.2

    [ https://issues.apache.org/jira/browse/HADOOP-18970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17785426#comment-17785426 ] 

ASF GitHub Bot commented on HADOOP-18970:
-----------------------------------------

adoroszlai opened a new pull request, #6269:
URL: https://github.com/apache/hadoop/pull/6269

   ## What changes were proposed in this pull request?
   
   1. Update to Hadoop 2.10.2 release.
   2. Adapted some misc. updates/improvements for the docker build from `docker-hadoop-3` branch.
   3. Install `which`, required by `hadoop` bash script in 2.x.
   
   https://issues.apache.org/jira/browse/HADOOP-18970
   
   ## How was this patch tested?
   
   Built the new image locally:
   
   ```
   $ ./build.sh
   ...
   Successfully built c251dc1bdbce
   Successfully tagged apache/hadoop:2
   ```
   
   Verified output from `hadoop version`:
   
   ```
   $ docker run -it --rm apache/hadoop:2 hadoop version
   Hadoop 2.10.2
   Subversion Unknown -r 965fd380006fa78b2315668fbc7eb432e1d8200f
   Compiled by ubuntu on 2022-05-24T22:35Z
   Compiled with protoc 2.5.0
   From source with checksum d3ab737f7788f05d467784f0a86573fe
   This command was run using /opt/hadoop/share/hadoop/common/hadoop-common-2.10.2.jar
   ```
   
   Also tested it with the included sample Docker Compose cluster:
   
   ```
   $ docker-compose up -d --scale datanode=3 --scale nodemanager=3
   ...
   Successfully built c251dc1bdbce
   Successfully tagged hadoop_namenode:latest
   ...
   $ docker-compose exec resourcemanager yarn jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.2.jar pi 3 3
   ...
   Job Finished in 14.464 seconds
   Estimated value of Pi is 3.55555555555555555556
   ```




> Upgrade hadoop2 docker scripts to latest 2.10.2
> -----------------------------------------------
>
>                 Key: HADOOP-18970
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18970
>             Project: Hadoop Common
>          Issue Type: Task
>            Reporter: Attila Doroszlai
>            Assignee: Attila Doroszlai
>            Priority: Major
>
> Apply enhancements from {{docker-hadoop-3}} branch, and upgrade to latest Hadoop 2 release: 2.10.2.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org