You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/13 09:11:00 UTC
[jira] [Commented] (HADOOP-18970) Upgrade hadoop2 docker scripts to latest 2.10.2
[ https://issues.apache.org/jira/browse/HADOOP-18970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17785426#comment-17785426 ]
ASF GitHub Bot commented on HADOOP-18970:
-----------------------------------------
adoroszlai opened a new pull request, #6269:
URL: https://github.com/apache/hadoop/pull/6269
## What changes were proposed in this pull request?
1. Update to Hadoop 2.10.2 release.
2. Adapted some misc. updates/improvements for the docker build from `docker-hadoop-3` branch.
3. Install `which`, required by `hadoop` bash script in 2.x.
https://issues.apache.org/jira/browse/HADOOP-18970
## How was this patch tested?
Built the new image locally:
```
$ ./build.sh
...
Successfully built c251dc1bdbce
Successfully tagged apache/hadoop:2
```
Verified output from `hadoop version`:
```
$ docker run -it --rm apache/hadoop:2 hadoop version
Hadoop 2.10.2
Subversion Unknown -r 965fd380006fa78b2315668fbc7eb432e1d8200f
Compiled by ubuntu on 2022-05-24T22:35Z
Compiled with protoc 2.5.0
From source with checksum d3ab737f7788f05d467784f0a86573fe
This command was run using /opt/hadoop/share/hadoop/common/hadoop-common-2.10.2.jar
```
Also tested it with the included sample Docker Compose cluster:
```
$ docker-compose up -d --scale datanode=3 --scale nodemanager=3
...
Successfully built c251dc1bdbce
Successfully tagged hadoop_namenode:latest
...
$ docker-compose exec resourcemanager yarn jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.2.jar pi 3 3
...
Job Finished in 14.464 seconds
Estimated value of Pi is 3.55555555555555555556
```
> Upgrade hadoop2 docker scripts to latest 2.10.2
> -----------------------------------------------
>
> Key: HADOOP-18970
> URL: https://issues.apache.org/jira/browse/HADOOP-18970
> Project: Hadoop Common
> Issue Type: Task
> Reporter: Attila Doroszlai
> Assignee: Attila Doroszlai
> Priority: Major
>
> Apply enhancements from {{docker-hadoop-3}} branch, and upgrade to latest Hadoop 2 release: 2.10.2.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org