You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by Arun C Murthy <ac...@hortonworks.com> on 2012/02/15 06:28:19 UTC
[VOTE] Release Apache Hadoop 0.23.1-rc1
I've created another release candidate for hadoop-0.23.1 that I would like to release.
It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
The hadoop-0.23.1-rc1 svn tag: https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
The maven artifacts for hadoop-0.23.1-rc1 are also available at repository.apache.org.
Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
# HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
# MAPREDUCE-3858. Task attempt failure during commit results in task never completing.
# MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery.
Please try the release and vote; the vote will run for the usual 7 days.
thanks,
Arun
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: [VOTE] Release Apache Hadoop 0.23.1-rc1
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
I checked this RC, based on my check-list:
- Signatures and message digests all are good.
- The top level full LICENSE, NOTICE and README for both the source and
binary artifacts are good
- CHANGES.txt for common, hdfs and mapped are correctly located.
- Able to build the tars out of the source tar ball.
Testing: All testing on single node, unsecured, default mode.
- Started HDFS daemons successfully , created directories.
- Successfully started YARN daemons - ResourceManager and NodeManager
- Successfully started mapred history server.
- Ran wordcount, pi, random writer, sort, grep and they all pass just
fine.
Even before the RC, been actively doing performance benchmarking and
testing on big clusters with this code. 0.23.1 clearly has much more
improvements compared to 0.23., even though it is still (the next level)
alpha.
With that, here's my +1 for the latest RC.
Thanks,
+Vinod
On Tue, Feb 14, 2012 at 9:28 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> I've created another release candidate for hadoop-0.23.1 that I would like
> to release.
>
> It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
> The hadoop-0.23.1-rc1 svn tag:
> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
> The maven artifacts for hadoop-0.23.1-rc1 are also available at
> repository.apache.org.
>
> Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
> # HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
> # MAPREDUCE-3858. Task attempt failure during commit results in task never
> completing.
> # MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and
> then the recovery.
>
> Please try the release and vote; the vote will run for the usual 7 days.
>
> thanks,
> Arun
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
Re: [VOTE] Release Apache Hadoop 0.23.1-rc1
Posted by Taeseong Kim <fl...@gmail.com>.
l
2012. 2. 15. 오후 2:29에 "Arun C Murthy" <ac...@hortonworks.com>님이 작성:
> I've created another release candidate for hadoop-0.23.1 that I would like
> to release.
>
> It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
> The hadoop-0.23.1-rc1 svn tag:
> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
> The maven artifacts for hadoop-0.23.1-rc1 are also available at
> repository.apache.org.
>
> Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
> # HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
> # MAPREDUCE-3858. Task attempt failure during commit results in task never
> completing.
> # MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and
> then the recovery.
>
> Please try the release and vote; the vote will run for the usual 7 days.
>
> thanks,
> Arun
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
Re: [VOTE] Release Apache Hadoop 0.23.1-rc1
Posted by Thomas Graves <tg...@yahoo-inc.com>.
I downloaded and checked this rc, some of the things I checked:
- release notes are present both binary and src
- html documentation present in binary: share/doc/hadoop/index.html
- release is present at:
https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoo
p-common/0.23.1/
- tag looks good and matches src tarball contents
- LICENSE, NOTICE and REAEDME are good
- md5 and signatures good
- src tarball builds
Testing: All testing on single node, unsecured
- all daemons started - hdfs/yarn/history server
- Ran wordcount, sleep, teragen, terasort, teravalidate and all passed
Questions (I'm new to this process):
- in binary package container-executor appears to be 64 bit, but the
libraries (libhadoop.a, etc) are 32 bit - what is the binary supposed to
support - 32 or 64?
- CHANGES.txt contains the date as (2012-02-08), does this need to be
updated for the new date of the rc1 vote?
Thanks,
Tom
On 2/14/12 11:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
> I've created another release candidate for hadoop-0.23.1 that I would like to
> release.
>
> It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
> The hadoop-0.23.1-rc1 svn tag:
> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
> The maven artifacts for hadoop-0.23.1-rc1 are also available at
> repository.apache.org.
>
> Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
> # HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
> # MAPREDUCE-3858. Task attempt failure during commit results in task never
> completing.
> # MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then
> the recovery.
>
> Please try the release and vote; the vote will run for the usual 7 days.
>
> thanks,
> Arun
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
Re: [VOTE] Release Apache Hadoop 0.23.1-rc1
Posted by Robert Evans <ev...@yahoo-inc.com>.
I built a tar from the tag, ran some basic tests on a single node cluster and it ran just fine. I am a bit concerned about the unit tests though. I ran all of the unit tests and I saw several failures
org.apache.hadoop.hdfs.server.namenode.TestStartup
org.apache.hadoop.yarn.server.resourcemanager.TestApplicationCleanup
org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
org.apache.hadoop.mapred.TestLazyOutput
org.apache.hadoop.tools.mapred.TestUniformSizeInputFormat
The only JIRA I could find for these failures is MAPREDUCE-3776 which covers TestRMContainerAllocator.
I am not sure if 0.23.1 is being considered alpha quality and if so do we want to let unit test failures block the release.
--Bobby Evans
On 2/14/12 11:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
I've created another release candidate for hadoop-0.23.1 that I would like to release.
It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
The hadoop-0.23.1-rc1 svn tag: https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
The maven artifacts for hadoop-0.23.1-rc1 are also available at repository.apache.org.
Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
# HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
# MAPREDUCE-3858. Task attempt failure during commit results in task never completing.
# MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery.
Please try the release and vote; the vote will run for the usual 7 days.
thanks,
Arun
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: [VOTE] Release Apache Hadoop 0.23.1-rc1
Posted by Ted Yu <yu...@gmail.com>.
What about MAPREDUCE-3685 which reportedly boosts performance for
MergeManager ?
Should it be considered for next RC ?
Cheers
On Sat, Feb 18, 2012 at 9:31 AM, Arun C Murthy <ac...@hortonworks.com> wrote:
> Makes sense, let me spin rc2.
>
> On Feb 17, 2012, at 8:20 AM, Robert Evans wrote:
>
> > I would like to see HADOOP-8054 put into 0.23.1. This is a regression
> that breaks hive.
> >
> > --Bobby Evans
> >
> > On 2/14/12 11:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
> >
> > I've created another release candidate for hadoop-0.23.1 that I would
> like to release.
> >
> > It is available at:
> http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
> > The hadoop-0.23.1-rc1 svn tag:
> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
> > The maven artifacts for hadoop-0.23.1-rc1 are also available at
> repository.apache.org.
> >
> > Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
> > # HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
> > # MAPREDUCE-3858. Task attempt failure during commit results in task
> never completing.
> > # MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and
> then the recovery.
> >
> > Please try the release and vote; the vote will run for the usual 7 days.
> >
> > thanks,
> > Arun
> >
> > --
> > Arun C. Murthy
> > Hortonworks Inc.
> > http://hortonworks.com/
> >
> >
> >
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
Re: [VOTE] Release Apache Hadoop 0.23.1-rc1
Posted by Arun C Murthy <ac...@hortonworks.com>.
Makes sense, let me spin rc2.
On Feb 17, 2012, at 8:20 AM, Robert Evans wrote:
> I would like to see HADOOP-8054 put into 0.23.1. This is a regression that breaks hive.
>
> --Bobby Evans
>
> On 2/14/12 11:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
> I've created another release candidate for hadoop-0.23.1 that I would like to release.
>
> It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
> The hadoop-0.23.1-rc1 svn tag: https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
> The maven artifacts for hadoop-0.23.1-rc1 are also available at repository.apache.org.
>
> Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
> # HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
> # MAPREDUCE-3858. Task attempt failure during commit results in task never completing.
> # MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery.
>
> Please try the release and vote; the vote will run for the usual 7 days.
>
> thanks,
> Arun
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: [VOTE] Release Apache Hadoop 0.23.1-rc1
Posted by Robert Evans <ev...@yahoo-inc.com>.
I would like to see HADOOP-8054 put into 0.23.1. This is a regression that breaks hive.
--Bobby Evans
On 2/14/12 11:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
I've created another release candidate for hadoop-0.23.1 that I would like to release.
It is available at: http://people.apache.org/~acmurthy/hadoop-0.23.1-rc1/
The hadoop-0.23.1-rc1 svn tag: https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.1-rc1
The maven artifacts for hadoop-0.23.1-rc1 are also available at repository.apache.org.
Since hadoop-0.23.1-rc0 last week, we've fixed some important bugs:
# HDFS-2923. Namenode IPC handler count uses the wrong configuration key.
# MAPREDUCE-3858. Task attempt failure during commit results in task never completing.
# MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery.
Please try the release and vote; the vote will run for the usual 7 days.
thanks,
Arun
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/