You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Pablo Musa <pa...@psafe.com> on 2012/07/03 22:19:05 UTC
Which hadoop version shoul I install in a production environment
Hi guys,
I am sorry to bother you, but I have a cluster already configured and running
with the following packages (cdh3):
hadoop-0.20.noarch 0.20.2+923.256-1
hadoop-hbase.noarch 0.90.6+84.29-1
hadoop-zookeeper.noarch 3.3.5+19.1-1
I having trouble with HBase regionserver that crashes (2-3 nodes per day) in
an 8 nodes cluster. I thought it was the GC problem, but I did the fix and they
still crash.
I was wondering if updating the whole system (hadoop + hbase + zookeeperr + mapred)
would fix my problems. Besides there are a lot of fixes and features implemented
since 0.20.
Searching around I found all the different versions realeased and opted by the
0.23-cdh4. Applied this new version to an old cdh3 dev environment 2 months ago.
Started doing other stuff and came back to finally try it into production.
Unfortunately, cdh4 is moved to 2.0 and I could not find the 0.23 packages
anymore. Besides, the 2.0 realease is in alpha version and thus not ready to
production.
Even worse, there is no 0.23 release in hadoop site:
http://hadoop.apache.org/common/releases.html
I read a few links, such as:
http://www.cloudera.com/blog/2012/01/an-update-on-apache-hadoop-1-0/
http://www.dbms2.com/2012/06/19/distributions-cdh-4-hdp-1-hadoop-2-0/
and could not reach to a conclusion for a very simple question:
Which is the latest stable hadoop version to install in a production
environment with package manager support?
Do you guys suggest any other manager than cdh?
Sorry for the bad english and thanks for the help ;)
Abs,
Pablo
Re: Which hadoop version shoul I install in a production environment
Posted by Matt Foley <mf...@hortonworks.com>.
0.20.2 is really old code and not nearly as stable as Hadoop 1.0. One
alternative, that would get you immediate access to stable 1.0 code and
which supports yum/rpm packaging, is HDP-1.0.0.12, available free from
Hortonworks. See http://hortonworks.com/download/
Disclosure: I'm a Hortonworks employee.
--Matt
On Thu, Jul 5, 2012 at 8:04 AM, Pablo Musa <pa...@psafe.com> wrote:
> Thank you all for your answers.
> I think I will keep 0.20.2 and wait for a new major release of cdh while I
> keep an eye on Ambari.
>
> Abs,
> Pablo
>
> -----Original Message-----
> From: Owen O'Malley [mailto:omalley@apache.org]
> Sent: terça-feira, 3 de julho de 2012 20:19
> To: common-user@hadoop.apache.org
> Subject: Re: Which hadoop version shoul I install in a production
> environment
>
> On Tue, Jul 3, 2012 at 1:19 PM, Pablo Musa <pa...@psafe.com> wrote:
>
> > Which is the latest stable hadoop version to install in a production
> > environment with package manager support?
> >
>
> The current stable version of Hadoop is 1.0.3. It is available as both
> source and rpms from here:
>
> http://hadoop.apache.org/common/releases.html#Download
>
>
> Which is the latest stable hadoop version to install in a production
> > environment with package manager support?
>
>
> Apache Ambari is a new project that can be used to install the Hadoop
> ecosystem including Hadoop 1.0.3 and HBase 0.92.1 using rpms and providing
> a web-based UI to control and monitor your cluster. They are in the process
> of making their first release and we would love to discuss it with you on
> ambari-user@apache.org.
>
> -- Owen
>
RE: Which hadoop version shoul I install in a production environment
Posted by Pablo Musa <pa...@psafe.com>.
Thank you all for your answers.
I think I will keep 0.20.2 and wait for a new major release of cdh while I keep an eye on Ambari.
Abs,
Pablo
-----Original Message-----
From: Owen O'Malley [mailto:omalley@apache.org]
Sent: terça-feira, 3 de julho de 2012 20:19
To: common-user@hadoop.apache.org
Subject: Re: Which hadoop version shoul I install in a production environment
On Tue, Jul 3, 2012 at 1:19 PM, Pablo Musa <pa...@psafe.com> wrote:
> Which is the latest stable hadoop version to install in a production
> environment with package manager support?
>
The current stable version of Hadoop is 1.0.3. It is available as both source and rpms from here:
http://hadoop.apache.org/common/releases.html#Download
Which is the latest stable hadoop version to install in a production
> environment with package manager support?
Apache Ambari is a new project that can be used to install the Hadoop ecosystem including Hadoop 1.0.3 and HBase 0.92.1 using rpms and providing a web-based UI to control and monitor your cluster. They are in the process of making their first release and we would love to discuss it with you on ambari-user@apache.org.
-- Owen
Re: Which hadoop version shoul I install in a production environment
Posted by Owen O'Malley <om...@apache.org>.
On Tue, Jul 3, 2012 at 1:19 PM, Pablo Musa <pa...@psafe.com> wrote:
> Which is the latest stable hadoop version to install in a production
> environment with package manager support?
>
The current stable version of Hadoop is 1.0.3. It is available as both
source and rpms from here:
http://hadoop.apache.org/common/releases.html#Download
Which is the latest stable hadoop version to install in a production
> environment with package manager support?
Apache Ambari is a new project that can be used to install the Hadoop
ecosystem including Hadoop 1.0.3 and HBase 0.92.1 using rpms and providing
a web-based UI to control and monitor your cluster. They are in the process
of making their first release and we would love to discuss it with you on
ambari-user@apache.org.
-- Owen
Re: Which hadoop version shoul I install in a production environment
Posted by Robert Evans <ev...@yahoo-inc.com>.
0.23 is also somewhat of an Alpha/Beta quality and I would not want to run
it in production just yet. 0.23 was renamed 2.0 and development work has
continued on both lines. New features have been going into 2.0 and 0.23
has been left only for stabilization. Hopefully we will have 0.23.3 to
the point that I feel comfortable calling a release vote on it soon, but
not quite yet.
--Bobby Evans
On 7/3/12 3:19 PM, "Pablo Musa" <pa...@psafe.com> wrote:
>Hi guys,
>I am sorry to bother you, but I have a cluster already configured and
>running
>with the following packages (cdh3):
>hadoop-0.20.noarch 0.20.2+923.256-1
>hadoop-hbase.noarch 0.90.6+84.29-1
>hadoop-zookeeper.noarch 3.3.5+19.1-1
>
>I having trouble with HBase regionserver that crashes (2-3 nodes per day)
>in
>an 8 nodes cluster. I thought it was the GC problem, but I did the fix
>and they
>still crash.
>
>I was wondering if updating the whole system (hadoop + hbase + zookeeperr
>+ mapred)
>would fix my problems. Besides there are a lot of fixes and features
>implemented
>since 0.20.
>
>Searching around I found all the different versions realeased and opted
>by the
>0.23-cdh4. Applied this new version to an old cdh3 dev environment 2
>months ago.
>Started doing other stuff and came back to finally try it into production.
>Unfortunately, cdh4 is moved to 2.0 and I could not find the 0.23 packages
>anymore. Besides, the 2.0 realease is in alpha version and thus not ready
>to
>production.
>Even worse, there is no 0.23 release in hadoop site:
>http://hadoop.apache.org/common/releases.html
>
>I read a few links, such as:
>http://www.cloudera.com/blog/2012/01/an-update-on-apache-hadoop-1-0/
>http://www.dbms2.com/2012/06/19/distributions-cdh-4-hdp-1-hadoop-2-0/
>and could not reach to a conclusion for a very simple question:
>Which is the latest stable hadoop version to install in a production
>environment with package manager support?
>
>Do you guys suggest any other manager than cdh?
>
>Sorry for the bad english and thanks for the help ;)
>
>Abs,
>Pablo