You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Azuryy Yu <az...@gmail.com> on 2013/03/25 04:57:55 UTC
Hadoop-2.x native libraries
Hi,
How to get hadoop-2.0.3-alpha native libraries, it was compiled under
32bits OS in the released package currently.
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Its too complicated. because Hadoopv2 is wire compatable, so MRv1 should
keep old RPC protocol, you can compile only common and HDFS firstly from
hadoopv2, then add to MRv1 classpath, fix the issues for uncompatables.
On Mar 25, 2013 10:26 PM, "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com> wrote:
> Hi Azurry,
> Do you have detail steps what did you do to make MRV1 work with HDFS2?
> Thanks,
> Mounir
> On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> > Thanks Harsh!
> > I used -Pnative got it.
> > I am compile src code. I made MRv1 work with HDFSv2 successfully.
> >
> >
> > On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> > If you're using a tarball, you'll need to build a native-added
> > tarball
> > yourself with "mvn package -Pdist,native,docs -DskipTests
> > -Dtar" and
> > then use that.
> >
> > Alternatively, if you're interested in packages, use the
> > Apache
> > Bigtop's scripts from http://bigtop.apache.org/ project's
> > repository
> > and generate the packages with native libs as well.
> >
> > On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> > <az...@gmail.com> wrote:
> > > Hi,
> > > How to get hadoop-2.0.3-alpha native libraries, it was
> > compiled under 32bits
> > > OS in the released package currently.
> > >
> > >
> >
> >
> >
> > --
> > Harsh J
>
>
>
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Its too complicated. because Hadoopv2 is wire compatable, so MRv1 should
keep old RPC protocol, you can compile only common and HDFS firstly from
hadoopv2, then add to MRv1 classpath, fix the issues for uncompatables.
On Mar 25, 2013 10:26 PM, "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com> wrote:
> Hi Azurry,
> Do you have detail steps what did you do to make MRV1 work with HDFS2?
> Thanks,
> Mounir
> On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> > Thanks Harsh!
> > I used -Pnative got it.
> > I am compile src code. I made MRv1 work with HDFSv2 successfully.
> >
> >
> > On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> > If you're using a tarball, you'll need to build a native-added
> > tarball
> > yourself with "mvn package -Pdist,native,docs -DskipTests
> > -Dtar" and
> > then use that.
> >
> > Alternatively, if you're interested in packages, use the
> > Apache
> > Bigtop's scripts from http://bigtop.apache.org/ project's
> > repository
> > and generate the packages with native libs as well.
> >
> > On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> > <az...@gmail.com> wrote:
> > > Hi,
> > > How to get hadoop-2.0.3-alpha native libraries, it was
> > compiled under 32bits
> > > OS in the released package currently.
> > >
> > >
> >
> >
> >
> > --
> > Harsh J
>
>
>
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Its too complicated. because Hadoopv2 is wire compatable, so MRv1 should
keep old RPC protocol, you can compile only common and HDFS firstly from
hadoopv2, then add to MRv1 classpath, fix the issues for uncompatables.
On Mar 25, 2013 10:26 PM, "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com> wrote:
> Hi Azurry,
> Do you have detail steps what did you do to make MRV1 work with HDFS2?
> Thanks,
> Mounir
> On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> > Thanks Harsh!
> > I used -Pnative got it.
> > I am compile src code. I made MRv1 work with HDFSv2 successfully.
> >
> >
> > On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> > If you're using a tarball, you'll need to build a native-added
> > tarball
> > yourself with "mvn package -Pdist,native,docs -DskipTests
> > -Dtar" and
> > then use that.
> >
> > Alternatively, if you're interested in packages, use the
> > Apache
> > Bigtop's scripts from http://bigtop.apache.org/ project's
> > repository
> > and generate the packages with native libs as well.
> >
> > On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> > <az...@gmail.com> wrote:
> > > Hi,
> > > How to get hadoop-2.0.3-alpha native libraries, it was
> > compiled under 32bits
> > > OS in the released package currently.
> > >
> > >
> >
> >
> >
> > --
> > Harsh J
>
>
>
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Its too complicated. because Hadoopv2 is wire compatable, so MRv1 should
keep old RPC protocol, you can compile only common and HDFS firstly from
hadoopv2, then add to MRv1 classpath, fix the issues for uncompatables.
On Mar 25, 2013 10:26 PM, "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com> wrote:
> Hi Azurry,
> Do you have detail steps what did you do to make MRV1 work with HDFS2?
> Thanks,
> Mounir
> On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> > Thanks Harsh!
> > I used -Pnative got it.
> > I am compile src code. I made MRv1 work with HDFSv2 successfully.
> >
> >
> > On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> > If you're using a tarball, you'll need to build a native-added
> > tarball
> > yourself with "mvn package -Pdist,native,docs -DskipTests
> > -Dtar" and
> > then use that.
> >
> > Alternatively, if you're interested in packages, use the
> > Apache
> > Bigtop's scripts from http://bigtop.apache.org/ project's
> > repository
> > and generate the packages with native libs as well.
> >
> > On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> > <az...@gmail.com> wrote:
> > > Hi,
> > > How to get hadoop-2.0.3-alpha native libraries, it was
> > compiled under 32bits
> > > OS in the released package currently.
> > >
> > >
> >
> >
> >
> > --
> > Harsh J
>
>
>
Re: Hadoop-2.x native libraries
Posted by "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com>.
Hi Azurry,
Do you have detail steps what did you do to make MRV1 work with HDFS2?
Thanks,
Mounir
On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> Thanks Harsh!
> I used -Pnative got it.
> I am compile src code. I made MRv1 work with HDFSv2 successfully.
>
>
> On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added
> tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests
> -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the
> Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's
> repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was
> compiled under 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
Re: Hadoop-2.x native libraries
Posted by "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com>.
Hi Azurry,
Do you have detail steps what did you do to make MRV1 work with HDFS2?
Thanks,
Mounir
On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> Thanks Harsh!
> I used -Pnative got it.
> I am compile src code. I made MRv1 work with HDFSv2 successfully.
>
>
> On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added
> tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests
> -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the
> Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's
> repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was
> compiled under 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
Re: Hadoop-2.x native libraries
Posted by "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com>.
Hi Azurry,
Do you have detail steps what did you do to make MRV1 work with HDFS2?
Thanks,
Mounir
On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> Thanks Harsh!
> I used -Pnative got it.
> I am compile src code. I made MRv1 work with HDFSv2 successfully.
>
>
> On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added
> tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests
> -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the
> Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's
> repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was
> compiled under 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
Re: Hadoop-2.x native libraries
Posted by "Mounir E. Bsaibes" <mb...@linux.vnet.ibm.com>.
Hi Azurry,
Do you have detail steps what did you do to make MRV1 work with HDFS2?
Thanks,
Mounir
On Mon, 2013-03-25 at 13:39 +0800, Azuryy Yu wrote:
> Thanks Harsh!
> I used -Pnative got it.
> I am compile src code. I made MRv1 work with HDFSv2 successfully.
>
>
> On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added
> tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests
> -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the
> Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's
> repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu
> <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was
> compiled under 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh!
I used -Pnative got it.
I am compile src code. I made MRv1 work with HDFSv2 successfully.
On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was compiled under
> 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
>
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh!
I used -Pnative got it.
I am compile src code. I made MRv1 work with HDFSv2 successfully.
On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was compiled under
> 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
>
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh!
I used -Pnative got it.
I am compile src code. I made MRv1 work with HDFSv2 successfully.
On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was compiled under
> 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
>
Re: Hadoop-2.x native libraries
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh!
I used -Pnative got it.
I am compile src code. I made MRv1 work with HDFSv2 successfully.
On Mar 25, 2013 12:56 PM, "Harsh J" <ha...@cloudera.com> wrote:
> If you're using a tarball, you'll need to build a native-added tarball
> yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
> then use that.
>
> Alternatively, if you're interested in packages, use the Apache
> Bigtop's scripts from http://bigtop.apache.org/ project's repository
> and generate the packages with native libs as well.
>
> On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> > Hi,
> > How to get hadoop-2.0.3-alpha native libraries, it was compiled under
> 32bits
> > OS in the released package currently.
> >
> >
>
>
>
> --
> Harsh J
>
Re: Hadoop-2.x native libraries
Posted by Harsh J <ha...@cloudera.com>.
If you're using a tarball, you'll need to build a native-added tarball
yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
then use that.
Alternatively, if you're interested in packages, use the Apache
Bigtop's scripts from http://bigtop.apache.org/ project's repository
and generate the packages with native libs as well.
On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi,
> How to get hadoop-2.0.3-alpha native libraries, it was compiled under 32bits
> OS in the released package currently.
>
>
--
Harsh J
Re: Hadoop-2.x native libraries
Posted by Harsh J <ha...@cloudera.com>.
If you're using a tarball, you'll need to build a native-added tarball
yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
then use that.
Alternatively, if you're interested in packages, use the Apache
Bigtop's scripts from http://bigtop.apache.org/ project's repository
and generate the packages with native libs as well.
On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi,
> How to get hadoop-2.0.3-alpha native libraries, it was compiled under 32bits
> OS in the released package currently.
>
>
--
Harsh J
Re: Hadoop-2.x native libraries
Posted by Harsh J <ha...@cloudera.com>.
If you're using a tarball, you'll need to build a native-added tarball
yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
then use that.
Alternatively, if you're interested in packages, use the Apache
Bigtop's scripts from http://bigtop.apache.org/ project's repository
and generate the packages with native libs as well.
On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi,
> How to get hadoop-2.0.3-alpha native libraries, it was compiled under 32bits
> OS in the released package currently.
>
>
--
Harsh J
Re: Hadoop-2.x native libraries
Posted by Harsh J <ha...@cloudera.com>.
If you're using a tarball, you'll need to build a native-added tarball
yourself with "mvn package -Pdist,native,docs -DskipTests -Dtar" and
then use that.
Alternatively, if you're interested in packages, use the Apache
Bigtop's scripts from http://bigtop.apache.org/ project's repository
and generate the packages with native libs as well.
On Mon, Mar 25, 2013 at 9:27 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi,
> How to get hadoop-2.0.3-alpha native libraries, it was compiled under 32bits
> OS in the released package currently.
>
>
--
Harsh J