RE: Example mvn cmd line to build snappy native lib?

[Tim Broberg <Ti...@exar.com>]

Download from google code?

________________________________________
From: Alejandro Abdelnur [tucu@cloudera.com]
Sent: Monday, October 31, 2011 3:34 PM
To: common-dev@hadoop.apache.org
Subject: Re: Example mvn cmd line to build snappy native lib?

You still need to download//build/install snappy. I asume you are doing
that.

Yes, Hadoop snappy JNI goes in the libhadoop OS

Thanks.

Alejandro

On Mon, Oct 31, 2011 at 2:56 PM, Tim Broberg <Ti...@exar.com> wrote:

> Solved - In trunk, the snappy symbols are getting linked in with the rest
> of the native stuff in libhadoop.so:
>
> [tbroberg@san-mothra trunk]$ nm -gC
> hadoop-common-project/hadoop-common/target/hadoop-common-0.24.0-SNAPSHOT/lib/libhadoop.so
> | grep -i snappy
> 0000000000003c20 T
> Java_org_apache_hadoop_io_compress_snappy_SnappyCompressor_compressBytesDirect
> 00000000000039e0 T
> Java_org_apache_hadoop_io_compress_snappy_SnappyCompressor_initIDs
> 0000000000004200 T
> Java_org_apache_hadoop_io_compress_snappy_SnappyDecompressor_decompressBytesDirect
> 0000000000003fc0 T
> Java_org_apache_hadoop_io_compress_snappy_SnappyDecompressor_initIDs
>
> So, this command line is sufficient:
>
> mvn install -Pdist,native -DskipTests
>
> Thanks again for answering, Alejandro.
>
>    - Tim.
>
> ________________________________________
> From: Tim Broberg [Tim.Broberg@exar.com]
> Sent: Monday, October 31, 2011 12:59 PM
> To: common-dev@hadoop.apache.org
> Subject: RE: Example mvn cmd line to build snappy native lib?
>
> Thanks, Alejandro, but perhaps this is the procedure for a previous
> version?
>
> SVN trunk provides source in
> trunk/hadoop-common-project/hadoop-common/target/native/src/org/apache/hadoop/io/compress/snappy,
> but there is no config script or makefile.
>
> There is a fragment of documentation in trunk/BUILDING.txt - "  * Use
> -Dsnappy.prefix=(/usr/local) & -Dbundle.snappy=(false) to compile
>    Snappy JNI bindings and to bundle Snappy SO files" which suggests that
> this is maven-able, and compilation / packaging succeed, but there is no
> libsnappy.so at the end of the process.
>
> I'd really like not to switch to a different branch of the code yet again,
> and surely *somebody* knows how to build snappy in the trunk...
>
>    - Tim.
>
> ________________________________________
> From: Alejandro Abdelnur [tucu@cloudera.com]
> Sent: Monday, October 31, 2011 12:45 PM
> To: common-dev@hadoop.apache.org; Tim Broberg
> Subject: Re: Example mvn cmd line to build snappy native lib?
>
> Tim,
>
>  You have to download it snappy from source tarball, run './configure' and
> then 'make install'
>
> Thanks.
>
> Alejandro
>
> On Mon, Oct 31, 2011 at 11:24 AM, Tim Broberg <tb...@yahoo.com> wrote:
>
> > bump
> >
> > Does anybody know how to build the snappy native library?
> >
> >     - Tim.
> >
> >
> > ________________________________
> > From: Tim Broberg <tb...@yahoo.com>
> > To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>
> > Sent: Friday, October 28, 2011 11:52 PM
> > Subject: Example mvn cmd line to build snappy native lib?
> >
> > I'm trying to build the trunk from hadoop SVN including all the native
> > libraries.
> >
> > The BUILDING.txt file has the following documentation on building the
> > native libraries:
> >
> > "
> >  Build options:
> >
> >   * Use -Pnative to compile/bundle native code
> >   * Use -Dsnappy.prefix=(/usr/local) & -Dbundle.snappy=(false) to compile
> >     Snappy JNI bindings and to bundle Snappy SO files
> > "
> >
> > I tried the following, but never seem to get a libsnappy.so anywhere:
> >
> > mvn compile -Pnative
> > mvn compile -Pnative -Dsnappy.prefix=/usr/local
> >
> > mvn compile -Pnative -Dsnappy.prefix=/usr/local -Dbundle.snappy=true
> >
> > mvn compile -Pnative -Dsnappy.prefix=/usr/local -Dbundle.snappy=false
> >
> > mvn compile -Pnative -Dsnappy.prefix=~tbroberg -Dbundle.snappy=true
> >
> >
> > If I stick a #error statement in SnappyCompressor.c, I do see the first
> of
> > these fail, so it's doing *something* with snappy.
> >
> > Can anyone provide an example command line to build this?
> >
> > Thanks,
> >     - Tim.
>
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged.  The message is
> intended solely for the addressee(s).  If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful.  If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
>
> ________________________________
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged. The message is
> intended solely for the addressee(s). If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful. If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
>

The information and any attached documents contained in this message
may be confidential and/or legally privileged.  The message is
intended solely for the addressee(s).  If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful.  If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.

Re: Example mvn cmd line to build snappy native lib?

[Alejandro Abdelnur <tu...@cloudera.com>]

correct

On Mon, Oct 31, 2011 at 4:33 PM, Tim Broberg <Ti...@exar.com> wrote:

> Download from google code?
>
> ________________________________________
> From: Alejandro Abdelnur [tucu@cloudera.com]
> Sent: Monday, October 31, 2011 3:34 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Example mvn cmd line to build snappy native lib?
>
> You still need to download//build/install snappy. I asume you are doing
> that.
>
> Yes, Hadoop snappy JNI goes in the libhadoop OS
>
> Thanks.
>
> Alejandro
>
> On Mon, Oct 31, 2011 at 2:56 PM, Tim Broberg <Ti...@exar.com> wrote:
>
> > Solved - In trunk, the snappy symbols are getting linked in with the rest
> > of the native stuff in libhadoop.so:
> >
> > [tbroberg@san-mothra trunk]$ nm -gC
> >
> hadoop-common-project/hadoop-common/target/hadoop-common-0.24.0-SNAPSHOT/lib/libhadoop.so
> > | grep -i snappy
> > 0000000000003c20 T
> >
> Java_org_apache_hadoop_io_compress_snappy_SnappyCompressor_compressBytesDirect
> > 00000000000039e0 T
> > Java_org_apache_hadoop_io_compress_snappy_SnappyCompressor_initIDs
> > 0000000000004200 T
> >
> Java_org_apache_hadoop_io_compress_snappy_SnappyDecompressor_decompressBytesDirect
> > 0000000000003fc0 T
> > Java_org_apache_hadoop_io_compress_snappy_SnappyDecompressor_initIDs
> >
> > So, this command line is sufficient:
> >
> > mvn install -Pdist,native -DskipTests
> >
> > Thanks again for answering, Alejandro.
> >
> >    - Tim.
> >
> > ________________________________________
> > From: Tim Broberg [Tim.Broberg@exar.com]
> > Sent: Monday, October 31, 2011 12:59 PM
> > To: common-dev@hadoop.apache.org
> > Subject: RE: Example mvn cmd line to build snappy native lib?
> >
> > Thanks, Alejandro, but perhaps this is the procedure for a previous
> > version?
> >
> > SVN trunk provides source in
> >
> trunk/hadoop-common-project/hadoop-common/target/native/src/org/apache/hadoop/io/compress/snappy,
> > but there is no config script or makefile.
> >
> > There is a fragment of documentation in trunk/BUILDING.txt - "  * Use
> > -Dsnappy.prefix=(/usr/local) & -Dbundle.snappy=(false) to compile
> >    Snappy JNI bindings and to bundle Snappy SO files" which suggests that
> > this is maven-able, and compilation / packaging succeed, but there is no
> > libsnappy.so at the end of the process.
> >
> > I'd really like not to switch to a different branch of the code yet
> again,
> > and surely *somebody* knows how to build snappy in the trunk...
> >
> >    - Tim.
> >
> > ________________________________________
> > From: Alejandro Abdelnur [tucu@cloudera.com]
> > Sent: Monday, October 31, 2011 12:45 PM
> > To: common-dev@hadoop.apache.org; Tim Broberg
> > Subject: Re: Example mvn cmd line to build snappy native lib?
> >
> > Tim,
> >
> >  You have to download it snappy from source tarball, run './configure'
> and
> > then 'make install'
> >
> > Thanks.
> >
> > Alejandro
> >
> > On Mon, Oct 31, 2011 at 11:24 AM, Tim Broberg <tb...@yahoo.com>
> wrote:
> >
> > > bump
> > >
> > > Does anybody know how to build the snappy native library?
> > >
> > >     - Tim.
> > >
> > >
> > > ________________________________
> > > From: Tim Broberg <tb...@yahoo.com>
> > > To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>
> > > Sent: Friday, October 28, 2011 11:52 PM
> > > Subject: Example mvn cmd line to build snappy native lib?
> > >
> > > I'm trying to build the trunk from hadoop SVN including all the native
> > > libraries.
> > >
> > > The BUILDING.txt file has the following documentation on building the
> > > native libraries:
> > >
> > > "
> > >  Build options:
> > >
> > >   * Use -Pnative to compile/bundle native code
> > >   * Use -Dsnappy.prefix=(/usr/local) & -Dbundle.snappy=(false) to
> compile
> > >     Snappy JNI bindings and to bundle Snappy SO files
> > > "
> > >
> > > I tried the following, but never seem to get a libsnappy.so anywhere:
> > >
> > > mvn compile -Pnative
> > > mvn compile -Pnative -Dsnappy.prefix=/usr/local
> > >
> > > mvn compile -Pnative -Dsnappy.prefix=/usr/local -Dbundle.snappy=true
> > >
> > > mvn compile -Pnative -Dsnappy.prefix=/usr/local -Dbundle.snappy=false
> > >
> > > mvn compile -Pnative -Dsnappy.prefix=~tbroberg -Dbundle.snappy=true
> > >
> > >
> > > If I stick a #error statement in SnappyCompressor.c, I do see the first
> > of
> > > these fail, so it's doing *something* with snappy.
> > >
> > > Can anyone provide an example command line to build this?
> > >
> > > Thanks,
> > >     - Tim.
> >
> > The information and any attached documents contained in this message
> > may be confidential and/or legally privileged.  The message is
> > intended solely for the addressee(s).  If you are not the intended
> > recipient, you are hereby notified that any use, dissemination, or
> > reproduction is strictly prohibited and may be unlawful.  If you are
> > not the intended recipient, please contact the sender immediately by
> > return e-mail and destroy all copies of the original message.
> >
> > ________________________________
> > The information and any attached documents contained in this message
> > may be confidential and/or legally privileged. The message is
> > intended solely for the addressee(s). If you are not the intended
> > recipient, you are hereby notified that any use, dissemination, or
> > reproduction is strictly prohibited and may be unlawful. If you are
> > not the intended recipient, please contact the sender immediately by
> > return e-mail and destroy all copies of the original message.
> >
>
> The information and any attached documents contained in this message
> may be confidential and/or legally privileged.  The message is
> intended solely for the addressee(s).  If you are not the intended
> recipient, you are hereby notified that any use, dissemination, or
> reproduction is strictly prohibited and may be unlawful.  If you are
> not the intended recipient, please contact the sender immediately by
> return e-mail and destroy all copies of the original message.
>