You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Jörg Anders <jr...@ymail.com.INVALID> on 2017/08/29 08:01:08 UTC

Error compiling parquet-mr

Hello!
I tried to compile apache-mr from source. Got lot of errors of this sort:

 /home/hduser/PARQUET/src/parquet-mr/parquet-protobuf/target/generated-test-sources/java/org/apache/parquet/proto/test/TestProto3.java:[12496,20] 
no suitable method found for parseFrom(java.nio.ByteBuffer,com.google.protobuf.ExtensionRegistryLite). I compiled protobuf from source because parquet-mr seems to 
request protobuf 3.x

$  protoc --version
libprotoc 3.3.0

$ cat /etc/issue
Debian GNU/Linux 8 \n \l

java is 
/usr/lib/jvm/java-7-openjdk-amd64

the mvn command is:

 LC_ALL=C mvn -X install

BTW:  Is there a way to skip the tests or at least the protoc tests?

Thank you in advance

Jorg





Re: Error compiling parquet-mr

Posted by 俊杰陈 <cj...@gmail.com>.
Hi
Change protoc version in parquet-protoc/pom.xml to same of your system
protoc version should work.

2017-08-29 23:48 GMT+08:00 Ryan Blue <rb...@netflix.com.invalid>:

> The easiest way to get your environment set up is to look at .travis.yml
> and install the same versions.
>
> The build is pretty much standard multi-module maven, so you can use -rf,
> -pl, -am, -amd, etc. Tests use surefire so standard options work there,
> too: -Dmaven.test.skip.
>
> rb
>
> On Tue, Aug 29, 2017 at 1:01 AM, Jörg Anders <jrg.anders@ymail.com.invalid
> >
> wrote:
>
> > Hello!
> > I tried to compile apache-mr from source. Got lot of errors of this sort:
> >
> >  /home/hduser/PARQUET/src/parquet-mr/parquet-protobuf/
> > target/generated-test-sources/java/org/apache/parquet/proto/
> > test/TestProto3.java:[12496,20]
> > no suitable method found for parseFrom(java.nio.ByteBuffer,
> > com.google.protobuf.ExtensionRegistryLite). I compiled protobuf from
> > source because parquet-mr seems to
> > request protobuf 3.x
> >
> > $  protoc --version
> > libprotoc 3.3.0
> >
> > $ cat /etc/issue
> > Debian GNU/Linux 8 \n \l
> >
> > java is
> > /usr/lib/jvm/java-7-openjdk-amd64
> >
> > the mvn command is:
> >
> >  LC_ALL=C mvn -X install
> >
> > BTW:  Is there a way to skip the tests or at least the protoc tests?
> >
> > Thank you in advance
> >
> > Jorg
> >
> >
> >
> >
> >
>
>
> --
> Ryan Blue
> Software Engineer
> Netflix
>



-- 
Thanks & Best Regards

Re: Error compiling parquet-mr

Posted by Ryan Blue <rb...@netflix.com.INVALID>.
The easiest way to get your environment set up is to look at .travis.yml
and install the same versions.

The build is pretty much standard multi-module maven, so you can use -rf,
-pl, -am, -amd, etc. Tests use surefire so standard options work there,
too: -Dmaven.test.skip.

rb

On Tue, Aug 29, 2017 at 1:01 AM, Jörg Anders <jr...@ymail.com.invalid>
wrote:

> Hello!
> I tried to compile apache-mr from source. Got lot of errors of this sort:
>
>  /home/hduser/PARQUET/src/parquet-mr/parquet-protobuf/
> target/generated-test-sources/java/org/apache/parquet/proto/
> test/TestProto3.java:[12496,20]
> no suitable method found for parseFrom(java.nio.ByteBuffer,
> com.google.protobuf.ExtensionRegistryLite). I compiled protobuf from
> source because parquet-mr seems to
> request protobuf 3.x
>
> $  protoc --version
> libprotoc 3.3.0
>
> $ cat /etc/issue
> Debian GNU/Linux 8 \n \l
>
> java is
> /usr/lib/jvm/java-7-openjdk-amd64
>
> the mvn command is:
>
>  LC_ALL=C mvn -X install
>
> BTW:  Is there a way to skip the tests or at least the protoc tests?
>
> Thank you in advance
>
> Jorg
>
>
>
>
>


-- 
Ryan Blue
Software Engineer
Netflix