You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Saritha Ravi <Sa...@chacha.com> on 2011/10/07 21:27:50 UTC
Help: Error with flume-hbase sink
Hi All,
>I am trying to configure flume-hbase sink in ec2 cloud.
>I have one flume-master,one flume-collector and one agent. I added
>hbase-sink jar file from github on my collector and update the
>flume-site.xml file. Added flume-class path too.
>I am getting error saying hbase class not found exception for these two
>files
>com.cloudera.flume.hbase.HBaseSink,com.cloudera.flume.hbase.Attr2HBaseEven
>tSink
>When I try jar tf
>
jar tf flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:127)
at java.util.zip.ZipFile.<init>(ZipFile.java:88)
at sun.tools.jar.Main.list(Main.java:979)
at sun.tools.jar.Main.run(Main.java:224)
at sun.tools.jar.Main.main(Main.java:1149)
>Getting the below error could you please help me with this
>
>
>
>
>Or can you please send me correct jar file
>
>Thanks,
>Saritha.
>
Re: Help: Error with flume-hbase sink
Posted by Saritha Ravi <Sa...@chacha.com>.
I am using sudo wget
https://github.com/abaranau/flume-plugin-hbasesink-compiled/blob/master/flu
me-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
Still getting the same error...
On 10/10/11 1:32 PM, "Mingjie Lai" <mj...@gmail.com> wrote:
>``mvn package'' should work.
>
>On 10/10/2011 08:35 AM, AD wrote:
>> how do you build this plugin from source? mvn compile doesnt seem to
>> create the .jar, jut the .classes ?
>>
>> On Mon, Oct 10, 2011 at 3:29 AM, Alex Baranau <alex.baranov.v@gmail.com
>> <ma...@gmail.com>> wrote:
>>
>> Weird. Jar seems good to me. Doing this:
>>
>> $ wget
>>
>>https://github.com/abaranau/flume-plugin-hbasesink-compiled/raw/master/fl
>>ume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
>> $ alex@alexpc:/tmp$ jar tf
>> flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
>> META-INF/
>> META-INF/MANIFEST.MF
>> com/
>> com/cloudera/
>> com/cloudera/flume/
>> com/cloudera/flume/hbase/
>> com/cloudera/flume/hbase/Attr2HBaseEventSink.class
>> com/cloudera/flume/hbase/HBaseSink$QualifierSpec.class
>> com/cloudera/flume/hbase/Attr2HBaseEventSink$1.class
>> com/cloudera/flume/hbase/HBaseSink.class
>> com/cloudera/flume/hbase/HBaseSink$1.class
>> META-INF/maven/
>> META-INF/maven/com.cloudera.flume.plugin/
>> META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/
>>
>>META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.xml
>>
>>META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.prope
>>rties
>>
>> Is that were you got the file from?
>>
>> Anyhow, if that is OK, I'd suggest you to try to build the new one
>> from the flume sources if this one doesn't work for you. As a bonus
>>I
>> guess it has some minor improvements in there - no sure. Don't know
>>if
>> there any other place to download this jar without compiling...
>>
>> Alex Baranau
>> ----
>> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Hadoop -
>> HBase
>>
>> On Sun, Oct 9, 2011 at 11:03 AM, Eran Kutner <eran@gigya.com
>> <ma...@gigya.com>> wrote:
>> > Just place those JARs in the flume lib directory.
>> >
>> > -eran
>> >
>> >
>> >
>> > On Fri, Oct 7, 2011 at 21:27, Saritha Ravi
>> <Saritha.Ravi@chacha.com <ma...@chacha.com>> wrote:
>> >>
>> >> Hi All,
>> >>
>> >> >I am trying to configure flume-hbase sink in ec2 cloud.
>> >> >I have one flume-master,one flume-collector and one agent. I
>>added
>> >> >hbase-sink jar file from github on my collector and update the
>> >> >flume-site.xml file. Added flume-class path too.
>> >> >I am getting error saying hbase class not found exception for
>> these two
>> >> >files
>> >>
>> >> >
>>
>>>com.cloudera.flume.hbase.HBaseSink,com.cloudera.flume.hbase.Attr2HBaseEv
>>>en
>> >> >tSink
>> >> >When I try jar tf
>> >> >
>> >>
>> >>
>> >> jar tf flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
>> >> java.util.zip.ZipException: error in opening zip file
>> >> at java.util.zip.ZipFile.open(Native Method)
>> >> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
>> >> at java.util.zip.ZipFile.<init>(ZipFile.java:88)
>> >> at sun.tools.jar.Main.list(Main.java:979)
>> >> at sun.tools.jar.Main.run(Main.java:224)
>> >> at sun.tools.jar.Main.main(Main.java:1149)
>> >>
>> >>
>> >> >Getting the below error could you please help me with this
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >Or can you please send me correct jar file
>> >> >
>> >> >Thanks,
>> >> >Saritha.
>> >> >
>> >>
>> >
>> >
>>
>>
>
Re: Help: Error with flume-hbase sink
Posted by Mingjie Lai <mj...@gmail.com>.
``mvn package'' should work.
On 10/10/2011 08:35 AM, AD wrote:
> how do you build this plugin from source? mvn compile doesnt seem to
> create the .jar, jut the .classes ?
>
> On Mon, Oct 10, 2011 at 3:29 AM, Alex Baranau <alex.baranov.v@gmail.com
> <ma...@gmail.com>> wrote:
>
> Weird. Jar seems good to me. Doing this:
>
> $ wget
> https://github.com/abaranau/flume-plugin-hbasesink-compiled/raw/master/flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
> $ alex@alexpc:/tmp$ jar tf
> flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
> META-INF/
> META-INF/MANIFEST.MF
> com/
> com/cloudera/
> com/cloudera/flume/
> com/cloudera/flume/hbase/
> com/cloudera/flume/hbase/Attr2HBaseEventSink.class
> com/cloudera/flume/hbase/HBaseSink$QualifierSpec.class
> com/cloudera/flume/hbase/Attr2HBaseEventSink$1.class
> com/cloudera/flume/hbase/HBaseSink.class
> com/cloudera/flume/hbase/HBaseSink$1.class
> META-INF/maven/
> META-INF/maven/com.cloudera.flume.plugin/
> META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/
> META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.xml
> META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.properties
>
> Is that were you got the file from?
>
> Anyhow, if that is OK, I'd suggest you to try to build the new one
> from the flume sources if this one doesn't work for you. As a bonus I
> guess it has some minor improvements in there - no sure. Don't know if
> there any other place to download this jar without compiling...
>
> Alex Baranau
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Hadoop -
> HBase
>
> On Sun, Oct 9, 2011 at 11:03 AM, Eran Kutner <eran@gigya.com
> <ma...@gigya.com>> wrote:
> > Just place those JARs in the flume lib directory.
> >
> > -eran
> >
> >
> >
> > On Fri, Oct 7, 2011 at 21:27, Saritha Ravi
> <Saritha.Ravi@chacha.com <ma...@chacha.com>> wrote:
> >>
> >> Hi All,
> >>
> >> >I am trying to configure flume-hbase sink in ec2 cloud.
> >> >I have one flume-master,one flume-collector and one agent. I added
> >> >hbase-sink jar file from github on my collector and update the
> >> >flume-site.xml file. Added flume-class path too.
> >> >I am getting error saying hbase class not found exception for
> these two
> >> >files
> >>
> >> >
> >com.cloudera.flume.hbase.HBaseSink,com.cloudera.flume.hbase.Attr2HBaseEven
> >> >tSink
> >> >When I try jar tf
> >> >
> >>
> >>
> >> jar tf flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
> >> java.util.zip.ZipException: error in opening zip file
> >> at java.util.zip.ZipFile.open(Native Method)
> >> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
> >> at java.util.zip.ZipFile.<init>(ZipFile.java:88)
> >> at sun.tools.jar.Main.list(Main.java:979)
> >> at sun.tools.jar.Main.run(Main.java:224)
> >> at sun.tools.jar.Main.main(Main.java:1149)
> >>
> >>
> >> >Getting the below error could you please help me with this
> >> >
> >> >
> >> >
> >> >
> >> >Or can you please send me correct jar file
> >> >
> >> >Thanks,
> >> >Saritha.
> >> >
> >>
> >
> >
>
>
Re: Help: Error with flume-hbase sink
Posted by AD <st...@gmail.com>.
how do you build this plugin from source? mvn compile doesnt seem to create
the .jar, jut the .classes ?
On Mon, Oct 10, 2011 at 3:29 AM, Alex Baranau <al...@gmail.com>wrote:
> Weird. Jar seems good to me. Doing this:
>
> $ wget
> https://github.com/abaranau/flume-plugin-hbasesink-compiled/raw/master/flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
> $ alex@alexpc:/tmp$ jar tf
> flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
> META-INF/
> META-INF/MANIFEST.MF
> com/
> com/cloudera/
> com/cloudera/flume/
> com/cloudera/flume/hbase/
> com/cloudera/flume/hbase/Attr2HBaseEventSink.class
> com/cloudera/flume/hbase/HBaseSink$QualifierSpec.class
> com/cloudera/flume/hbase/Attr2HBaseEventSink$1.class
> com/cloudera/flume/hbase/HBaseSink.class
> com/cloudera/flume/hbase/HBaseSink$1.class
> META-INF/maven/
> META-INF/maven/com.cloudera.flume.plugin/
> META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/
> META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.xml
>
> META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.properties
>
> Is that were you got the file from?
>
> Anyhow, if that is OK, I'd suggest you to try to build the new one
> from the flume sources if this one doesn't work for you. As a bonus I
> guess it has some minor improvements in there - no sure. Don't know if
> there any other place to download this jar without compiling...
>
> Alex Baranau
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Hadoop - HBase
>
> On Sun, Oct 9, 2011 at 11:03 AM, Eran Kutner <er...@gigya.com> wrote:
> > Just place those JARs in the flume lib directory.
> >
> > -eran
> >
> >
> >
> > On Fri, Oct 7, 2011 at 21:27, Saritha Ravi <Sa...@chacha.com>
> wrote:
> >>
> >> Hi All,
> >>
> >> >I am trying to configure flume-hbase sink in ec2 cloud.
> >> >I have one flume-master,one flume-collector and one agent. I added
> >> >hbase-sink jar file from github on my collector and update the
> >> >flume-site.xml file. Added flume-class path too.
> >> >I am getting error saying hbase class not found exception for these two
> >> >files
> >>
> >> >
> >com.cloudera.flume.hbase.HBaseSink,com.cloudera.flume.hbase.Attr2HBaseEven
> >> >tSink
> >> >When I try jar tf
> >> >
> >>
> >>
> >> jar tf flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
> >> java.util.zip.ZipException: error in opening zip file
> >> at java.util.zip.ZipFile.open(Native Method)
> >> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
> >> at java.util.zip.ZipFile.<init>(ZipFile.java:88)
> >> at sun.tools.jar.Main.list(Main.java:979)
> >> at sun.tools.jar.Main.run(Main.java:224)
> >> at sun.tools.jar.Main.main(Main.java:1149)
> >>
> >>
> >> >Getting the below error could you please help me with this
> >> >
> >> >
> >> >
> >> >
> >> >Or can you please send me correct jar file
> >> >
> >> >Thanks,
> >> >Saritha.
> >> >
> >>
> >
> >
>
Re: Help: Error with flume-hbase sink
Posted by Alex Baranau <al...@gmail.com>.
Weird. Jar seems good to me. Doing this:
$ wget https://github.com/abaranau/flume-plugin-hbasesink-compiled/raw/master/flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
$ alex@alexpc:/tmp$ jar tf flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
META-INF/
META-INF/MANIFEST.MF
com/
com/cloudera/
com/cloudera/flume/
com/cloudera/flume/hbase/
com/cloudera/flume/hbase/Attr2HBaseEventSink.class
com/cloudera/flume/hbase/HBaseSink$QualifierSpec.class
com/cloudera/flume/hbase/Attr2HBaseEventSink$1.class
com/cloudera/flume/hbase/HBaseSink.class
com/cloudera/flume/hbase/HBaseSink$1.class
META-INF/maven/
META-INF/maven/com.cloudera.flume.plugin/
META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/
META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.xml
META-INF/maven/com.cloudera.flume.plugin/flume-plugin-hbasesink/pom.properties
Is that were you got the file from?
Anyhow, if that is OK, I'd suggest you to try to build the new one
from the flume sources if this one doesn't work for you. As a bonus I
guess it has some minor improvements in there - no sure. Don't know if
there any other place to download this jar without compiling...
Alex Baranau
----
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Hadoop - HBase
On Sun, Oct 9, 2011 at 11:03 AM, Eran Kutner <er...@gigya.com> wrote:
> Just place those JARs in the flume lib directory.
>
> -eran
>
>
>
> On Fri, Oct 7, 2011 at 21:27, Saritha Ravi <Sa...@chacha.com> wrote:
>>
>> Hi All,
>>
>> >I am trying to configure flume-hbase sink in ec2 cloud.
>> >I have one flume-master,one flume-collector and one agent. I added
>> >hbase-sink jar file from github on my collector and update the
>> >flume-site.xml file. Added flume-class path too.
>> >I am getting error saying hbase class not found exception for these two
>> >files
>>
>> > >com.cloudera.flume.hbase.HBaseSink,com.cloudera.flume.hbase.Attr2HBaseEven
>> >tSink
>> >When I try jar tf
>> >
>>
>>
>> jar tf flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
>> java.util.zip.ZipException: error in opening zip file
>> at java.util.zip.ZipFile.open(Native Method)
>> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
>> at java.util.zip.ZipFile.<init>(ZipFile.java:88)
>> at sun.tools.jar.Main.list(Main.java:979)
>> at sun.tools.jar.Main.run(Main.java:224)
>> at sun.tools.jar.Main.main(Main.java:1149)
>>
>>
>> >Getting the below error could you please help me with this
>> >
>> >
>> >
>> >
>> >Or can you please send me correct jar file
>> >
>> >Thanks,
>> >Saritha.
>> >
>>
>
>
Re: Help: Error with flume-hbase sink
Posted by Eran Kutner <er...@gigya.com>.
Just place those JARs in the flume lib directory.
-eran
On Fri, Oct 7, 2011 at 21:27, Saritha Ravi <Sa...@chacha.com> wrote:
> Hi All,
>
> >I am trying to configure flume-hbase sink in ec2 cloud.
> >I have one flume-master,one flume-collector and one agent. I added
> >hbase-sink jar file from github on my collector and update the
> >flume-site.xml file. Added flume-class path too.
> >I am getting error saying hbase class not found exception for these two
> >files
> >com.cloudera.flume.hbase.HBaseSink,com.cloudera.flume.hbase.Attr2HBaseEven
> >tSink
> >When I try jar tf
> >
>
>
> jar tf flume-plugin-hbasesink-0.9.5-SNAPSHOT-20110627.jar
> java.util.zip.ZipException: error in opening zip file
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:127)
> at java.util.zip.ZipFile.<init>(ZipFile.java:88)
> at sun.tools.jar.Main.list(Main.java:979)
> at sun.tools.jar.Main.run(Main.java:224)
> at sun.tools.jar.Main.main(Main.java:1149)
>
>
> >Getting the below error could you please help me with this
> >
> >
> >
> >
> >Or can you please send me correct jar file
> >
> >Thanks,
> >Saritha.
> >
>
>