You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Sutanu Das <sd...@att.com> on 2015/07/22 21:47:36 UTC
Flume 1.6 Install question
Hello,
How do I install Flume 1.6 for git clone?
I already did this:
git clone https://git-wip-us.apache.org/repos/asf/flume.git flume
Question:
Do I have to compile the code now with Maven before I can use Flume?
Please help advise - thanks
Re: Flume 1.6 Install question
Posted by Hari Shreedharan <hs...@cloudera.com>.
Looks like you are missing Hadoop on the classpath. To write to HDFS you
need HDFS client lib (and its dependencies) in the classpath
Thanks,
Hari
On Thu, Aug 13, 2015 at 3:31 PM, Sutanu Das <sd...@att.com> wrote:
> Johny/Community,
>
>
>
> Tried the binary version but getting this error when running an agent, I
> just want to run Flume server and I don’t have Hadoop or HDP
>
>
>
>
>
> Any thoughts ?
>
>
>
>
>
>
>
> 13 Aug 2015 22:28:15,749 ERROR [conf-file-poller-0]
> (org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run:145)
> *- Failed to start agent because dependencies were not found in classpath.
> Error follows.*
>
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/io/SequenceFile$CompressionType
>
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.configure(HDFSEventSink.java:239)
>
> at
> org.apache.flume.conf.Configurables.configure(Configurables.java:41)
>
> at
> org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:413)
>
> at
> org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:98)
>
> at
> org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
>
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:744)
>
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.io.SequenceFile$CompressionType
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
> ... 12 more
>
>
>
> *From:* Johny Rufus [mailto:jrufus@cloudera.com]
> *Sent:* Wednesday, July 22, 2015 4:08 PM
> *To:* user@flume.apache.org
> *Subject:* Re: Flume 1.6 Install question
>
>
>
> Do you want to build Flume from source ? If not you can just download the
> binary version.
>
>
>
> https://cwiki.apache.org/confluence/display/FLUME/Getting+Started this
> should give you a fairly good idea of how to proceed.
>
>
> Thanks,
>
> Rufus
>
>
>
> On Wed, Jul 22, 2015 at 12:47 PM, Sutanu Das <sd...@att.com> wrote:
>
> Hello,
>
>
>
> How do I install Flume 1.6 for git clone?
>
>
>
> I already did this:
>
>
>
> git clone https://git-wip-us.apache.org/repos/asf/flume.git flume
>
>
>
>
>
> Question:
>
>
>
> Do I have to compile the code now with Maven before I can use Flume?
>
>
>
> Please help advise - thanks
>
>
>
>
>
RE: Flume 1.6 Install question
Posted by Sutanu Das <sd...@att.com>.
Johny/Community,
Tried the binary version but getting this error when running an agent, I just want to run Flume server and I don’t have Hadoop or HDP
Any thoughts ?
13 Aug 2015 22:28:15,749 ERROR [conf-file-poller-0] (org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run:145) - Failed to start agent because dependencies were not found in classpath. Error follows.
java.lang.NoClassDefFoundError: org/apache/hadoop/io/SequenceFile$CompressionType
at org.apache.flume.sink.hdfs.HDFSEventSink.configure(HDFSEventSink.java:239)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSinks(AbstractConfigurationProvider.java:413)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:98)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.io.SequenceFile$CompressionType
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 12 more
From: Johny Rufus [mailto:jrufus@cloudera.com]
Sent: Wednesday, July 22, 2015 4:08 PM
To: user@flume.apache.org
Subject: Re: Flume 1.6 Install question
Do you want to build Flume from source ? If not you can just download the binary version.
https://cwiki.apache.org/confluence/display/FLUME/Getting+Started this should give you a fairly good idea of how to proceed.
Thanks,
Rufus
On Wed, Jul 22, 2015 at 12:47 PM, Sutanu Das <sd...@att.com>> wrote:
Hello,
How do I install Flume 1.6 for git clone?
I already did this:
git clone https://git-wip-us.apache.org/repos/asf/flume.git flume
Question:
Do I have to compile the code now with Maven before I can use Flume?
Please help advise - thanks
Re: Flume 1.6 Install question
Posted by Johny Rufus <jr...@cloudera.com>.
Do you want to build Flume from source ? If not you can just download the
binary version.
https://cwiki.apache.org/confluence/display/FLUME/Getting+Started this
should give you a fairly good idea of how to proceed.
Thanks,
Rufus
On Wed, Jul 22, 2015 at 12:47 PM, Sutanu Das <sd...@att.com> wrote:
> Hello,
>
>
>
> How do I install Flume 1.6 for git clone?
>
>
>
> I already did this:
>
>
>
> git clone https://git-wip-us.apache.org/repos/asf/flume.git flume
>
>
>
>
>
> Question:
>
>
>
> Do I have to compile the code now with Maven before I can use Flume?
>
>
>
> Please help advise - thanks
>
>
>