You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Lichen <ke...@huawei.com> on 2012/10/08 09:37:52 UTC
RE: Unable to use HDFS sink
Hi Mike,
I’ve tried hadoop-1.0.3 which doesn’t work as before. Nothing happens after
[INFO - org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:70)] Creating instance of sink: hdfs-sink, type: hdfs
I can execute $HADOOP_HOME/bin/hadoop classpath. Don’t know why the HDFS sink is not working.
Chen
On Sat, Sep 30, 2012 at 10:49 AM, Mike Percy <mp...@apache.org>> wrote::
Hi,
Don't use vanilla hadoop 0.20.2 ... you will not get durability.
You must use hadoop 0.20.205, hadoop 1.0.x, hadoop 2.0.x, or CDH3/4 with Flume NG.
Regards,
Mike
On Sat, Sep 29, 2012 at 12:57 AM, Lichen <ke...@huawei.com>> wrote:
Hi. I’m using flume 1.2 with hadoop-0.20.2 but unable to use HDFS sink. Flume stuck during creating HDFS sink, which is OK using file-roll or logger sinks. I’ve included $HADOOP_HOME and $HADOOP_HOME/lib in FLUME_CLASSPATH. Is it because my hadoop version not compatible?
Configuration file:
agent_foo.sources = netcat-source
agent_foo.sinks = hdfs-sink
agent_foo.channels = mem-channel-1
# properties of netcat-source
agent_foo.sources.netcat-source.channels = mem-channel-1
agent_foo.sources.netcat-source.type = netcat
agent_foo.sources.netcat-source.bind = localhost
agent_foo.sources.netcat-source.port = 44444
# properties of hdfs-sink
agent_foo.sinks.hdfs-sink.channel = mem-channel-1
agent_foo.sinks.hdfs-sink.type = hdfs
agent_foo.sinks.hdfs-sink.hdfs.path = hdfs://hadoop0:9000/flume/
# properties of mem-channel-1
agent_foo.channels.mem-channel-1.type = memory
agent_foo.channels.mem-channel-1.capacity = 1000
agent_foo.channels.mem-channel-1.transactionCapacity = 100
Log:
$ bin/flume-ng agent -c conf/ -f conf/test.conf -n agent_foo
2012-09-29 15:19:47,765 (main) [INFO - org.apache.flume.lifecycle.LifecycleSupervisor.start(LifecycleSupervisor.java:67)] Starting lifecycle supervisor 1
2012-09-29 15:19:47,768 (main) [INFO - org.apache.flume.node.FlumeNode.start(FlumeNode.java:54)] Flume node starting - agent_foo
2012-09-29 15:19:47,772 (lifecycleSupervisor-1-1) [INFO - org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.start(DefaultLogicalNodeManager.java:187)] Node manager starting
2012-09-29 15:19:47,772 (lifecycleSupervisor-1-1) [INFO - org.apache.flume.lifecycle.LifecycleSupervisor.start(LifecycleSupervisor.java:67)] Starting lifecycle supervisor 11
2012-09-29 15:19:47,774 (lifecycleSupervisor-1-2) [INFO - org.apache.flume.conf.file.AbstractFileConfigurationProvider.start(AbstractFileConfigurationProvider.java:67)] Configuration provider starting
2012-09-29 15:19:47,776 (conf-file-poller-0) [INFO - org.apache.flume.conf.file.AbstractFileConfigurationProvider$FileWatcherRunnable.run(AbstractFileConfigurationProvider.java:195)] Reloading configuration file:conf/test.conf
2012-09-29 15:19:47,780 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)] Processing:hdfs-sink
2012-09-29 15:19:47,788 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)] Processing:hdfs-sink
2012-09-29 15:19:47,788 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:902)] Added sinks: hdfs-sink Agent: agent_foo
2012-09-29 15:19:47,789 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)] Processing:hdfs-sink
2012-09-29 15:19:47,816 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:122)] Post-validation flume configuration contains configuration for agents: [agent_foo]
2012-09-29 15:19:47,816 (conf-file-poller-0) [INFO - org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.loadChannels(PropertiesFileConfigurationProvider.java:249)] Creating channels
2012-09-29 15:19:47,858 (conf-file-poller-0) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.<init>(MonitoredCounterGroup.java:68)] Monitoried counter group for type: CHANNEL, name: mem-channel-1, registered successfully.
2012-09-29 15:19:47,859 (conf-file-poller-0) [INFO - org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.loadChannels(PropertiesFileConfigurationProvider.java:273)] created channel mem-channel-1
2012-09-29 15:19:47,879 (conf-file-poller-0) [INFO - org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:70)] Creating instance of sink: hdfs-sink, type: hdfs
There is no more output after the last line.
Re: Unable to use HDFS sink
Posted by Mike Percy <mp...@apache.org>.
Hi Chen,
I don't see the SinkRunner thread so it didn't get very far. I'm not sure
what went wrong but it looks like some error was swallowed somewhere by
some Thread maybe. Seems strange. But it isn't immediately obvious to me
what went wrong since if you are using a recent version of Flume it should
print an error to the log if it gets a ClassNotFoundException, say if it
can't find the Hadoop classes.
Regards,
Mike
On Mon, Oct 8, 2012 a
t 8:48 PM, Lichen <ke...@huawei.com> wrote:
> Mike, I’ve dumped flume and get this:****
>
> ** **
>
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode):*
> ***
>
> ** **
>
> "Attach Listener" daemon prio=10 tid=0x00002aaab5088000 nid=0x3229 waiting
> on condition [0x0000000000000000]****
>
> java.lang.Thread.State: RUNNABLE****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "conf-file-poller-0" prio=10 tid=0x00002aaab50d6000 nid=0x3210 waiting on
> condition [0x0000000041139000]****
>
> java.lang.Thread.State: WAITING (parking)****
>
> at sun.misc.Unsafe.park(Native Method)****
>
> - parking to wait for <0x00002aaab49f8aa8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
> at
> java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)****
>
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
> ****
>
> at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
> ****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> ****
>
> at java.lang.Thread.run(Thread.java:619)****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "lifecycleSupervisor-1-0" prio=10 tid=0x00002aaab50fe000 nid=0x320f
> waiting on condition [0x0000000041038000]****
>
> java.lang.Thread.State: TIMED_WAITING (parking)****
>
> at sun.misc.Unsafe.park(Native Method)****
>
> - parking to wait for <0x00002aaab49ff488> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
> at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)****
>
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
> ****
>
> at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
> ****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> ****
>
> at java.lang.Thread.run(Thread.java:619)****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "lifecycleSupervisor-1-2" prio=10 tid=0x00002aaab5cf7800 nid=0x320e
> waiting on condition [0x0000000040f37000]****
>
> java.lang.Thread.State: TIMED_WAITING (parking)****
>
> at sun.misc.Unsafe.park(Native Method)****
>
> - parking to wait for <0x00002aaab4a23be8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
> at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)****
>
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
> ****
>
> at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
> ****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> ****
>
> at java.lang.Thread.run(Thread.java:619)****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "lifecycleSupervisor-1-1" prio=10 tid=0x00002aaab5cf7000 nid=0x320d
> waiting on condition [0x0000000040e36000]****
>
> java.lang.Thread.State: TIMED_WAITING (parking)****
>
> at sun.misc.Unsafe.park(Native Method)****
>
> - parking to wait for <0x00002aaab4a23be8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
> at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)****
>
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
> ****
>
> at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
> ****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> ****
>
> at java.lang.Thread.run(Thread.java:619)****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "lifecycleSupervisor-1-0" prio=10 tid=0x00002aaab5cf6000 nid=0x320c
> waiting on condition [0x0000000040d35000]****
>
> java.lang.Thread.State: TIMED_WAITING (parking)****
>
> at sun.misc.Unsafe.park(Native Method)****
>
> - parking to wait for <0x00002aaab4a23be8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)****
>
> at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)****
>
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
> ****
>
> at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
> ****
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> ****
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> ****
>
> at java.lang.Thread.run(Thread.java:619)****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "Low Memory Detector" daemon prio=10 tid=0x00002aaab4dcc800 nid=0x320a
> runnable [0x0000000000000000]****
>
> java.lang.Thread.State: RUNNABLE****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "CompilerThread1" daemon prio=10 tid=0x00002aaab4dc9800 nid=0x3209 waiting
> on condition [0x0000000000000000]****
>
> java.lang.Thread.State: RUNNABLE****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "CompilerThread0" daemon prio=10 tid=0x00002aaab4dc5800 nid=0x3208 waiting
> on condition [0x0000000000000000]****
>
> java.lang.Thread.State: RUNNABLE****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "Signal Dispatcher" daemon prio=10 tid=0x00002aaab4bed800 nid=0x3207
> runnable [0x0000000000000000]****
>
> java.lang.Thread.State: RUNNABLE****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "Finalizer" daemon prio=10 tid=0x00002aaab4bd0800 nid=0x3206 in
> Object.wait() [0x000000004072f000]****
>
> java.lang.Thread.State: WAITING (on object monitor)****
>
> at java.lang.Object.wait(Native Method)****
>
> - waiting on <0x00002aaab49ffb68> (a
> java.lang.ref.ReferenceQueue$Lock)****
>
> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)***
> *
>
> - locked <0x00002aaab49ffb68> (a java.lang.ref.ReferenceQueue$Lock)
> ****
>
> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)***
> *
>
> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
> ****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "Reference Handler" daemon prio=10 tid=0x00002aaab4bce800 nid=0x3205 in
> Object.wait() [0x000000004062e000]****
>
> java.lang.Thread.State: WAITING (on object monitor)****
>
> at java.lang.Object.wait(Native Method)****
>
> - waiting on <0x00002aaab49f8358> (a java.lang.ref.Reference$Lock)
> ****
>
> at java.lang.Object.wait(Object.java:485)****
>
> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
> ****
>
> - locked <0x00002aaab49f8358> (a java.lang.ref.Reference$Lock)****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "main" prio=10 tid=0x000000004011a000 nid=0x3201 waiting on condition
> [0x000000004022a000]****
>
> java.lang.Thread.State: TIMED_WAITING (sleeping)****
>
> at java.lang.Thread.sleep(Native Method)****
>
> at
> org.apache.flume.lifecycle.LifecycleController.waitForOneOf(LifecycleController.java:73)
> ****
>
> at
> org.apache.flume.lifecycle.LifecycleController.waitForOneOf(LifecycleController.java:49)
> ****
>
> at org.apache.flume.node.Application.run(Application.java:167)****
>
> at org.apache.flume.node.Application.main(Application.java:70)****
>
> ** **
>
> Locked ownable synchronizers:****
>
> - None****
>
> ** **
>
> "VM Thread" prio=10 tid=0x00002aaab4bc7800 nid=0x3204 runnable****
>
> ** **
>
> "GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000040124000 nid=0x3202
> runnable****
>
> ** **
>
> "GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000040126000 nid=0x3203
> runnable****
>
> ** **
>
> "VM Periodic Task Thread" prio=10 tid=0x00002aaab4dcf000 nid=0x320b
> waiting on condition****
>
> ** **
>
> JNI global references: 615****
>
> ** **
>
> Is this enough to know why flume stuck? Thanks.****
>
> Chen****
>
> ** **
>
> On Mon, Oct 9, 2012 at 10:58 AM, Mike Percy <mp...@cloudera.org> wrote:**
> **
>
> ** **
>
> Chen if you can send jstack output that could help. Or do: sudo kill -3
> <pid> on Flume and send the output from the Flume stdout, which is the same
> thing.****
>
> ** **
>
> Regards****
>
> Mike****
>
RE: Unable to use HDFS sink
Posted by Lichen <ke...@huawei.com>.
Mike, I’ve dumped flume and get this:
Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode):
"Attach Listener" daemon prio=10 tid=0x00002aaab5088000 nid=0x3229 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"conf-file-poller-0" prio=10 tid=0x00002aaab50d6000 nid=0x3210 waiting on condition [0x0000000041139000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aaab49f8aa8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"lifecycleSupervisor-1-0" prio=10 tid=0x00002aaab50fe000 nid=0x320f waiting on condition [0x0000000041038000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aaab49ff488> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"lifecycleSupervisor-1-2" prio=10 tid=0x00002aaab5cf7800 nid=0x320e waiting on condition [0x0000000040f37000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aaab4a23be8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"lifecycleSupervisor-1-1" prio=10 tid=0x00002aaab5cf7000 nid=0x320d waiting on condition [0x0000000040e36000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aaab4a23be8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"lifecycleSupervisor-1-0" prio=10 tid=0x00002aaab5cf6000 nid=0x320c waiting on condition [0x0000000040d35000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00002aaab4a23be8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Low Memory Detector" daemon prio=10 tid=0x00002aaab4dcc800 nid=0x320a runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"CompilerThread1" daemon prio=10 tid=0x00002aaab4dc9800 nid=0x3209 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"CompilerThread0" daemon prio=10 tid=0x00002aaab4dc5800 nid=0x3208 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"Signal Dispatcher" daemon prio=10 tid=0x00002aaab4bed800 nid=0x3207 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"Finalizer" daemon prio=10 tid=0x00002aaab4bd0800 nid=0x3206 in Object.wait() [0x000000004072f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00002aaab49ffb68> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x00002aaab49ffb68> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
Locked ownable synchronizers:
- None
"Reference Handler" daemon prio=10 tid=0x00002aaab4bce800 nid=0x3205 in Object.wait() [0x000000004062e000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00002aaab49f8358> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x00002aaab49f8358> (a java.lang.ref.Reference$Lock)
Locked ownable synchronizers:
- None
"main" prio=10 tid=0x000000004011a000 nid=0x3201 waiting on condition [0x000000004022a000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.flume.lifecycle.LifecycleController.waitForOneOf(LifecycleController.java:73)
at org.apache.flume.lifecycle.LifecycleController.waitForOneOf(LifecycleController.java:49)
at org.apache.flume.node.Application.run(Application.java:167)
at org.apache.flume.node.Application.main(Application.java:70)
Locked ownable synchronizers:
- None
"VM Thread" prio=10 tid=0x00002aaab4bc7800 nid=0x3204 runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000040124000 nid=0x3202 runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000040126000 nid=0x3203 runnable
"VM Periodic Task Thread" prio=10 tid=0x00002aaab4dcf000 nid=0x320b waiting on condition
JNI global references: 615
Is this enough to know why flume stuck? Thanks.
Chen
On Mon, Oct 9, 2012 at 10:58 AM, Mike Percy <mp...@cloudera.org>> wrote:
Chen if you can send jstack output that could help. Or do: sudo kill -3 <pid> on Flume and send the output from the Flume stdout, which is the same thing.
Regards
Mike
Re: Unable to use HDFS sink
Posted by Mike Percy <mp...@cloudera.com>.
Chen if you can send jstack output that could help. Or do: sudo kill -3
<pid> on Flume and send the output from the Flume stdout, which is the same
thing.
Regards
Mike
On Mon, Oct 8, 2012 at 12:37 AM, Lichen <ke...@huawei.com> wrote:
> Hi Mike,****
>
> ** **
>
> I’ve tried hadoop-1.0.3 which doesn’t work as before. Nothing happens after
> ****
>
> [INFO -
> org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:70)]
> Creating instance of sink: hdfs-sink, type: hdfs****
>
> I can execute $HADOOP_HOME/bin/hadoop classpath. Don’t know why the HDFS
> sink is not working.****
>
> ** **
>
> Chen****
>
> ** **
>
> On Sat, Sep 30, 2012 at 10:49 AM, Mike Percy <mp...@apache.org> wrote::**
> **
>
> ** **
>
> Hi,****
>
> Don't use vanilla hadoop 0.20.2 ... you will not get durability.****
>
> ** **
>
> You must use hadoop 0.20.205, hadoop 1.0.x, hadoop 2.0.x, or CDH3/4 with
> Flume NG.****
>
> ** **
>
> Regards,****
>
> Mike****
>
> ** **
>
> On Sat, Sep 29, 2012 at 12:57 AM, Lichen <ke...@huawei.com> wrote:***
> *
>
> Hi. I’m using flume 1.2 with hadoop-0.20.2 but unable to use HDFS sink.
> Flume stuck during creating HDFS sink, which is OK using file-roll or
> logger sinks. I’ve included $HADOOP_HOME and $HADOOP_HOME/lib in
> FLUME_CLASSPATH. Is it because my hadoop version not compatible?****
>
> ****
>
> Configuration file:****
>
> agent_foo.sources = netcat-source****
>
> agent_foo.sinks = hdfs-sink****
>
> agent_foo.channels = mem-channel-1****
>
> ****
>
> # properties of netcat-source****
>
> agent_foo.sources.netcat-source.channels = mem-channel-1****
>
> agent_foo.sources.netcat-source.type = netcat****
>
> agent_foo.sources.netcat-source.bind = localhost****
>
> agent_foo.sources.netcat-source.port = 44444****
>
> ****
>
> # properties of hdfs-sink****
>
> agent_foo.sinks.hdfs-sink.channel = mem-channel-1****
>
> agent_foo.sinks.hdfs-sink.type = hdfs****
>
> agent_foo.sinks.hdfs-sink.hdfs.path = hdfs://hadoop0:9000/flume/****
>
> ****
>
> # properties of mem-channel-1****
>
> agent_foo.channels.mem-channel-1.type = memory****
>
> agent_foo.channels.mem-channel-1.capacity = 1000****
>
> agent_foo.channels.mem-channel-1.transactionCapacity = 100****
>
> ****
>
> Log:****
>
> $ bin/flume-ng agent -c conf/ -f conf/test.conf -n agent_foo****
>
> 2012-09-29 15:19:47,765 (main) [INFO -
> org.apache.flume.lifecycle.LifecycleSupervisor.start(LifecycleSupervisor.java:67)]
> Starting lifecycle supervisor 1****
>
> 2012-09-29 15:19:47,768 (main) [INFO -
> org.apache.flume.node.FlumeNode.start(FlumeNode.java:54)] Flume node
> starting - agent_foo****
>
> 2012-09-29 15:19:47,772 (lifecycleSupervisor-1-1) [INFO -
> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.start(DefaultLogicalNodeManager.java:187)]
> Node manager starting****
>
> 2012-09-29 15:19:47,772 (lifecycleSupervisor-1-1) [INFO -
> org.apache.flume.lifecycle.LifecycleSupervisor.start(LifecycleSupervisor.java:67)]
> Starting lifecycle supervisor 11****
>
> 2012-09-29 15:19:47,774 (lifecycleSupervisor-1-2) [INFO -
> org.apache.flume.conf.file.AbstractFileConfigurationProvider.start(AbstractFileConfigurationProvider.java:67)]
> Configuration provider starting****
>
> 2012-09-29 15:19:47,776 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.file.AbstractFileConfigurationProvider$FileWatcherRunnable.run(AbstractFileConfigurationProvider.java:195)]
> Reloading configuration file:conf/test.conf****
>
> 2012-09-29 15:19:47,780 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)]
> Processing:hdfs-sink****
>
> 2012-09-29 15:19:47,788 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)]
> Processing:hdfs-sink****
>
> 2012-09-29 15:19:47,788 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:902)]
> Added sinks: hdfs-sink Agent: agent_foo****
>
> 2012-09-29 15:19:47,789 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.addProperty(FlumeConfiguration.java:988)]
> Processing:hdfs-sink****
>
> 2012-09-29 15:19:47,816 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:122)]
> Post-validation flume configuration contains configuration for agents:
> [agent_foo]****
>
> 2012-09-29 15:19:47,816 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.loadChannels(PropertiesFileConfigurationProvider.java:249)]
> Creating channels****
>
> 2012-09-29 15:19:47,858 (conf-file-poller-0) [INFO -
> org.apache.flume.instrumentation.MonitoredCounterGroup.<init>(MonitoredCounterGroup.java:68)]
> Monitoried counter group for type: CHANNEL, name: mem-channel-1, registered
> successfully.****
>
> 2012-09-29 15:19:47,859 (conf-file-poller-0) [INFO -
> org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.loadChannels(PropertiesFileConfigurationProvider.java:273)]
> created channel mem-channel-1****
>
> 2012-09-29 15:19:47,879 (conf-file-poller-0) [INFO -
> org.apache.flume.sink.DefaultSinkFactory.create(DefaultSinkFactory.java:70)]
> Creating instance of sink: hdfs-sink, type: hdfs****
>
> ****
>
> There is no more output after the last line.****
>
> ** **
>