You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Raymond Ng <ra...@gmail.com> on 2012/09/24 16:47:27 UTC
ETA for flume 1.3
Hi
I'd like to know when 1.3 is scheduled to be released, I'm waiting for the
fix for FLUME-1573 <../../../jira/browse/FLUME-1573>
I'm using flume 1.2 and have multiple hdfs sinks writing into the same
directory and I'm getting the following exception regularly
2012-09-21 16:26:50,567 WARN
[SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS
IO error
java.io.IOException: Callable timed out
at
org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
at
org.apache.flume.sink.hdfs.HDFSEventSink.append(HDFSEventSink.java:714)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.util.concurrent.TimeoutException
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228)
at java.util.concurrent.FutureTask.get(FutureTask.java:91)
at
org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:336)
... 5 more
2012-09-21 16:26:50,753 WARN
[SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS
IO error
java.io.IOException: Callable timed out
at
org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
--
Rgds
Ray
Re: ETA for flume 1.3
Posted by Brock Noland <br...@cloudera.com>.
I was thinking of starting proposing a 1.3 release and volunteering to
be the RM. It would still be sometime before there was a 1.3 release
if all went well. I'll get that thread started on the dev@ list.
On Mon, Sep 24, 2012 at 1:22 PM, Hari Shreedharan
<hs...@cloudera.com> wrote:
> As of now, there is no immediate timeline for Flume-1.3.0. Please bring it
> up once this patch is committed - we can discuss it at that time.
>
>
> Thanks
> Hari
>
> --
> Hari Shreedharan
>
> On Monday, September 24, 2012 at 7:47 AM, Raymond Ng wrote:
>
> Hi
>
> I'd like to know when 1.3 is scheduled to be released, I'm waiting for the
> fix for FLUME-1573
>
> I'm using flume 1.2 and have multiple hdfs sinks writing into the same
> directory and I'm getting the following exception regularly
>
> 2012-09-21 16:26:50,567 WARN
> [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO
> error
> java.io.IOException: Callable timed out
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.append(HDFSEventSink.java:714)
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412)
> at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.util.concurrent.TimeoutException
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228)
> at java.util.concurrent.FutureTask.get(FutureTask.java:91)
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:336)
> ... 5 more
> 2012-09-21 16:26:50,753 WARN
> [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO
> error
> java.io.IOException: Callable timed out
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
>
> --
> Rgds
> Ray
>
>
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
Re: ETA for flume 1.3
Posted by Hari Shreedharan <hs...@cloudera.com>.
As of now, there is no immediate timeline for Flume-1.3.0. Please bring it up once this patch is committed - we can discuss it at that time.
Thanks
Hari
--
Hari Shreedharan
On Monday, September 24, 2012 at 7:47 AM, Raymond Ng wrote:
> Hi
>
> I'd like to know when 1.3 is scheduled to be released, I'm waiting for the fix for FLUME-1573 (../../../jira/browse/FLUME-1573)
>
> I'm using flume 1.2 and have multiple hdfs sinks writing into the same directory and I'm getting the following exception regularly
>
> 2012-09-21 16:26:50,567 WARN [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO error
> java.io.IOException: Callable timed out
> at org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
> at org.apache.flume.sink.hdfs.HDFSEventSink.append(HDFSEventSink.java:714)
> at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.util.concurrent.TimeoutException
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228)
> at java.util.concurrent.FutureTask.get(FutureTask.java:91)
> at org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:336)
> ... 5 more
> 2012-09-21 16:26:50,753 WARN [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO error
> java.io.IOException: Callable timed out
> at org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
>
> --
> Rgds
> Ray