You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Rajkumar Muthukumar (JIRA)" <ji...@apache.org> on 2014/05/22 01:24:38 UTC
[jira] [Commented] (FLUME-2147) Missing headers cause events to
become stuck in channel
[ https://issues.apache.org/jira/browse/FLUME-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005379#comment-14005379 ]
Rajkumar Muthukumar commented on FLUME-2147:
--------------------------------------------
Rajkumar Muthukumar: May 21 2014
When I try to inject data using, I get this error. Can someone shed lights on this issue?.
014-05-21 22:36:27,606 ERROR org.apache.flume.sink.hdfs.HDFSEventSink: process failed
java.lang.NullPointerException: Expected timestamp in the Flume event headers, but it was null
at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229)
at org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:200)
at org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:396)
at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:356)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:619)
> Missing headers cause events to become stuck in channel
> -------------------------------------------------------
>
> Key: FLUME-2147
> URL: https://issues.apache.org/jira/browse/FLUME-2147
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Reporter: Jonathan Cooper-Ellis
>
> If a sink expects a header but does not find it, events will become stuck in the channel and Flume will log NullPointer and EventDelivery exceptions. In a memory channel, this can be fixed by restarting. In a file channel, restarting does not cause events to be removed.
> 05 Aug 2013 12:21:09,424 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.SinkRunner$PollingRunner.run:160) - Unable to deliver event. Exception follows.
> org.apache.flume.EventDeliveryException: java.lang.NullPointerException: Expected timestamp in the Flume event headers, but it was null
> at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:426)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.NullPointerException: Expected timestamp in the Flume event headers, but it was null
> at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:204)
> at org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:200)
> at org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:396)
> at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:356)
> ... 3 more
> 05 Aug 2013 12:21:09,424 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.hdfs.HDFSEventSink.process:422) - process failed
> java.lang.NullPointerException: Expected timestamp in the Flume event headers, but it was null
> at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:204)
> at org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:200)
> at org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:396)
> at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:356)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> I was using RegexExtractorInterceptor to match timestamp for partitioning in with HDFS sink.
--
This message was sent by Atlassian JIRA
(v6.2#6252)