You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Mike Percy (JIRA)" <ji...@apache.org> on 2012/05/09 03:39:49 UTC
[jira] [Created] (FLUME-1193) Rolling file sink doesn't handle
reconfiguration
Mike Percy created FLUME-1193:
---------------------------------
Summary: Rolling file sink doesn't handle reconfiguration
Key: FLUME-1193
URL: https://issues.apache.org/jira/browse/FLUME-1193
Project: Flume
Issue Type: Bug
Components: Sinks+Sources
Affects Versions: v1.1.0
Reporter: Mike Percy
Filing this so I don't forget. Tried to reconfigure rolling file sink, then write another event. I got nearly 10,000 of these exceptions in the log when sending one event after reconfiguration:
2012-05-08 18:33:55,413 ERROR flume.SinkRunner: Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to process event: [Event headers = {timestamp=1334340671000, Severity=2, host=localhost, Facility=8}, body.length = 14 ]
at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:201)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Bad file descriptor
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:282)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
at java.io.FilterOutputStream.write(FilterOutputStream.java:80)
at org.apache.flume.serialization.BodyTextEventSerializer.write(BodyTextEventSerializer.java:71)
at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:181)
... 3 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1193) Rolling file sink doesn't handle
reconfiguration
Posted by "Will McQueen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271096#comment-13271096 ]
Will McQueen commented on FLUME-1193:
-------------------------------------
This is a duplicate of FLUME-1175, which has a suggested patch.
> Rolling file sink doesn't handle reconfiguration
> ------------------------------------------------
>
> Key: FLUME-1193
> URL: https://issues.apache.org/jira/browse/FLUME-1193
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.1.0
> Reporter: Mike Percy
>
> Filing this so I don't forget. Tried to reconfigure rolling file sink, then write another event. I got nearly 10,000 of these exceptions in the log when sending one event after reconfiguration:
> 2012-05-08 18:33:55,413 ERROR flume.SinkRunner: Unable to deliver event. Exception follows.
> org.apache.flume.EventDeliveryException: Failed to process event: [Event headers = {timestamp=1334340671000, Severity=2, host=localhost, Facility=8}, body.length = 14 ]
> at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:201)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:282)
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
> at java.io.FilterOutputStream.write(FilterOutputStream.java:80)
> at org.apache.flume.serialization.BodyTextEventSerializer.write(BodyTextEventSerializer.java:71)
> at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:181)
> ... 3 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (FLUME-1193) Rolling file sink
doesn't handle reconfiguration
Posted by "Will McQueen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271096#comment-13271096 ]
Will McQueen edited comment on FLUME-1193 at 5/9/12 4:51 AM:
-------------------------------------------------------------
This is a duplicate of FLUME-1175, which has a suggested fix.
was (Author: will@cloudera.com):
This is a duplicate of FLUME-1175, which has a suggested patch.
> Rolling file sink doesn't handle reconfiguration
> ------------------------------------------------
>
> Key: FLUME-1193
> URL: https://issues.apache.org/jira/browse/FLUME-1193
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.1.0
> Reporter: Mike Percy
>
> Filing this so I don't forget. Tried to reconfigure rolling file sink, then write another event. I got nearly 10,000 of these exceptions in the log when sending one event after reconfiguration:
> 2012-05-08 18:33:55,413 ERROR flume.SinkRunner: Unable to deliver event. Exception follows.
> org.apache.flume.EventDeliveryException: Failed to process event: [Event headers = {timestamp=1334340671000, Severity=2, host=localhost, Facility=8}, body.length = 14 ]
> at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:201)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:282)
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
> at java.io.FilterOutputStream.write(FilterOutputStream.java:80)
> at org.apache.flume.serialization.BodyTextEventSerializer.write(BodyTextEventSerializer.java:71)
> at org.apache.flume.sink.RollingFileSink.process(RollingFileSink.java:181)
> ... 3 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira