You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Bing Li <sa...@gmail.com> on 2013/12/18 13:50:52 UTC

FileChannel doesn't work when upgrade protobuf to 2.5.0 in Flume 1.3.1

Hi, guys
I'm using Flume 1.3.1 + protobuf 2.5.0, and got a failure in
TestFlileChannel, the target file is empty.

I have applied changes in
https://issues.apache.org/jira/browse/FLUME-1929
https://issues.apache.org/jira/browse/FLUME-2172

and update filechannel.proto to the latest.

Is there a simple way to fix this instead of port all changes related to
FileChannel from Flume 1.4.0?

Thank you!

=================
*Results :*

Failed tests:   testInOut(org.apache.flume.test.agent.TestFileChannel):
FILE_ROLL sink's actual output doesn't match expected output.

2013-12-18 04:16:43,959 (main) [ERROR -
org.apache.flume.test.agent.TestFileChannel.testInOut(TestFileChannel.java:156)]
Actual output doesn&apos;t match expected output.

==================

*Stack trace in Flume log:*

2013-12-17 23:21:18,027 (lifecycleSupervisor-1-0) [ERROR -
org.apache.flume.channel.file.Log.replay(Log.java:410)] Failed to
initialize Log on [channel=c1]
java.lang.UnsupportedOperationException: This is supposed to be overridden
by subclasses.
        at
com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
        at *org.apache.flume.channel.file.proto.ProtosFactory*
$Checkpoint.getSerializedSize(ProtosFactory.java:233)
        at *com.google.protobuf.AbstractMessageLite.writeDelimitedTo*
(AbstractMessageLite.java:84)
        at *org.apache.flume.channel.file.EventQueueBackingStoreFileV3*
.<init>(EventQueueBackingStoreFileV3.java:100)
        at
org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:64)
        at
org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36)
        at org.apache.flume.channel.file.Log.replay(Log.java:390)
        at
org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
        at
org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:450)
        at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:328)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:161)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:109)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:191)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:215)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:906)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:929)
        at java.lang.Thread.run(Thread.java:738)