You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "chenshangan (JIRA)" <ji...@apache.org> on 2014/07/11 08:16:07 UTC

[jira] [Commented] (FLUME-2420) HDFSEventSink#stop might throw ConcurrentModificationException

    [ https://issues.apache.org/jira/browse/FLUME-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058456#comment-14058456 ] 

chenshangan commented on FLUME-2420:
------------------------------------

This happens when we try to close all sinks. Following is the exception stack:
{code}
11 七月 2014 09:33:00,741 ERROR [pool-2-thread-1] (org.apache.flume.node.Application.stopAllSinks:119)  - Error while stopping SinkRunner: { policy:org.apache.flume.sink.DefaultSinkProcessor@6435d824 counterGroup:{ name:null counters:{runner.backoffs.consecutive=0, runner.backoffs=224} } }
java.util.ConcurrentModificationException    at java.util.LinkedHashMap$LinkedHashIterator.nextEntry(LinkedHashMap.java:394)    at java.util.LinkedHashMap$EntryIterator.next(LinkedHashMap.java:413)
    at java.util.LinkedHashMap$EntryIterator.next(LinkedHashMap.java:412)
    at org.apache.flume.sink.hdfs.HDFSEventSink.stop(HDFSEventSink.java:615)    at org.apache.flume.sink.DefaultSinkProcessor.stop(DefaultSinkProcessor.java:53)    at org.apache.flume.SinkRunner.stop(SinkRunner.java:122)
    at org.apache.flume.lifecycle.LifecycleSupervisor.unsupervise(LifecycleSupervisor.java:172)
    at org.apache.flume.node.Application.stopAllSinks(Application.java:117)    at org.apache.flume.node.SinkZookeeperRunnable.run(SinkZookeeperRunnable.java:71)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)    
    at java.lang.Thread.run(Thread.java:722)
{code}

> HDFSEventSink#stop might throw ConcurrentModificationException
> --------------------------------------------------------------
>
>                 Key: FLUME-2420
>                 URL: https://issues.apache.org/jira/browse/FLUME-2420
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.5.0
>            Reporter: chenshangan
>            Assignee: chenshangan
>         Attachments: FLUME-2420.patch
>
>
> There's a chance that bucketWriter callback and HDFSEventSink#stop operate on sfWriter together. So synchronized should apply before operation on sfWriter.



--
This message was sent by Atlassian JIRA
(v6.2#6252)