You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2016/10/13 16:53:20 UTC

[jira] [Resolved] (BEAM-257) fix ConcurrentModificationException in KafkaIO

     [ https://issues.apache.org/jira/browse/BEAM-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi resolved BEAM-257.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 0.1.0-incubating

https://github.com/apache/incubator-beam/pull/290

> fix ConcurrentModificationException in KafkaIO
> ----------------------------------------------
>
>                 Key: BEAM-257
>                 URL: https://issues.apache.org/jira/browse/BEAM-257
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-extensions
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>             Fix For: 0.1.0-incubating
>
>
> [~tgroh] reported the following exception with KafkaIO while using with DirectRunner. Fixing it in https://github.com/apache/incubator-beam/pull/290
> {code}
>  java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
> 	at org.apache.kafka.clients.consumer.KafkaConsumer.acquire(KafkaConsumer.java:1324)
> 	at org.apache.kafka.clients.consumer.KafkaConsumer.close(KafkaConsumer.java:1255)
> 	at com.google.common.io.Closeables.close(Closeables.java:79)
> 	at org.apache.beam.sdk.io.kafka.KafkaIO$UnboundedKafkaReader.close(KafkaIO.java:1050)
> 	at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.finishBundle(UnboundedReadEvaluatorFactory.java:167)
> 	at org.apache.beam.runners.direct.TransformExecutor.finishBundle(TransformExecutor.java:161)
> 	at org.apache.beam.runners.direct.TransformExecutor.call(TransformExecutor.java:116)
> 	at org.apache.beam.runners.direct.TransformExecutor.call(TransformExecutor.java:41)
> 	at java.util.concurrent.FutureTask.run(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> 	at java.lang.Thread.run(Unknown Source)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)