You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jay Kreps (JIRA)" <ji...@apache.org> on 2015/02/07 23:15:34 UTC
[jira] [Resolved] (KAFKA-1290) TestLogCleaning tool hangs on the
new producer
[ https://issues.apache.org/jira/browse/KAFKA-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jay Kreps resolved KAFKA-1290.
------------------------------
Resolution: Fixed
Seems to have fixed itself.
> TestLogCleaning tool hangs on the new producer
> ----------------------------------------------
>
> Key: KAFKA-1290
> URL: https://issues.apache.org/jira/browse/KAFKA-1290
> Project: Kafka
> Issue Type: Sub-task
> Components: producer
> Affects Versions: 0.9.0
> Reporter: Neha Narkhede
> Priority: Blocker
>
> KAFKA-1281 (yet to be checked in) converted existing tools to use the new producer. I found that TestLogCleaning hangs while sending messages using the new producer. Following is a thread dump and steps to reproduce the issue.
> nnarkhed-mn1:kafka-git-idea nnarkhed$ ./bin/kafka-run-class.sh kafka.TestLogCleaning --broker localhost:9092 --topics 1 --zk localhost:2181 --messages 100000
> Producing 100000 messages...
> Logging produce requests to /var/folders/61/bspy8z8n1t5dn5sdqzsnhbdr000383/T/kafka-log-cleaner-produced-3744326506335955516.txt
> 2014-03-04 10:51:35
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.65-b04-462 mixed mode):
> "kafka-network-thread" daemon prio=5 tid=7fc27e94c000 nid=0x10a643000 runnable [10a642000]
> java.lang.Thread.State: RUNNABLE
> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
> at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136)
> at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
> - locked <7ec0b0170> (a sun.nio.ch.Util$2)
> - locked <7ec0b0180> (a java.util.Collections$UnmodifiableSet)
> - locked <7ec0b0128> (a sun.nio.ch.KQueueSelectorImpl)
> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
> at org.apache.kafka.common.network.Selector.select(Selector.java:296)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:198)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:153)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:98)
> at java.lang.Thread.run(Thread.java:695)
> "RMI TCP Accept-0" daemon prio=5 tid=7fc27e99c800 nid=0x10a43d000 runnable [10a43c000]
> java.lang.Thread.State: RUNNABLE
> at java.net.PlainSocketImpl.socketAccept(Native Method)
> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:439)
> - locked <7ec0b6088> (a java.net.SocksSocketImpl)
> at java.net.ServerSocket.implAccept(ServerSocket.java:468)
> at java.net.ServerSocket.accept(ServerSocket.java:436)
> at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)
> at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
> at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
> at java.lang.Thread.run(Thread.java:695)
> "AWT-AppKit" daemon prio=5 tid=7fc27f830000 nid=0x7fff7b984180 runnable [00000000]
> java.lang.Thread.State: RUNNABLE
> "Low Memory Detector" daemon prio=5 tid=7fc27e8db000 nid=0x109b30000 runnable [00000000]
> java.lang.Thread.State: RUNNABLE
> "C2 CompilerThread1" daemon prio=9 tid=7fc27e8da800 nid=0x109a2d000 waiting on condition [00000000]
> java.lang.Thread.State: RUNNABLE
> "C2 CompilerThread0" daemon prio=9 tid=7fc27e8d9800 nid=0x10992a000 waiting on condition [00000000]
> java.lang.Thread.State: RUNNABLE
> "Signal Dispatcher" daemon prio=9 tid=7fc27e8d9000 nid=0x109827000 waiting on condition [00000000]
> java.lang.Thread.State: RUNNABLE
> "Surrogate Locker Thread (Concurrent GC)" daemon prio=5 tid=7fc27e002000 nid=0x109724000 waiting on condition [00000000]
> java.lang.Thread.State: RUNNABLE
> "Finalizer" daemon prio=8 tid=7fc27e8d8000 nid=0x109519000 in Object.wait() [109518000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <7ec0b23b0> (a java.lang.ref.ReferenceQueue$Lock)
> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
> - locked <7ec0b23b0> (a java.lang.ref.ReferenceQueue$Lock)
> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171)
> "Reference Handler" daemon prio=10 tid=7fc27e8d7800 nid=0x109416000 in Object.wait() [109415000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <7ec0b4000> (a java.lang.ref.Reference$Lock)
> at java.lang.Object.wait(Object.java:485)
> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
> - locked <7ec0b4000> (a java.lang.ref.Reference$Lock)
> "main" prio=5 tid=7fc27e000800 nid=0x102159000 in Object.wait() [102158000]
> java.lang.Thread.State: TIMED_WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <7ec0b23e0> (a org.apache.kafka.clients.producer.internals.Metadata)
> at org.apache.kafka.clients.producer.internals.Metadata.fetch(Metadata.java:89)
> - locked <7ec0b23e0> (a org.apache.kafka.clients.producer.internals.Metadata)
> at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:210)
> at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:144)
> at kafka.TestLogCleaning$$anonfun$produceMessages$1.apply$mcVL$sp(TestLogCleaning.scala:260)
> at kafka.TestLogCleaning$$anonfun$produceMessages$1.apply(TestLogCleaning.scala:251)
> at kafka.TestLogCleaning$$anonfun$produceMessages$1.apply(TestLogCleaning.scala:251)
> at scala.collection.immutable.NumericRange.foreach(NumericRange.scala:86)
> at kafka.TestLogCleaning$.produceMessages(TestLogCleaning.scala:251)
> at kafka.TestLogCleaning$.main(TestLogCleaning.scala:113)
> at kafka.TestLogCleaning.main(TestLogCleaning.scala)
> "VM Thread" prio=9 tid=7fc27e8d3000 nid=0x109313000 runnable
> "Gang worker#0 (Parallel GC Threads)" prio=9 tid=7fc27e800000 nid=0x10555b000 runnable
> "Gang worker#1 (Parallel GC Threads)" prio=9 tid=7fc27e801000 nid=0x10565e000 runnable
> "Gang worker#2 (Parallel GC Threads)" prio=9 tid=7fc27e801800 nid=0x105761000 runnable
> "Gang worker#3 (Parallel GC Threads)" prio=9 tid=7fc27e802000 nid=0x105864000 runnable
> "Concurrent Mark-Sweep GC Thread" prio=9 tid=7fc27e87d000 nid=0x108f8a000 runnable
> "VM Periodic Task Thread" prio=10 tid=7fc27e9b8000 nid=0x10a540000 waiting on condition
> "Exception Catcher Thread" prio=10 tid=7fc27e001800 nid=0x102384000 runnable
> JNI global references: 1387
> Heap
> par new generation total 19136K, used 1795K [7eae00000, 7ec2c0000, 7ece00000)
> eden space 17024K, 5% used [7eae00000, 7eaed6a28, 7ebea0000)
> from space 2112K, 44% used [7ec0b0000, 7ec19a5c8, 7ec2c0000)
> to space 2112K, 0% used [7ebea0000, 7ebea0000, 7ec0b0000)
> concurrent mark-sweep generation total 63872K, used 2050K [7ece00000, 7f0c60000, 7fae00000)
> concurrent-mark-sweep perm gen total 21248K, used 13649K [7fae00000, 7fc2c0000, 800000000)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)