You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Yan Fang (JIRA)" <ji...@apache.org> on 2015/01/30 20:31:34 UTC
[jira] [Commented] (SAMZA-544) TestSamzaContainerPerformance throws
OOM occasionally
[ https://issues.apache.org/jira/browse/SAMZA-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299103#comment-14299103 ]
Yan Fang commented on SAMZA-544:
--------------------------------
Also, this test always takes very high CPU usage, sometimes 200%, is it suppose to be this way?
> TestSamzaContainerPerformance throws OOM occasionally
> ------------------------------------------------------
>
> Key: SAMZA-544
> URL: https://issues.apache.org/jira/browse/SAMZA-544
> Project: Samza
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Yan Fang
> Fix For: 0.9.0
>
>
> Occasionally, can see the OOM error from TestSamzaContainerPerformance. Doubt it is because we decreased the memory in SAMZA-426. Log is following.
> {code}
> 11:22:14.338 [DEBUG] [TestEventLogger] 2152 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Starting consumer multiplexer.
> 11:23:57.797 [ERROR] [system.err]
> 11:23:57.798 [ERROR] [system.err] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "MockSystemConsumer-7"
> 11:24:47.237 [DEBUG] [TestEventLogger] 155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down.
> 11:24:47.237 [DEBUG] [TestEventLogger] Exception in thread "MockSystemConsumer-6" java.lang.OutOfMemoryError: Java heap space
> 11:24:47.238 [DEBUG] [TestEventLogger] at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:335)
> 11:24:47.238 [DEBUG] [TestEventLogger] at org.apache.samza.util.BlockingEnvelopeMap.put(BlockingEnvelopeMap.java:168)
> 11:24:47.238 [DEBUG] [TestEventLogger] at org.apache.samza.system.mock.MockSystemConsumer.access$200(MockSystemConsumer.java:43)
> 11:24:47.238 [DEBUG] [TestEventLogger] at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
> 11:24:47.238 [DEBUG] [TestEventLogger] at java.lang.Thread.run(Thread.java:745)
> 11:24:47.239 [DEBUG] [TestEventLogger] 155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer.
> 11:24:47.239 [DEBUG] [TestEventLogger] Exception in thread "MockSystemConsumer-2" java.lang.OutOfMemoryError: Java heap space
> 11:24:47.239 [DEBUG] [TestEventLogger] at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
> 11:24:47.239 [DEBUG] [TestEventLogger] at java.lang.Thread.run(Thread.java:745)
> 11:24:47.240 [DEBUG] [TestEventLogger] Exception in thread "MockSystemConsumer-3" java.lang.OutOfMemoryError: Java heap space
> 11:24:47.240 [DEBUG] [TestEventLogger] Exception in thread "MockSystemConsumer-9" java.lang.OutOfMemoryError: Java heap space
> 11:24:47.240 [DEBUG] [TestEventLogger] at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
> 11:24:47.240 [DEBUG] [TestEventLogger] at java.lang.Thread.run(Thread.java:745)
> 11:24:47.240 [DEBUG] [TestEventLogger]
> 11:24:47.240 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_OUT
> 11:24:47.241 [DEBUG] [TestEventLogger] Got interrupt. Shutting down.
> 11:24:47.241 [DEBUG] [TestEventLogger] Got interrupt. Shutting down.
> 11:24:47.241 [DEBUG] [TestEventLogger] Got interrupt. Shutting down.
> 11:24:47.241 [DEBUG] [TestEventLogger] Got interrupt. Shutting down.
> 11:24:47.241 [DEBUG] [TestEventLogger] Got interrupt. Shutting down.
> 11:24:47.242 [DEBUG] [TestEventLogger] Got interrupt. Shutting down.
> 11:24:47.242 [DEBUG] [TestEventLogger] Got interrupt. Shutting down.
> 11:24:47.242 [DEBUG] [TestEventLogger]
> 11:24:47.242 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_ERROR
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)