You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Suma Shivaprasad (JIRA)" <ji...@apache.org> on 2016/06/16 23:12:05 UTC

[jira] [Comment Edited] (ATLAS-912) Update to use Kafka 0.10.0.0 (from 0.9.0.0)

    [ https://issues.apache.org/jira/browse/ATLAS-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334906#comment-15334906 ] 

Suma Shivaprasad edited comment on ATLAS-912 at 6/16/16 11:11 PM:
------------------------------------------------------------------

Seeing an OOM error in StormHook while running tests with 1G heap size with the new Kafka version

[WARNING] FAILED org.eclipse.jetty.server.handler.ContextHandlerCollection@14c8d0b0[o.e.j.m.p.JettyWebAppContext@32bf5cde{/,file:/Users/sshivaprasad/workspace-latest/atlas-commit2/webapp/target/atlas-webapp-0.7-incubating-SNAPSHOT/,STARTING}{/Users/sshivaprasad/workspace-latest/atlas-commit2/webapp/target/atlas-webapp-0.7-incubating-SNAPSHOT.war}]: java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
	at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
	at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
	at kafka.log.SkimpyOffsetMap.<init>(OffsetMap.scala:43)
	at kafka.log.LogCleaner$CleanerThread.<init>(LogCleaner.scala:193)
	at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83)
	at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
	at scala.collection.immutable.Range.foreach(Range.scala:141)
	at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
	at scala.collection.AbstractTraversable.map(Traversable.scala:105)
	at kafka.log.LogCleaner.<init>(LogCleaner.scala:83)
	at kafka.log.LogManager.<init>(LogManager.scala:66)
	at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:609)
	at kafka.server.KafkaServer.startup(KafkaServer.scala:183)
	at org.apache.atlas.kafka.KafkaNotification.startKafka(KafkaNotification.java:335)
	at org.apache.atlas.kafka.KafkaNotification.start(KafkaNotification.java:140)
	at org.apache.atlas.service.Services.start(Services.java:45)
	at org.apache.atlas.web.listeners.GuiceServletConfig.startServices(GuiceServletConfig.java:142)
	at org.apache.atlas.web.listeners.TestGuiceServletConfig.startServices(TestGuiceServletConfig.java:74)
	at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:136)
	at org.apache.atlas.web.listeners.TestGuiceServletConfig.contextInitialized(TestGuiceServletConfig.java:42)
	at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
	at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
	at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
	at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
	at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
	at org.eclipse.jetty.maven.plugin.JettyWebAppContext.startWebapp(JettyWebAppContext.java:296)
	at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
	at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
	at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
	at org.eclipse.jetty.maven.plugin.JettyWebAppContext.doStart(JettyWebAppContext.java:365)


was (Author: suma.shivaprasad):
Seeing an OOM error in StormHook while running tests

[WARNING] FAILED org.eclipse.jetty.server.handler.ContextHandlerCollection@14c8d0b0[o.e.j.m.p.JettyWebAppContext@32bf5cde{/,file:/Users/sshivaprasad/workspace-latest/atlas-commit2/webapp/target/atlas-webapp-0.7-incubating-SNAPSHOT/,STARTING}{/Users/sshivaprasad/workspace-latest/atlas-commit2/webapp/target/atlas-webapp-0.7-incubating-SNAPSHOT.war}]: java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
	at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
	at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
	at kafka.log.SkimpyOffsetMap.<init>(OffsetMap.scala:43)
	at kafka.log.LogCleaner$CleanerThread.<init>(LogCleaner.scala:193)
	at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83)
	at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
	at scala.collection.immutable.Range.foreach(Range.scala:141)
	at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
	at scala.collection.AbstractTraversable.map(Traversable.scala:105)
	at kafka.log.LogCleaner.<init>(LogCleaner.scala:83)
	at kafka.log.LogManager.<init>(LogManager.scala:66)
	at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:609)
	at kafka.server.KafkaServer.startup(KafkaServer.scala:183)
	at org.apache.atlas.kafka.KafkaNotification.startKafka(KafkaNotification.java:335)
	at org.apache.atlas.kafka.KafkaNotification.start(KafkaNotification.java:140)
	at org.apache.atlas.service.Services.start(Services.java:45)
	at org.apache.atlas.web.listeners.GuiceServletConfig.startServices(GuiceServletConfig.java:142)
	at org.apache.atlas.web.listeners.TestGuiceServletConfig.startServices(TestGuiceServletConfig.java:74)
	at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:136)
	at org.apache.atlas.web.listeners.TestGuiceServletConfig.contextInitialized(TestGuiceServletConfig.java:42)
	at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
	at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
	at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
	at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
	at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
	at org.eclipse.jetty.maven.plugin.JettyWebAppContext.startWebapp(JettyWebAppContext.java:296)
	at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
	at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
	at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
	at org.eclipse.jetty.maven.plugin.JettyWebAppContext.doStart(JettyWebAppContext.java:365)

> Update to use Kafka 0.10.0.0 (from 0.9.0.0)
> -------------------------------------------
>
>                 Key: ATLAS-912
>                 URL: https://issues.apache.org/jira/browse/ATLAS-912
>             Project: Atlas
>          Issue Type: Task
>            Reporter: Madhan Neethiraj
>            Assignee: Madhan Neethiraj
>         Attachments: ATLAS-912.patch
>
>
> Atlas currently uses Kafka version 0.9.0.0. A newer version of Kafka, 0.10.0.0, is available.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)