You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Neha Narkhede <ne...@gmail.com> on 2011/09/26 01:25:30 UTC

broken unit test

Hi,

I see that one unit test (kafka.javaapi.integration.PrimitiveApiTest)
is broken on trunk. It runs into an OOME [1].
Is anyone else seeing this too ?

Thanks,
Neha

1. [info] == kafka.javaapi.integration.PrimitiveApiTest ==
[info] Test Starting:
testProduceAndFetch(kafka.javaapi.integration.PrimitiveApiTest)
[error] Test Failed:
testProduceAndFetch(kafka.javaapi.integration.PrimitiveApiTest)
java.lang.RuntimeException: OOME with size 1213486160
       at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:84)
       at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63)
       at kafka.network.Receive$class.readCompletely(Transmission.scala:57)
       at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
       at kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:184)
       at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:90)
       at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:88)
       at kafka.javaapi.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:43)
       at kafka.javaapi.integration.PrimitiveApiTest.testProduceAndFetch(PrimitiveApiTest.scala:54)
       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
       at java.lang.reflect.Method.invoke(Method.java:597)
       at junit.framework.TestCase.runTest(TestCase.java:164)
       at junit.framework.TestCase.runBare(TestCase.java:130)
       at junit.framework.TestResult$1.protect(TestResult.java:110)
       at junit.framework.TestResult.runProtected(TestResult.java:128)
       at junit.framework.TestResult.run(TestResult.java:113)
       at junit.framework.TestCase.run(TestCase.java:120)
       at junit.framework.TestSuite.runTest(TestSuite.java:228)
       at junit.framework.TestSuite.run(TestSuite.java:223)
       at junit.framework.TestSuite.runTest(TestSuite.java:228)
       at junit.framework.TestSuite.run(TestSuite.java:223)
       at org.scalatest.junit.JUnit3Suite.run(JUnit3Suite.scala:309)
       at org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:40)
       at sbt.TestRunner.run(TestFramework.scala:53)
       at sbt.TestRunner.runTest$1(TestFramework.scala:67)
       at sbt.TestRunner.run(TestFramework.scala:76)
       at sbt.TestFramework$$anonfun$10$$anonfun$apply$11.runTest$2(TestFramework.scala:194)
       at sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
       at sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
       at sbt.NamedTestTask.run(TestFramework.scala:92)
       at sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
       at sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
       at sbt.TaskManager$Task.invoke(TaskManager.scala:62)
       at sbt.impl.RunTask.doRun$1(RunTask.scala:77)
       at sbt.impl.RunTask.runTask(RunTask.scala:85)

Re: broken unit test

Posted by Jun Rao <ju...@gmail.com>.
I got some transient failures, but not because of OOME.

Jun

On Sun, Sep 25, 2011 at 4:25 PM, Neha Narkhede <ne...@gmail.com>wrote:

> Hi,
>
> I see that one unit test (kafka.javaapi.integration.PrimitiveApiTest)
> is broken on trunk. It runs into an OOME [1].
> Is anyone else seeing this too ?
>
> Thanks,
> Neha
>
> 1. [info] == kafka.javaapi.integration.PrimitiveApiTest ==
> [info] Test Starting:
> testProduceAndFetch(kafka.javaapi.integration.PrimitiveApiTest)
> [error] Test Failed:
> testProduceAndFetch(kafka.javaapi.integration.PrimitiveApiTest)
> java.lang.RuntimeException: OOME with size 1213486160
>        at
> kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:84)
>        at
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63)
>        at kafka.network.Receive$class.readCompletely(Transmission.scala:57)
>        at
> kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
>        at
> kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:184)
>        at
> kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:90)
>        at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:88)
>        at
> kafka.javaapi.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:43)
>        at
> kafka.javaapi.integration.PrimitiveApiTest.testProduceAndFetch(PrimitiveApiTest.scala:54)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at junit.framework.TestCase.runTest(TestCase.java:164)
>        at junit.framework.TestCase.runBare(TestCase.java:130)
>        at junit.framework.TestResult$1.protect(TestResult.java:110)
>        at junit.framework.TestResult.runProtected(TestResult.java:128)
>        at junit.framework.TestResult.run(TestResult.java:113)
>        at junit.framework.TestCase.run(TestCase.java:120)
>        at junit.framework.TestSuite.runTest(TestSuite.java:228)
>        at junit.framework.TestSuite.run(TestSuite.java:223)
>        at junit.framework.TestSuite.runTest(TestSuite.java:228)
>        at junit.framework.TestSuite.run(TestSuite.java:223)
>        at org.scalatest.junit.JUnit3Suite.run(JUnit3Suite.scala:309)
>        at
> org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:40)
>        at sbt.TestRunner.run(TestFramework.scala:53)
>        at sbt.TestRunner.runTest$1(TestFramework.scala:67)
>        at sbt.TestRunner.run(TestFramework.scala:76)
>        at
> sbt.TestFramework$$anonfun$10$$anonfun$apply$11.runTest$2(TestFramework.scala:194)
>        at
> sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
>        at
> sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
>        at sbt.NamedTestTask.run(TestFramework.scala:92)
>        at
> sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
>        at
> sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
>        at sbt.TaskManager$Task.invoke(TaskManager.scala:62)
>        at sbt.impl.RunTask.doRun$1(RunTask.scala:77)
>        at sbt.impl.RunTask.runTask(RunTask.scala:85)
>

Re: broken unit test

Posted by Neha Narkhede <ne...@gmail.com>.
I had a long running sbt process on my laptop, when I saw these OOME
exceptions. They just disappeared the next day, when I restarted the
process.

Seems like this is a known issue in SBT versions <= 0.7.7 -
https://groups.google.com/group/simple-build-tool/browse_thread/thread/884a2f51804a3d91

Upgrade to latest version seems to help. We have an open JIRA for this
- https://issues.apache.org/jira/browse/KAFKA-134

Thanks,
Neha

On Mon, Oct 3, 2011 at 7:12 PM, Chris Burroughs
<ch...@gmail.com> wrote:
> Thanks!  I kept seeing this failure sporadically on the build server,
> but have been unable to reporoduce it locally.  It might be yet another
> timing problem :-(  Ticket created:
> https://issues.apache.org/jira/browse/KAFKA-146
>
> I think this is unrelated to the other unit tests errors reported on the
> thread.
>
> On 10/03/2011 10:04 PM, Bao Thai Ngo wrote:
>> Hi,
>>
>> I get the following errors when running sbt release-zip:
>>
>> [info] Test Starting: testUnreachableServer
>> First message send retries took 10038 ms
>> [error] Test Failed: testUnreachableServer
>> junit.framework.AssertionFailedError: null
>> at junit.framework.Assert.fail(Assert.java:47)
>> at junit.framework.Assert.assertTrue(Assert.java:20)
>>  at junit.framework.Assert.assertTrue(Assert.java:27)
>> at
>> kafka.producer.SyncProducerTest.testUnreachableServer(SyncProducerTest.scala:72)
>>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>  at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>>  at
>> org.junit.internal.runners.TestMethodRunner.executeMethodBody(TestMethodRunner.java:99)
>> at
>> org.junit.internal.runners.TestMethodRunner.runUnprotected(TestMethodRunner.java:81)
>>  at
>> org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
>> at
>> org.junit.internal.runners.TestMethodRunner.runMethod(TestMethodRunner.java:75)
>>  at
>> org.junit.internal.runners.TestMethodRunner.run(TestMethodRunner.java:45)
>> at
>> org.junit.internal.runners.TestClassMethodsRunner.invokeTestMethod(TestClassMethodsRunner.java:71)
>>  at
>> org.junit.internal.runners.TestClassMethodsRunner.run(TestClassMethodsRunner.java:35)
>> at
>> org.junit.internal.runners.TestClassRunner$1.runUnprotected(TestClassRunner.java:42)
>>  at
>> org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
>> at org.junit.internal.runners.TestClassRunner.run(TestClassRunner.java:52)
>>  at org.junit.internal.runners.CompositeRunner.run(CompositeRunner.java:29)
>> at org.junit.runner.JUnitCore.run(JUnitCore.java:121)
>>  at org.junit.runner.JUnitCore.run(JUnitCore.java:100)
>> at org.junit.runner.JUnitCore.run(JUnitCore.java:91)
>>  at org.scalatest.junit.JUnitSuite$class.run(JUnitSuite.scala:261)
>> at kafka.producer.SyncProducerTest.run(SyncProducerTest.scala:31)
>>  at
>> org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:40)
>> at sbt.TestRunner.run(TestFramework.scala:53)
>>  at sbt.TestRunner.runTest$1(TestFramework.scala:67)
>> at sbt.TestRunner.run(TestFramework.scala:76)
>>  at
>> sbt.TestFramework$$anonfun$10$$anonfun$apply$11.runTest$2(TestFramework.scala:194)
>> at
>> sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
>>  at
>> sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
>> at sbt.NamedTestTask.run(TestFramework.scala:92)
>>  at
>> sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
>> at
>> sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
>>  at sbt.TaskManager$Task.invoke(TaskManager.scala:62)
>> at sbt.impl.RunTask.doRun$1(RunTask.scala:77)
>>  at sbt.impl.RunTask.runTask(RunTask.scala:85)
>> at sbt.impl.RunTask.sbt$impl$RunTask$$runIfNotRoot(RunTask.scala:60)
>>  at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
>> at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
>>  at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
>> at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
>>  at sbt.Control$.trapUnit(Control.scala:19)
>> at sbt.Distributor$Run$Worker.run(ParallelRunner.scala:131)
>> [info] Test Starting: testReachableServer
>> [info] Test Passed: testReachableServer
>> [info] Test Starting: testReachableServerWrongPort
>> [info] Test Passed: testReachableServerWrongPort
>>
>> and:
>>
>> [info] == core-kafka / test-finish ==
>> [error] Failed: : Total 129, Failed 2, Errors 0, Passed 127, Skipped 0
>> [info] == core-kafka / test-finish ==
>> [info]
>> [info] == core-kafka / test-cleanup ==
>> [info] == core-kafka / test-cleanup ==
>> [info]
>> [info] == hadoop producer / producer-package-action ==
>> [info] == hadoop producer / producer-package-action ==
>> [info]
>> [info] == perf / perf-package-action ==
>> [info] == perf / perf-package-action ==
>> [info]
>> [info] == java-examples / examples-package-action ==
>> [info] == java-examples / examples-package-action ==
>> [error] Error running kafka.producer.SyncProducerTest: Test FAILED
>> [error] Error running kafka.javaapi.producer.SyncProducerTest: Test FAILED
>> [error] Error running test: One or more subtasks failed
>> [info]
>> [info] Total time: 181 s, completed Oct 3, 2011 6:55:21 PM
>> [info]
>> [info] Total session time: 181 s, completed Oct 3, 2011 6:55:21 PM
>> [error] Error during build.
>>
>> any thought?
>>
>> Thanks,
>> ~Thai
>>
>
>

Re: broken unit test

Posted by Chris Burroughs <ch...@gmail.com>.
Thanks!  I kept seeing this failure sporadically on the build server,
but have been unable to reporoduce it locally.  It might be yet another
timing problem :-(  Ticket created:
https://issues.apache.org/jira/browse/KAFKA-146

I think this is unrelated to the other unit tests errors reported on the
thread.

On 10/03/2011 10:04 PM, Bao Thai Ngo wrote:
> Hi,
> 
> I get the following errors when running sbt release-zip:
> 
> [info] Test Starting: testUnreachableServer
> First message send retries took 10038 ms
> [error] Test Failed: testUnreachableServer
> junit.framework.AssertionFailedError: null
> at junit.framework.Assert.fail(Assert.java:47)
> at junit.framework.Assert.assertTrue(Assert.java:20)
>  at junit.framework.Assert.assertTrue(Assert.java:27)
> at
> kafka.producer.SyncProducerTest.testUnreachableServer(SyncProducerTest.scala:72)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>  at
> org.junit.internal.runners.TestMethodRunner.executeMethodBody(TestMethodRunner.java:99)
> at
> org.junit.internal.runners.TestMethodRunner.runUnprotected(TestMethodRunner.java:81)
>  at
> org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
> at
> org.junit.internal.runners.TestMethodRunner.runMethod(TestMethodRunner.java:75)
>  at
> org.junit.internal.runners.TestMethodRunner.run(TestMethodRunner.java:45)
> at
> org.junit.internal.runners.TestClassMethodsRunner.invokeTestMethod(TestClassMethodsRunner.java:71)
>  at
> org.junit.internal.runners.TestClassMethodsRunner.run(TestClassMethodsRunner.java:35)
> at
> org.junit.internal.runners.TestClassRunner$1.runUnprotected(TestClassRunner.java:42)
>  at
> org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
> at org.junit.internal.runners.TestClassRunner.run(TestClassRunner.java:52)
>  at org.junit.internal.runners.CompositeRunner.run(CompositeRunner.java:29)
> at org.junit.runner.JUnitCore.run(JUnitCore.java:121)
>  at org.junit.runner.JUnitCore.run(JUnitCore.java:100)
> at org.junit.runner.JUnitCore.run(JUnitCore.java:91)
>  at org.scalatest.junit.JUnitSuite$class.run(JUnitSuite.scala:261)
> at kafka.producer.SyncProducerTest.run(SyncProducerTest.scala:31)
>  at
> org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:40)
> at sbt.TestRunner.run(TestFramework.scala:53)
>  at sbt.TestRunner.runTest$1(TestFramework.scala:67)
> at sbt.TestRunner.run(TestFramework.scala:76)
>  at
> sbt.TestFramework$$anonfun$10$$anonfun$apply$11.runTest$2(TestFramework.scala:194)
> at
> sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
>  at
> sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
> at sbt.NamedTestTask.run(TestFramework.scala:92)
>  at
> sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
> at
> sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
>  at sbt.TaskManager$Task.invoke(TaskManager.scala:62)
> at sbt.impl.RunTask.doRun$1(RunTask.scala:77)
>  at sbt.impl.RunTask.runTask(RunTask.scala:85)
> at sbt.impl.RunTask.sbt$impl$RunTask$$runIfNotRoot(RunTask.scala:60)
>  at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
> at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
>  at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
> at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
>  at sbt.Control$.trapUnit(Control.scala:19)
> at sbt.Distributor$Run$Worker.run(ParallelRunner.scala:131)
> [info] Test Starting: testReachableServer
> [info] Test Passed: testReachableServer
> [info] Test Starting: testReachableServerWrongPort
> [info] Test Passed: testReachableServerWrongPort
> 
> and:
> 
> [info] == core-kafka / test-finish ==
> [error] Failed: : Total 129, Failed 2, Errors 0, Passed 127, Skipped 0
> [info] == core-kafka / test-finish ==
> [info]
> [info] == core-kafka / test-cleanup ==
> [info] == core-kafka / test-cleanup ==
> [info]
> [info] == hadoop producer / producer-package-action ==
> [info] == hadoop producer / producer-package-action ==
> [info]
> [info] == perf / perf-package-action ==
> [info] == perf / perf-package-action ==
> [info]
> [info] == java-examples / examples-package-action ==
> [info] == java-examples / examples-package-action ==
> [error] Error running kafka.producer.SyncProducerTest: Test FAILED
> [error] Error running kafka.javaapi.producer.SyncProducerTest: Test FAILED
> [error] Error running test: One or more subtasks failed
> [info]
> [info] Total time: 181 s, completed Oct 3, 2011 6:55:21 PM
> [info]
> [info] Total session time: 181 s, completed Oct 3, 2011 6:55:21 PM
> [error] Error during build.
> 
> any thought?
> 
> Thanks,
> ~Thai
> 


Re: broken unit test

Posted by Bao Thai Ngo <ba...@gmail.com>.
Hi,

I get the following errors when running sbt release-zip:

[info] Test Starting: testUnreachableServer
First message send retries took 10038 ms
[error] Test Failed: testUnreachableServer
junit.framework.AssertionFailedError: null
at junit.framework.Assert.fail(Assert.java:47)
at junit.framework.Assert.assertTrue(Assert.java:20)
 at junit.framework.Assert.assertTrue(Assert.java:27)
at
kafka.producer.SyncProducerTest.testUnreachableServer(SyncProducerTest.scala:72)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
 at
org.junit.internal.runners.TestMethodRunner.executeMethodBody(TestMethodRunner.java:99)
at
org.junit.internal.runners.TestMethodRunner.runUnprotected(TestMethodRunner.java:81)
 at
org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
at
org.junit.internal.runners.TestMethodRunner.runMethod(TestMethodRunner.java:75)
 at
org.junit.internal.runners.TestMethodRunner.run(TestMethodRunner.java:45)
at
org.junit.internal.runners.TestClassMethodsRunner.invokeTestMethod(TestClassMethodsRunner.java:71)
 at
org.junit.internal.runners.TestClassMethodsRunner.run(TestClassMethodsRunner.java:35)
at
org.junit.internal.runners.TestClassRunner$1.runUnprotected(TestClassRunner.java:42)
 at
org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
at org.junit.internal.runners.TestClassRunner.run(TestClassRunner.java:52)
 at org.junit.internal.runners.CompositeRunner.run(CompositeRunner.java:29)
at org.junit.runner.JUnitCore.run(JUnitCore.java:121)
 at org.junit.runner.JUnitCore.run(JUnitCore.java:100)
at org.junit.runner.JUnitCore.run(JUnitCore.java:91)
 at org.scalatest.junit.JUnitSuite$class.run(JUnitSuite.scala:261)
at kafka.producer.SyncProducerTest.run(SyncProducerTest.scala:31)
 at
org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:40)
at sbt.TestRunner.run(TestFramework.scala:53)
 at sbt.TestRunner.runTest$1(TestFramework.scala:67)
at sbt.TestRunner.run(TestFramework.scala:76)
 at
sbt.TestFramework$$anonfun$10$$anonfun$apply$11.runTest$2(TestFramework.scala:194)
at
sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
 at
sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
at sbt.NamedTestTask.run(TestFramework.scala:92)
 at
sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
at
sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
 at sbt.TaskManager$Task.invoke(TaskManager.scala:62)
at sbt.impl.RunTask.doRun$1(RunTask.scala:77)
 at sbt.impl.RunTask.runTask(RunTask.scala:85)
at sbt.impl.RunTask.sbt$impl$RunTask$$runIfNotRoot(RunTask.scala:60)
 at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
 at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
 at sbt.Control$.trapUnit(Control.scala:19)
at sbt.Distributor$Run$Worker.run(ParallelRunner.scala:131)
[info] Test Starting: testReachableServer
[info] Test Passed: testReachableServer
[info] Test Starting: testReachableServerWrongPort
[info] Test Passed: testReachableServerWrongPort

and:

[info] == core-kafka / test-finish ==
[error] Failed: : Total 129, Failed 2, Errors 0, Passed 127, Skipped 0
[info] == core-kafka / test-finish ==
[info]
[info] == core-kafka / test-cleanup ==
[info] == core-kafka / test-cleanup ==
[info]
[info] == hadoop producer / producer-package-action ==
[info] == hadoop producer / producer-package-action ==
[info]
[info] == perf / perf-package-action ==
[info] == perf / perf-package-action ==
[info]
[info] == java-examples / examples-package-action ==
[info] == java-examples / examples-package-action ==
[error] Error running kafka.producer.SyncProducerTest: Test FAILED
[error] Error running kafka.javaapi.producer.SyncProducerTest: Test FAILED
[error] Error running test: One or more subtasks failed
[info]
[info] Total time: 181 s, completed Oct 3, 2011 6:55:21 PM
[info]
[info] Total session time: 181 s, completed Oct 3, 2011 6:55:21 PM
[error] Error during build.

any thought?

Thanks,
~Thai

Re: broken unit test

Posted by Chris Burroughs <ch...@gmail.com>.
I have not seen that failure, but I get LogManagerTest failures often
locally.  There is a nearby TODO about sleeps and time for metadata updates.

info] == core-kafka / kafka.log.LogManagerTest ==
[info] Test Starting: testCreateLog
[info] Test Passed: testCreateLog
[info] Test Starting: testCleanupExpiredSegments
[error] Test Failed: testCleanupExpiredSegments
junit.framework.AssertionFailedError: Now there should only be only one
segment. expected:<1> but was:<13>
	at junit.framework.Assert.fail(Assert.java:47)
	at junit.framework.Assert.failNotEquals(Assert.java:277)
	at junit.framework.Assert.assertEquals(Assert.java:64)
	at junit.framework.Assert.assertEquals(Assert.java:195)
	at
kafka.log.LogManagerTest.testCleanupExpiredSegments(LogManagerTest.scala:77)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at
org.junit.internal.runners.TestMethodRunner.executeMethodBody(TestMethodRunner.java:99)
	at
org.junit.internal.runners.TestMethodRunner.runUnprotected(TestMethodRunner.java:81)
	at
org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
	at
org.junit.internal.runners.TestMethodRunner.runMethod(TestMethodRunner.java:75)
	at
org.junit.internal.runners.TestMethodRunner.run(TestMethodRunner.java:45)
	at
org.junit.internal.runners.TestClassMethodsRunner.invokeTestMethod(TestClassMethodsRunner.java:71)
	at
org.junit.internal.runners.TestClassMethodsRunner.run(TestClassMethodsRunner.java:35)
	at
org.junit.internal.runners.TestClassRunner$1.runUnprotected(TestClassRunner.java:42)
	at
org.junit.internal.runners.BeforeAndAfterRunner.runProtected(BeforeAndAfterRunner.java:34)
	at org.junit.internal.runners.TestClassRunner.run(TestClassRunner.java:52)
	at org.junit.internal.runners.CompositeRunner.run(CompositeRunner.java:29)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:121)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:100)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:91)
	at org.scalatest.junit.JUnitSuite$class.run(JUnitSuite.scala:261)
	at kafka.log.LogManagerTest.run(LogManagerTest.scala:28)
	at
org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:40)
	at sbt.TestRunner.run(TestFramework.scala:53)
	at sbt.TestRunner.runTest$1(TestFramework.scala:67)
	at sbt.TestRunner.run(TestFramework.scala:76)
	at
sbt.TestFramework$$anonfun$10$$anonfun$apply$11.runTest$2(TestFramework.scala:194)
	at
sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
	at
sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
	at sbt.NamedTestTask.run(TestFramework.scala:92)
	at
sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
	at
sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
	at sbt.TaskManager$Task.invoke(TaskManager.scala:62)
	at sbt.impl.RunTask.doRun$1(RunTask.scala:77)
	at sbt.impl.RunTask.runTask(RunTask.scala:85)
	at sbt.impl.RunTask.sbt$impl$RunTask$$runIfNotRoot(RunTask.scala:60)
	at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
	at sbt.impl.RunTask$$anonfun$runTasksExceptRoot$2.apply(RunTask.scala:48)
	at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
	at sbt.Distributor$Run$Worker$$anonfun$2.apply(ParallelRunner.scala:131)
	at sbt.Control$.trapUnit(Control.scala:19)
	at sbt.Distributor$Run$Worker.run(ParallelRunner.scala:131)


On 09/25/2011 07:25 PM, Neha Narkhede wrote:
> Hi,
> 
> I see that one unit test (kafka.javaapi.integration.PrimitiveApiTest)
> is broken on trunk. It runs into an OOME [1].
> Is anyone else seeing this too ?
> 
> Thanks,
> Neha
> 
> 1. [info] == kafka.javaapi.integration.PrimitiveApiTest ==
> [info] Test Starting:
> testProduceAndFetch(kafka.javaapi.integration.PrimitiveApiTest)
> [error] Test Failed:
> testProduceAndFetch(kafka.javaapi.integration.PrimitiveApiTest)
> java.lang.RuntimeException: OOME with size 1213486160
>        at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:84)
>        at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63)
>        at kafka.network.Receive$class.readCompletely(Transmission.scala:57)
>        at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
>        at kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:184)
>        at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:90)
>        at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:88)
>        at kafka.javaapi.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:43)
>        at kafka.javaapi.integration.PrimitiveApiTest.testProduceAndFetch(PrimitiveApiTest.scala:54)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at junit.framework.TestCase.runTest(TestCase.java:164)
>        at junit.framework.TestCase.runBare(TestCase.java:130)
>        at junit.framework.TestResult$1.protect(TestResult.java:110)
>        at junit.framework.TestResult.runProtected(TestResult.java:128)
>        at junit.framework.TestResult.run(TestResult.java:113)
>        at junit.framework.TestCase.run(TestCase.java:120)
>        at junit.framework.TestSuite.runTest(TestSuite.java:228)
>        at junit.framework.TestSuite.run(TestSuite.java:223)
>        at junit.framework.TestSuite.runTest(TestSuite.java:228)
>        at junit.framework.TestSuite.run(TestSuite.java:223)
>        at org.scalatest.junit.JUnit3Suite.run(JUnit3Suite.scala:309)
>        at org.scalatest.tools.ScalaTestFramework$ScalaTestRunner.run(ScalaTestFramework.scala:40)
>        at sbt.TestRunner.run(TestFramework.scala:53)
>        at sbt.TestRunner.runTest$1(TestFramework.scala:67)
>        at sbt.TestRunner.run(TestFramework.scala:76)
>        at sbt.TestFramework$$anonfun$10$$anonfun$apply$11.runTest$2(TestFramework.scala:194)
>        at sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
>        at sbt.TestFramework$$anonfun$10$$anonfun$apply$11$$anonfun$apply$12.apply(TestFramework.scala:205)
>        at sbt.NamedTestTask.run(TestFramework.scala:92)
>        at sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
>        at sbt.ScalaProject$$anonfun$sbt$ScalaProject$$toTask$1.apply(ScalaProject.scala:193)
>        at sbt.TaskManager$Task.invoke(TaskManager.scala:62)
>        at sbt.impl.RunTask.doRun$1(RunTask.scala:77)
>        at sbt.impl.RunTask.runTask(RunTask.scala:85)