You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Gwen Shapira <gs...@cloudera.com> on 2015/02/25 21:47:26 UTC
Unit tests in java7 vs java8
Hi,
Anyone running tests on Java 8? I just noticed that they take almost twice
as long to run compared to Java 7 (at least on my box, and with Scala
2.10.4).
Anyone else noticed this? Maybe even did some digging on the causes?
Gwen
Re: Unit tests in java7 vs java8
Posted by Gwen Shapira <gs...@cloudera.com>.
I guess its just my machine then.
Thanks!
On Mon, Mar 2, 2015 at 2:47 PM, Guozhang Wang <wa...@gmail.com> wrote:
> Here are some number I got (this is with KAFKA-1910 patch and ConsumerTest
> modified a bit):
>
> ---- JDK 8 ----
>
> Total time: 18 mins 3.649 secs
>
> real 18m4.091s
> user 0m7.105s
> sys 0m0.426s
>
> ---- JDK 7 ----
>
> Total time: 18 mins 55.546 secs
>
> real 18m55.997s
> user 0m4.157s
> sys 0m0.341s
>
> --------------------
>
> Guozhang
>
>
>
> On Wed, Feb 25, 2015 at 5:06 PM, Guozhang Wang <gu...@linkedin.com.invalid>
> wrote:
>
>> I am working on the test handing / NPE / failure issues of ConsumerTest
>> only.
>>
>> I currently run Java 8 and the unit test takes about 10 minutes, I can do
>> "time ./gradlew test" with both versions and see if there is a clear
>> difference.
>>
>> Guozhang
>> ________________________________
>> From: Jay Kreps [jay.kreps@gmail.com]
>> Sent: Wednesday, February 25, 2015 4:53 PM
>> To: dev@kafka.apache.org; Guozhang Wang
>> Subject: Re: Unit tests in java7 vs java8
>>
>> Yeah, hey Guozhang, is that fix part of the larger consumer patch you just
>> posted or is that a separate issue?
>>
>> -Jay
>>
>> On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira <gshapira@cloudera.com
>> <ma...@cloudera.com>> wrote:
>> The Consumer tests are currently hanging :(
>>
>> I think Guozhang is working on a solution. I'm commenting them out until
>> the problem is resolved...
>>
>>
>>
>> On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <litong01@us.ibm.com<mailto:
>> litong01@us.ibm.com>> wrote:
>>
>> > Gwen,
>> > I have not tried Java 8. Still on Java 7, but I always run into the
>> > test hung problems (no errors on the screen and the system is completely
>> > idle), it may be a different problem. I can recreate that problem every
>> > time when I run "gradle --daemon testAll", I recall that couple of weeks
>> > ago there was one patch saying fixed the problem, but I am still seeing
>> the
>> > problem with latest code. What I noticed is that seems tests always stop
>> at
>> > one of the ConsumerTest test cases. What puzzled me the most is that it
>> was
>> > not always a particular test case. Being very new in this community, I
>> > think that error must be something related to my env. Here is my
>> > environment:
>> >
>> > Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
>> > big enough max lock memory,
>> >
>> > not complaining, just some observations in case you wonder what other
>> > developers may face.
>> >
>> > Thanks.
>> >
>> > Tong Li
>> > OpenStack & Kafka Community Development
>> > Building 501/B205
>> > litong01@us.ibm.com<ma...@us.ibm.com>
>> >
>> > [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
>> > PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
>> > Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java 8? I
>> > just noticed that they take almost twice
>> >
>> > From: Gwen Shapira <gs...@cloudera.com>>
>> > To: "dev@kafka.apache.org<ma...@kafka.apache.org>" <
>> dev@kafka.apache.org<ma...@kafka.apache.org>>
>> > Date: 02/25/2015 03:47 PM
>> > Subject: Unit tests in java7 vs java8
>> > ------------------------------
>> >
>> >
>> >
>> > Hi,
>> >
>> > Anyone running tests on Java 8? I just noticed that they take almost
>> twice
>> > as long to run compared to Java 7 (at least on my box, and with Scala
>> > 2.10.4).
>> >
>> > Anyone else noticed this? Maybe even did some digging on the causes?
>> >
>> > Gwen
>> >
>> >
>>
>>
>
>
> --
> -- Guozhang
Error when submit a patch set which contains a file rename.
Posted by Tong Li <li...@us.ibm.com>.
Hi, I was trying to submit a patch set for review. In this patch set, I
removed one file and created another to replace the removed. However, when
I run kafka-patch-review.py I got an error.
python kafka-patch-review.py -b origin/trunk -j KAFKA-1926
Configuring reviewboard url to https://reviews.apache.org
Updating your remote branches to pull the latest changes
Verifying JIRA connection configurations
ERROR: Error validating diff
core/src/main/scala/kafka/utils/Utils.scala: The file was not found in the
repository. (HTTP 400, API Error 207)
ERROR: reviewboard update failed. Exiting.
I wonder if it is because I do not have enough of permission? the file to
be renamed is clearly there. Any help will be appreciated.
Thanks.
Tong Li
OpenStack & Kafka Community Development
Building 501/B205
litong01@us.ibm.com
Re: Unit tests in java7 vs java8
Posted by Gwen Shapira <gs...@cloudera.com>.
Total time: 14 mins 57.037 secs
And I'm running with SSD.
On Mon, Mar 2, 2015 at 4:34 PM, Jay Kreps <ja...@gmail.com> wrote:
> Wow, 18 mins?
>
> I was seeing 8 mins a couple weeks ago and 12 mins now. Anyone know what's
> up? Not sure if the 12<=>18 is just because I have SSDs or what. It is
> really easy to make a small change that adds a few hundred ms of startup or
> shutdown time and that have that multiply by 500 server start and stops in
> the test execution.
>
> -Jay
>
> On Mon, Mar 2, 2015 at 2:47 PM, Guozhang Wang <wa...@gmail.com> wrote:
>
>> Here are some number I got (this is with KAFKA-1910 patch and ConsumerTest
>> modified a bit):
>>
>> ---- JDK 8 ----
>>
>> Total time: 18 mins 3.649 secs
>>
>> real 18m4.091s
>> user 0m7.105s
>> sys 0m0.426s
>>
>> ---- JDK 7 ----
>>
>> Total time: 18 mins 55.546 secs
>>
>> real 18m55.997s
>> user 0m4.157s
>> sys 0m0.341s
>>
>> --------------------
>>
>> Guozhang
>>
>>
>>
>> On Wed, Feb 25, 2015 at 5:06 PM, Guozhang Wang <guwang@linkedin.com.invalid
>> >
>> wrote:
>>
>> > I am working on the test handing / NPE / failure issues of ConsumerTest
>> > only.
>> >
>> > I currently run Java 8 and the unit test takes about 10 minutes, I can do
>> > "time ./gradlew test" with both versions and see if there is a clear
>> > difference.
>> >
>> > Guozhang
>> > ________________________________
>> > From: Jay Kreps [jay.kreps@gmail.com]
>> > Sent: Wednesday, February 25, 2015 4:53 PM
>> > To: dev@kafka.apache.org; Guozhang Wang
>> > Subject: Re: Unit tests in java7 vs java8
>> >
>> > Yeah, hey Guozhang, is that fix part of the larger consumer patch you
>> just
>> > posted or is that a separate issue?
>> >
>> > -Jay
>> >
>> > On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira <gshapira@cloudera.com
>> > <ma...@cloudera.com>> wrote:
>> > The Consumer tests are currently hanging :(
>> >
>> > I think Guozhang is working on a solution. I'm commenting them out until
>> > the problem is resolved...
>> >
>> >
>> >
>> > On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <litong01@us.ibm.com<mailto:
>> > litong01@us.ibm.com>> wrote:
>> >
>> > > Gwen,
>> > > I have not tried Java 8. Still on Java 7, but I always run into the
>> > > test hung problems (no errors on the screen and the system is
>> completely
>> > > idle), it may be a different problem. I can recreate that problem every
>> > > time when I run "gradle --daemon testAll", I recall that couple of
>> weeks
>> > > ago there was one patch saying fixed the problem, but I am still seeing
>> > the
>> > > problem with latest code. What I noticed is that seems tests always
>> stop
>> > at
>> > > one of the ConsumerTest test cases. What puzzled me the most is that it
>> > was
>> > > not always a particular test case. Being very new in this community, I
>> > > think that error must be something related to my env. Here is my
>> > > environment:
>> > >
>> > > Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
>> > > big enough max lock memory,
>> > >
>> > > not complaining, just some observations in case you wonder what other
>> > > developers may face.
>> > >
>> > > Thanks.
>> > >
>> > > Tong Li
>> > > OpenStack & Kafka Community Development
>> > > Building 501/B205
>> > > litong01@us.ibm.com<ma...@us.ibm.com>
>> > >
>> > > [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
>> > > PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
>> > > Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java
>> 8? I
>> > > just noticed that they take almost twice
>> > >
>> > > From: Gwen Shapira <gshapira@cloudera.com<mailto:gshapira@cloudera.com
>> >>
>> > > To: "dev@kafka.apache.org<ma...@kafka.apache.org>" <
>> > dev@kafka.apache.org<ma...@kafka.apache.org>>
>> > > Date: 02/25/2015 03:47 PM
>> > > Subject: Unit tests in java7 vs java8
>> > > ------------------------------
>> > >
>> > >
>> > >
>> > > Hi,
>> > >
>> > > Anyone running tests on Java 8? I just noticed that they take almost
>> > twice
>> > > as long to run compared to Java 7 (at least on my box, and with Scala
>> > > 2.10.4).
>> > >
>> > > Anyone else noticed this? Maybe even did some digging on the causes?
>> > >
>> > > Gwen
>> > >
>> > >
>> >
>> >
>>
>>
>> --
>> -- Guozhang
>>
Re: Unit tests in java7 vs java8
Posted by Jay Kreps <ja...@gmail.com>.
Wow, 18 mins?
I was seeing 8 mins a couple weeks ago and 12 mins now. Anyone know what's
up? Not sure if the 12<=>18 is just because I have SSDs or what. It is
really easy to make a small change that adds a few hundred ms of startup or
shutdown time and that have that multiply by 500 server start and stops in
the test execution.
-Jay
On Mon, Mar 2, 2015 at 2:47 PM, Guozhang Wang <wa...@gmail.com> wrote:
> Here are some number I got (this is with KAFKA-1910 patch and ConsumerTest
> modified a bit):
>
> ---- JDK 8 ----
>
> Total time: 18 mins 3.649 secs
>
> real 18m4.091s
> user 0m7.105s
> sys 0m0.426s
>
> ---- JDK 7 ----
>
> Total time: 18 mins 55.546 secs
>
> real 18m55.997s
> user 0m4.157s
> sys 0m0.341s
>
> --------------------
>
> Guozhang
>
>
>
> On Wed, Feb 25, 2015 at 5:06 PM, Guozhang Wang <guwang@linkedin.com.invalid
> >
> wrote:
>
> > I am working on the test handing / NPE / failure issues of ConsumerTest
> > only.
> >
> > I currently run Java 8 and the unit test takes about 10 minutes, I can do
> > "time ./gradlew test" with both versions and see if there is a clear
> > difference.
> >
> > Guozhang
> > ________________________________
> > From: Jay Kreps [jay.kreps@gmail.com]
> > Sent: Wednesday, February 25, 2015 4:53 PM
> > To: dev@kafka.apache.org; Guozhang Wang
> > Subject: Re: Unit tests in java7 vs java8
> >
> > Yeah, hey Guozhang, is that fix part of the larger consumer patch you
> just
> > posted or is that a separate issue?
> >
> > -Jay
> >
> > On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira <gshapira@cloudera.com
> > <ma...@cloudera.com>> wrote:
> > The Consumer tests are currently hanging :(
> >
> > I think Guozhang is working on a solution. I'm commenting them out until
> > the problem is resolved...
> >
> >
> >
> > On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <litong01@us.ibm.com<mailto:
> > litong01@us.ibm.com>> wrote:
> >
> > > Gwen,
> > > I have not tried Java 8. Still on Java 7, but I always run into the
> > > test hung problems (no errors on the screen and the system is
> completely
> > > idle), it may be a different problem. I can recreate that problem every
> > > time when I run "gradle --daemon testAll", I recall that couple of
> weeks
> > > ago there was one patch saying fixed the problem, but I am still seeing
> > the
> > > problem with latest code. What I noticed is that seems tests always
> stop
> > at
> > > one of the ConsumerTest test cases. What puzzled me the most is that it
> > was
> > > not always a particular test case. Being very new in this community, I
> > > think that error must be something related to my env. Here is my
> > > environment:
> > >
> > > Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
> > > big enough max lock memory,
> > >
> > > not complaining, just some observations in case you wonder what other
> > > developers may face.
> > >
> > > Thanks.
> > >
> > > Tong Li
> > > OpenStack & Kafka Community Development
> > > Building 501/B205
> > > litong01@us.ibm.com<ma...@us.ibm.com>
> > >
> > > [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
> > > PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
> > > Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java
> 8? I
> > > just noticed that they take almost twice
> > >
> > > From: Gwen Shapira <gshapira@cloudera.com<mailto:gshapira@cloudera.com
> >>
> > > To: "dev@kafka.apache.org<ma...@kafka.apache.org>" <
> > dev@kafka.apache.org<ma...@kafka.apache.org>>
> > > Date: 02/25/2015 03:47 PM
> > > Subject: Unit tests in java7 vs java8
> > > ------------------------------
> > >
> > >
> > >
> > > Hi,
> > >
> > > Anyone running tests on Java 8? I just noticed that they take almost
> > twice
> > > as long to run compared to Java 7 (at least on my box, and with Scala
> > > 2.10.4).
> > >
> > > Anyone else noticed this? Maybe even did some digging on the causes?
> > >
> > > Gwen
> > >
> > >
> >
> >
>
>
> --
> -- Guozhang
>
Re: Unit tests in java7 vs java8
Posted by Guozhang Wang <wa...@gmail.com>.
Here are some number I got (this is with KAFKA-1910 patch and ConsumerTest
modified a bit):
---- JDK 8 ----
Total time: 18 mins 3.649 secs
real 18m4.091s
user 0m7.105s
sys 0m0.426s
---- JDK 7 ----
Total time: 18 mins 55.546 secs
real 18m55.997s
user 0m4.157s
sys 0m0.341s
--------------------
Guozhang
On Wed, Feb 25, 2015 at 5:06 PM, Guozhang Wang <gu...@linkedin.com.invalid>
wrote:
> I am working on the test handing / NPE / failure issues of ConsumerTest
> only.
>
> I currently run Java 8 and the unit test takes about 10 minutes, I can do
> "time ./gradlew test" with both versions and see if there is a clear
> difference.
>
> Guozhang
> ________________________________
> From: Jay Kreps [jay.kreps@gmail.com]
> Sent: Wednesday, February 25, 2015 4:53 PM
> To: dev@kafka.apache.org; Guozhang Wang
> Subject: Re: Unit tests in java7 vs java8
>
> Yeah, hey Guozhang, is that fix part of the larger consumer patch you just
> posted or is that a separate issue?
>
> -Jay
>
> On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira <gshapira@cloudera.com
> <ma...@cloudera.com>> wrote:
> The Consumer tests are currently hanging :(
>
> I think Guozhang is working on a solution. I'm commenting them out until
> the problem is resolved...
>
>
>
> On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <litong01@us.ibm.com<mailto:
> litong01@us.ibm.com>> wrote:
>
> > Gwen,
> > I have not tried Java 8. Still on Java 7, but I always run into the
> > test hung problems (no errors on the screen and the system is completely
> > idle), it may be a different problem. I can recreate that problem every
> > time when I run "gradle --daemon testAll", I recall that couple of weeks
> > ago there was one patch saying fixed the problem, but I am still seeing
> the
> > problem with latest code. What I noticed is that seems tests always stop
> at
> > one of the ConsumerTest test cases. What puzzled me the most is that it
> was
> > not always a particular test case. Being very new in this community, I
> > think that error must be something related to my env. Here is my
> > environment:
> >
> > Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
> > big enough max lock memory,
> >
> > not complaining, just some observations in case you wonder what other
> > developers may face.
> >
> > Thanks.
> >
> > Tong Li
> > OpenStack & Kafka Community Development
> > Building 501/B205
> > litong01@us.ibm.com<ma...@us.ibm.com>
> >
> > [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
> > PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
> > Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java 8? I
> > just noticed that they take almost twice
> >
> > From: Gwen Shapira <gs...@cloudera.com>>
> > To: "dev@kafka.apache.org<ma...@kafka.apache.org>" <
> dev@kafka.apache.org<ma...@kafka.apache.org>>
> > Date: 02/25/2015 03:47 PM
> > Subject: Unit tests in java7 vs java8
> > ------------------------------
> >
> >
> >
> > Hi,
> >
> > Anyone running tests on Java 8? I just noticed that they take almost
> twice
> > as long to run compared to Java 7 (at least on my box, and with Scala
> > 2.10.4).
> >
> > Anyone else noticed this? Maybe even did some digging on the causes?
> >
> > Gwen
> >
> >
>
>
--
-- Guozhang
RE: Unit tests in java7 vs java8
Posted by Guozhang Wang <gu...@linkedin.com.INVALID>.
I am working on the test handing / NPE / failure issues of ConsumerTest only.
I currently run Java 8 and the unit test takes about 10 minutes, I can do "time ./gradlew test" with both versions and see if there is a clear difference.
Guozhang
________________________________
From: Jay Kreps [jay.kreps@gmail.com]
Sent: Wednesday, February 25, 2015 4:53 PM
To: dev@kafka.apache.org; Guozhang Wang
Subject: Re: Unit tests in java7 vs java8
Yeah, hey Guozhang, is that fix part of the larger consumer patch you just posted or is that a separate issue?
-Jay
On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira <gs...@cloudera.com>> wrote:
The Consumer tests are currently hanging :(
I think Guozhang is working on a solution. I'm commenting them out until
the problem is resolved...
On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <li...@us.ibm.com>> wrote:
> Gwen,
> I have not tried Java 8. Still on Java 7, but I always run into the
> test hung problems (no errors on the screen and the system is completely
> idle), it may be a different problem. I can recreate that problem every
> time when I run "gradle --daemon testAll", I recall that couple of weeks
> ago there was one patch saying fixed the problem, but I am still seeing the
> problem with latest code. What I noticed is that seems tests always stop at
> one of the ConsumerTest test cases. What puzzled me the most is that it was
> not always a particular test case. Being very new in this community, I
> think that error must be something related to my env. Here is my
> environment:
>
> Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
> big enough max lock memory,
>
> not complaining, just some observations in case you wonder what other
> developers may face.
>
> Thanks.
>
> Tong Li
> OpenStack & Kafka Community Development
> Building 501/B205
> litong01@us.ibm.com<ma...@us.ibm.com>
>
> [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
> PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
> Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java 8? I
> just noticed that they take almost twice
>
> From: Gwen Shapira <gs...@cloudera.com>>
> To: "dev@kafka.apache.org<ma...@kafka.apache.org>" <de...@kafka.apache.org>>
> Date: 02/25/2015 03:47 PM
> Subject: Unit tests in java7 vs java8
> ------------------------------
>
>
>
> Hi,
>
> Anyone running tests on Java 8? I just noticed that they take almost twice
> as long to run compared to Java 7 (at least on my box, and with Scala
> 2.10.4).
>
> Anyone else noticed this? Maybe even did some digging on the causes?
>
> Gwen
>
>
Re: Unit tests in java7 vs java8
Posted by Guozhang Wang <wa...@gmail.com>.
I am working on the test handing / NPE / failure issues of ConsumerTest
only as part of the consumer rewriting (KAFKA-1910).
I currently run Java 8 and the unit test takes about 10 minutes, I can do
"time ./gradlew test" with both versions and see if there is a clear
difference.
Guozhang
On Wed, Feb 25, 2015 at 4:53 PM, Jay Kreps <ja...@gmail.com> wrote:
> Yeah, hey Guozhang, is that fix part of the larger consumer patch you just
> posted or is that a separate issue?
>
> -Jay
>
> On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira <gs...@cloudera.com>
> wrote:
>
> > The Consumer tests are currently hanging :(
> >
> > I think Guozhang is working on a solution. I'm commenting them out until
> > the problem is resolved...
> >
> >
> >
> > On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <li...@us.ibm.com> wrote:
> >
> > > Gwen,
> > > I have not tried Java 8. Still on Java 7, but I always run into the
> > > test hung problems (no errors on the screen and the system is
> completely
> > > idle), it may be a different problem. I can recreate that problem every
> > > time when I run "gradle --daemon testAll", I recall that couple of
> weeks
> > > ago there was one patch saying fixed the problem, but I am still seeing
> > the
> > > problem with latest code. What I noticed is that seems tests always
> stop
> > at
> > > one of the ConsumerTest test cases. What puzzled me the most is that it
> > was
> > > not always a particular test case. Being very new in this community, I
> > > think that error must be something related to my env. Here is my
> > > environment:
> > >
> > > Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
> > > big enough max lock memory,
> > >
> > > not complaining, just some observations in case you wonder what other
> > > developers may face.
> > >
> > > Thanks.
> > >
> > > Tong Li
> > > OpenStack & Kafka Community Development
> > > Building 501/B205
> > > litong01@us.ibm.com
> > >
> > > [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
> > > PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
> > > Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java
> 8? I
> > > just noticed that they take almost twice
> > >
> > > From: Gwen Shapira <gs...@cloudera.com>
> > > To: "dev@kafka.apache.org" <de...@kafka.apache.org>
> > > Date: 02/25/2015 03:47 PM
> > > Subject: Unit tests in java7 vs java8
> > > ------------------------------
> > >
> > >
> > >
> > > Hi,
> > >
> > > Anyone running tests on Java 8? I just noticed that they take almost
> > twice
> > > as long to run compared to Java 7 (at least on my box, and with Scala
> > > 2.10.4).
> > >
> > > Anyone else noticed this? Maybe even did some digging on the causes?
> > >
> > > Gwen
> > >
> > >
> >
>
--
-- Guozhang
Re: Unit tests in java7 vs java8
Posted by Jay Kreps <ja...@gmail.com>.
Yeah, hey Guozhang, is that fix part of the larger consumer patch you just
posted or is that a separate issue?
-Jay
On Wed, Feb 25, 2015 at 4:25 PM, Gwen Shapira <gs...@cloudera.com> wrote:
> The Consumer tests are currently hanging :(
>
> I think Guozhang is working on a solution. I'm commenting them out until
> the problem is resolved...
>
>
>
> On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <li...@us.ibm.com> wrote:
>
> > Gwen,
> > I have not tried Java 8. Still on Java 7, but I always run into the
> > test hung problems (no errors on the screen and the system is completely
> > idle), it may be a different problem. I can recreate that problem every
> > time when I run "gradle --daemon testAll", I recall that couple of weeks
> > ago there was one patch saying fixed the problem, but I am still seeing
> the
> > problem with latest code. What I noticed is that seems tests always stop
> at
> > one of the ConsumerTest test cases. What puzzled me the most is that it
> was
> > not always a particular test case. Being very new in this community, I
> > think that error must be something related to my env. Here is my
> > environment:
> >
> > Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
> > big enough max lock memory,
> >
> > not complaining, just some observations in case you wonder what other
> > developers may face.
> >
> > Thanks.
> >
> > Tong Li
> > OpenStack & Kafka Community Development
> > Building 501/B205
> > litong01@us.ibm.com
> >
> > [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
> > PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
> > Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java 8? I
> > just noticed that they take almost twice
> >
> > From: Gwen Shapira <gs...@cloudera.com>
> > To: "dev@kafka.apache.org" <de...@kafka.apache.org>
> > Date: 02/25/2015 03:47 PM
> > Subject: Unit tests in java7 vs java8
> > ------------------------------
> >
> >
> >
> > Hi,
> >
> > Anyone running tests on Java 8? I just noticed that they take almost
> twice
> > as long to run compared to Java 7 (at least on my box, and with Scala
> > 2.10.4).
> >
> > Anyone else noticed this? Maybe even did some digging on the causes?
> >
> > Gwen
> >
> >
>
Re: Unit tests in java7 vs java8
Posted by Gwen Shapira <gs...@cloudera.com>.
The Consumer tests are currently hanging :(
I think Guozhang is working on a solution. I'm commenting them out until
the problem is resolved...
On Wed, Feb 25, 2015 at 4:00 PM, Tong Li <li...@us.ibm.com> wrote:
> Gwen,
> I have not tried Java 8. Still on Java 7, but I always run into the
> test hung problems (no errors on the screen and the system is completely
> idle), it may be a different problem. I can recreate that problem every
> time when I run "gradle --daemon testAll", I recall that couple of weeks
> ago there was one patch saying fixed the problem, but I am still seeing the
> problem with latest code. What I noticed is that seems tests always stop at
> one of the ConsumerTest test cases. What puzzled me the most is that it was
> not always a particular test case. Being very new in this community, I
> think that error must be something related to my env. Here is my
> environment:
>
> Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles and
> big enough max lock memory,
>
> not complaining, just some observations in case you wonder what other
> developers may face.
>
> Thanks.
>
> Tong Li
> OpenStack & Kafka Community Development
> Building 501/B205
> litong01@us.ibm.com
>
> [image: Inactive hide details for Gwen Shapira ---02/25/2015 03:47:58
> PM---Hi, Anyone running tests on Java 8? I just noticed that they]Gwen
> Shapira ---02/25/2015 03:47:58 PM---Hi, Anyone running tests on Java 8? I
> just noticed that they take almost twice
>
> From: Gwen Shapira <gs...@cloudera.com>
> To: "dev@kafka.apache.org" <de...@kafka.apache.org>
> Date: 02/25/2015 03:47 PM
> Subject: Unit tests in java7 vs java8
> ------------------------------
>
>
>
> Hi,
>
> Anyone running tests on Java 8? I just noticed that they take almost twice
> as long to run compared to Java 7 (at least on my box, and with Scala
> 2.10.4).
>
> Anyone else noticed this? Maybe even did some digging on the causes?
>
> Gwen
>
>
Re: Unit tests in java7 vs java8
Posted by Tong Li <li...@us.ibm.com>.
Gwen,
I have not tried Java 8. Still on Java 7, but I always run into the
test hung problems (no errors on the screen and the system is completely
idle), it may be a different problem. I can recreate that problem every
time when I run "gradle --daemon testAll", I recall that couple of weeks
ago there was one patch saying fixed the problem, but I am still seeing the
problem with latest code. What I noticed is that seems tests always stop at
one of the ConsumerTest test cases. What puzzled me the most is that it was
not always a particular test case. Being very new in this community, I
think that error must be something related to my env. Here is my
environment:
Oracle JDK 7, gradle 2.2.1, scala 2.10.4. Lot of open file handles
and big enough max lock memory,
not complaining, just some observations in case you wonder what other
developers may face.
Thanks.
Tong Li
OpenStack & Kafka Community Development
Building 501/B205
litong01@us.ibm.com
From: Gwen Shapira <gs...@cloudera.com>
To: "dev@kafka.apache.org" <de...@kafka.apache.org>
Date: 02/25/2015 03:47 PM
Subject: Unit tests in java7 vs java8
Hi,
Anyone running tests on Java 8? I just noticed that they take almost twice
as long to run compared to Java 7 (at least on my box, and with Scala
2.10.4).
Anyone else noticed this? Maybe even did some digging on the causes?
Gwen