You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Brian Cho <ch...@gmail.com> on 2015/02/11 09:24:29 UTC

Stopped some stalled Ubuntu CI jobs

FYI, I stopped a couple Ubuntu CI jobs, one that was stalled for 20+ hours
[1], the other 10+ hours [2]. They both seem to have stopped at
TaskCountingTest [3]. Also, they were blocking all the subsequent tests
from completing as well.

I'm not sure what happened. I'll report here if I figure out what happened
or if there's anything else to update.

Thanks,
Brian

[1] https://builds.apache.org/job/Reef-pull-request-ubuntu/250/
[2] https://builds.apache.org/job/Reef-pull-request-ubuntu/253/
[3] Below:

Running org.apache.reef.tests.taskcounting.TaskCountingTest
Feb 10, 2015 10:12:13 PM org.apache.reef.tests.TestEnvironmentFactory
getNewTestEnvironment
INFO: Running tests on Local

Powered by
     ___________  ______  ______  _______
    /  ______  / /  ___/ /  ___/ /  ____/
   /     _____/ /  /__  /  /__  /  /___
  /  /\  \     /  ___/ /  ___/ /  ____/
 /  /  \  \   /  /__  /  /__  /  /
/__/    \__\ /_____/ /_____/ /__/

Feb 10, 2015 10:12:13 PM org.apache.reef.util.REEFVersion logVersion
INFO: REEF Version: 0.11.0-incubating-SNAPSHOT

Re: Stopped some stalled Ubuntu CI jobs

Posted by Brian Cho <ch...@gmail.com>.
Before the particular test stalls, I see many more tests failing. This does
not happen on my local machine.

I'm not sure, but it seems to be a protobuf problem [1]. Were there any
protoc setup changes lately? Is there a way to check the protoc version?

Thanks,
Brian



[1] Partial log with *emphasis* on protobuf part:

org.apache.reef.exception.evaluator.NetworkException:
com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.UnsupportedOperationException: This is supposed to be
overridden by subclasses.
	at org.apache.reef.io.network.impl.NSConnection.open(NSConnection.java:92)
	at org.apache.reef.services.network.NetworkServiceTest$1.run(NetworkServiceTest.java:253)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:724)
Caused by: com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.UnsupportedOperationException: This is supposed to be
overridden by subclasses.
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2234)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4764)
	at org.apache.reef.io.network.naming.NameCache.get(NameCache.java:59)
	at org.apache.reef.io.network.naming.NameCache.get(NameCache.java:33)
	at org.apache.reef.io.network.naming.NameLookupClient.lookup(NameLookupClient.java:135)
	at org.apache.reef.io.network.naming.NameClient.lookup(NameClient.java:129)
	at org.apache.reef.io.network.impl.NSConnection.open(NSConnection.java:77)
	... 7 more*Caused by: java.lang.UnsupportedOperationException: This
is supposed to be overridden by subclasses.
	at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)*
	at org.apache.reef.wake.remote.proto.WakeRemoteProtos$WakeTuplePBuf.getSerializedSize(WakeRemoteProtos.java:802)
	at com.google.protobuf.AbstractMessageLite.toByteArray(AbstractMessageLite.java:62)
	at org.apache.reef.wake.remote.impl.MultiEncoder.encode(MultiEncoder.java:61)
	at org.apache.reef.wake.remote.impl.MultiCodec.encode(MultiCodec.java:62)
	at org.apache.reef.wake.remote.transport.netty.NettyLink.write(NettyLink.java:76)
	at org.apache.reef.io.network.naming.NameLookupClient.remoteLookup(NameLookupClient.java:182)
Feb 11, 2015 8:24:19 AM org.apache.reef.io.network.impl.NetworkService$1 onNext



On Wed, Feb 11, 2015 at 5:24 PM, Brian Cho <ch...@gmail.com> wrote:

> FYI, I stopped a couple Ubuntu CI jobs, one that was stalled for 20+ hours
> [1], the other 10+ hours [2]. They both seem to have stopped at
> TaskCountingTest [3]. Also, they were blocking all the subsequent tests
> from completing as well.
>
> I'm not sure what happened. I'll report here if I figure out what happened
> or if there's anything else to update.
>
> Thanks,
> Brian
>
> [1] https://builds.apache.org/job/Reef-pull-request-ubuntu/250/
> [2] https://builds.apache.org/job/Reef-pull-request-ubuntu/253/
> [3] Below:
>
> Running org.apache.reef.tests.taskcounting.TaskCountingTest
> Feb 10, 2015 10:12:13 PM org.apache.reef.tests.TestEnvironmentFactory getNewTestEnvironment
> INFO: Running tests on Local
>
> Powered by
>      ___________  ______  ______  _______
>     /  ______  / /  ___/ /  ___/ /  ____/
>    /     _____/ /  /__  /  /__  /  /___
>   /  /\  \     /  ___/ /  ___/ /  ____/
>  /  /  \  \   /  /__  /  /__  /  /
> /__/    \__\ /_____/ /_____/ /__/
>
> Feb 10, 2015 10:12:13 PM org.apache.reef.util.REEFVersion logVersion
> INFO: REEF Version: 0.11.0-incubating-SNAPSHOT
>
>