You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Alex Amato <aj...@google.com> on 2019/05/28 23:25:35 UTC

How do I debug failing runners:google-cloud-dataflow-java:examples:verifyFnApiWorker task in presubmit

I'm had a lingering PR for some about a month now. I'm trying to get this
passing presubmits and submitted, but I don't have enough output from the
failing task to debug this.

I think its from a wordcount timeout, but I don't know how to get more
info. I don't think its a dataflow job with any links to its running page.
Can this test be launched somehow in a debugger?

https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApi_Commit/3210/console

*19:09:11* Build timed out (after 120 minutes). Marking the build as
aborted.*19:09:11* Build was aborted*19:09:11* Recording test
results*19:09:13* *19:09:13* >* Task
:runners:google-cloud-dataflow-java:examples:verifyFnApiWorker*
FAILED*19:09:13* Could not stop
org.gradle.internal.actor.internal.DefaultActorFactory$NonBlockingActor@3bd68689.*19:09:13*
org.gradle.internal.dispatch.DispatchException: Could not dispatch
message [MethodInvocation method:
processTestClass(DefaultTestClassRunInfo(org.apache.beam.examples.WordCountIT))].*19:09:13*
	at org.gradle.internal.dispatch.ExceptionTrackingFailureHandler.dispatchFailed(ExceptionTrackingFailureHandler.java:34)*19:09:13*
	at org.gradle.internal.dispatch.FailureHandlingDispatch.dispatch(FailureHandlingDispatch.java:31)*19:09:13*
	at org.gradle.internal.dispatch.AsyncDispatch.dispatchMessages(AsyncDispatch.java:87)*19:09:13*
	at org.gradle.internal.dispatch.AsyncDispatch.access$000(AsyncDispatch.java:36)*19:09:13*
	at org.gradle.internal.dispatch.AsyncDispatch$1.run(AsyncDispatch.java:71)*19:09:13*
	at org.gradle.internal.concurrent.InterruptibleRunnable.run(InterruptibleRunnable.java:42)*19:09:13*
	at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)*19:09:13*
	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)*19:09:13*
	at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)*19:09:13*
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*19:09:13*
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*19:09:13*
	at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)*19:09:13*
	at java.lang.Thread.run(Thread.java:748)*19:09:13* Caused by:
org.gradle.process.internal.ExecException: Process 'Gradle Test
Executor 1' finished with non-zero exit value 143*19:09:13* This
problem might be caused by incorrect test process
configuration.*19:09:13* Please refer to the test execution section in
the User Manual at
https://docs.gradle.org/5.2.1/userguide/java_testing.html#sec:test_execution*19:09:13*
	at org.gradle.api.internal.tasks.testing.worker.ForkingTestClassProcessor.stop(ForkingTestClassProcessor.java:163)*19:09:13*
	at org.gradle.api.internal.tasks.testing.processors.RestartEveryNTestClassProcessor.endBatch(RestartEveryNTestClassProcessor.java:77)*19:09:13*
	at org.gradle.api.internal.tasks.testing.processors.RestartEveryNTestClassProcessor.processTestClass(RestartEveryNTestClassProcessor.java:55)*19:09:13*
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)*19:09:13* 	at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)*19:09:13*
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*19:09:13*
	at java.lang.reflect.Method.invoke(Method.java:498)*19:09:13* 	at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)*19:09:13*
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)*19:09:13*
	at org.gradle.internal.dispatch.FailureHandlingDispatch.dispatch(FailureHandlingDispatch.java:29)*19:09:13*
	... 11 more*19:09:14* Setting status of
59fcfe4a0e37f9a057b03d1d8bb35f35d7748252 to FAILURE with url
https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApi_Commit/3210/
and message: 'FAILURE*19:09:14*  '*19:09:14* Using context:
JavaPortabilityApi ("Run JavaPortabilityApi PreCommit")*19:09:14* The
message received from the daemon indicates that the daemon has
disappeared.*19:09:14* Build request sent:
Build{id=7ed96db1-2c38-4d51-b65d-d2ced0ec2e6d,
currentDir=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_JavaPortabilityApi_Commit/src}*19:09:14*
Attempting to read last messages from the daemon log...*19:09:14*
Daemon pid: 23758*19:09:14*   log file:
/home/jenkins/.gradle/daemon/5.2.1/daemon-23758.out.log*19:09:14*
----- Last  20 lines from daemon log file - daemon-23758.out.log
-----*19:09:14* 	at
org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)*19:09:14*
	at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)*19:09:14*
	at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)*19:09:14*
	at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)*19:09:14*
	at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)*19:09:14*
	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)*19:09:14*
	at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)*19:09:14*
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*19:09:14*
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*19:09:14*
	at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)*19:09:14*
	at java.lang.Thread.run(Thread.java:748)*19:09:14* Caused by:
java.lang.IllegalStateException: Shutdown in progress*19:09:14* 	at
java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)*19:09:14*
	at java.lang.Runtime.removeShutdownHook(Runtime.java:239)*19:09:14*
	at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)*19:09:14*
	at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)*19:09:14*
	at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)*19:09:14*
	at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)*19:09:14*
	at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)*19:09:14*
	... 7 more*19:09:14* ----- End of the daemon log -----

Re: How do I debug failing runners:google-cloud-dataflow-java:examples:verifyFnApiWorker task in presubmit

Posted by Alex Amato <aj...@google.com>.
PR link
https://github.com/apache/beam/pull/8416

On Tue, May 28, 2019 at 4:25 PM Alex Amato <aj...@google.com> wrote:

> I'm had a lingering PR for some about a month now. I'm trying to get this
> passing presubmits and submitted, but I don't have enough output from the
> failing task to debug this.
>
> I think its from a wordcount timeout, but I don't know how to get more
> info. I don't think its a dataflow job with any links to its running page.
> Can this test be launched somehow in a debugger?
>
>
> https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApi_Commit/3210/console
>
> *19:09:11* Build timed out (after 120 minutes). Marking the build as aborted.*19:09:11* Build was aborted*19:09:11* Recording test results*19:09:13* *19:09:13* >* Task :runners:google-cloud-dataflow-java:examples:verifyFnApiWorker* FAILED*19:09:13* Could not stop org.gradle.internal.actor.internal.DefaultActorFactory$NonBlockingActor@3bd68689.*19:09:13* org.gradle.internal.dispatch.DispatchException: Could not dispatch message [MethodInvocation method: processTestClass(DefaultTestClassRunInfo(org.apache.beam.examples.WordCountIT))].*19:09:13* 	at org.gradle.internal.dispatch.ExceptionTrackingFailureHandler.dispatchFailed(ExceptionTrackingFailureHandler.java:34)*19:09:13* 	at org.gradle.internal.dispatch.FailureHandlingDispatch.dispatch(FailureHandlingDispatch.java:31)*19:09:13* 	at org.gradle.internal.dispatch.AsyncDispatch.dispatchMessages(AsyncDispatch.java:87)*19:09:13* 	at org.gradle.internal.dispatch.AsyncDispatch.access$000(AsyncDispatch.java:36)*19:09:13* 	at org.gradle.internal.dispatch.AsyncDispatch$1.run(AsyncDispatch.java:71)*19:09:13* 	at org.gradle.internal.concurrent.InterruptibleRunnable.run(InterruptibleRunnable.java:42)*19:09:13* 	at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)*19:09:13* 	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)*19:09:13* 	at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)*19:09:13* 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*19:09:13* 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*19:09:13* 	at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)*19:09:13* 	at java.lang.Thread.run(Thread.java:748)*19:09:13* Caused by: org.gradle.process.internal.ExecException: Process 'Gradle Test Executor 1' finished with non-zero exit value 143*19:09:13* This problem might be caused by incorrect test process configuration.*19:09:13* Please refer to the test execution section in the User Manual at https://docs.gradle.org/5.2.1/userguide/java_testing.html#sec:test_execution*19:09:13* 	at org.gradle.api.internal.tasks.testing.worker.ForkingTestClassProcessor.stop(ForkingTestClassProcessor.java:163)*19:09:13* 	at org.gradle.api.internal.tasks.testing.processors.RestartEveryNTestClassProcessor.endBatch(RestartEveryNTestClassProcessor.java:77)*19:09:13* 	at org.gradle.api.internal.tasks.testing.processors.RestartEveryNTestClassProcessor.processTestClass(RestartEveryNTestClassProcessor.java:55)*19:09:13* 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)*19:09:13* 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)*19:09:13* 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)*19:09:13* 	at java.lang.reflect.Method.invoke(Method.java:498)*19:09:13* 	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)*19:09:13* 	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)*19:09:13* 	at org.gradle.internal.dispatch.FailureHandlingDispatch.dispatch(FailureHandlingDispatch.java:29)*19:09:13* 	... 11 more*19:09:14* Setting status of 59fcfe4a0e37f9a057b03d1d8bb35f35d7748252 to FAILURE with url https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApi_Commit/3210/ and message: 'FAILURE*19:09:14*  '*19:09:14* Using context: JavaPortabilityApi ("Run JavaPortabilityApi PreCommit")*19:09:14* The message received from the daemon indicates that the daemon has disappeared.*19:09:14* Build request sent: Build{id=7ed96db1-2c38-4d51-b65d-d2ced0ec2e6d, currentDir=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_JavaPortabilityApi_Commit/src}*19:09:14* Attempting to read last messages from the daemon log...*19:09:14* Daemon pid: 23758*19:09:14*   log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-23758.out.log*19:09:14* ----- Last  20 lines from daemon log file - daemon-23758.out.log -----*19:09:14* 	at org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)*19:09:14* 	at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)*19:09:14* 	at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)*19:09:14* 	at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)*19:09:14* 	at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)*19:09:14* 	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)*19:09:14* 	at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)*19:09:14* 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*19:09:14* 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*19:09:14* 	at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)*19:09:14* 	at java.lang.Thread.run(Thread.java:748)*19:09:14* Caused by: java.lang.IllegalStateException: Shutdown in progress*19:09:14* 	at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)*19:09:14* 	at java.lang.Runtime.removeShutdownHook(Runtime.java:239)*19:09:14* 	at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)*19:09:14* 	at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)*19:09:14* 	at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)*19:09:14* 	at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)*19:09:14* 	at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)*19:09:14* 	... 7 more*19:09:14* ----- End of the daemon log -----
>
>
>