You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/03/03 21:02:00 UTC
[jira] [Commented] (BEAM-13810) Flaky tests: Gradle build daemon disappeared unexpectedly
[ https://issues.apache.org/jira/browse/BEAM-13810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501032#comment-17501032 ]
Kenneth Knowles commented on BEAM-13810:
----------------------------------------
I don't currently have a specific Jenkins job or gradle scan to investigate. We can run with `--profile` to estimate. We can probably do this all the time, and it may already be included in the data uploaded by `--scan`.
> Flaky tests: Gradle build daemon disappeared unexpectedly
> ---------------------------------------------------------
>
> Key: BEAM-13810
> URL: https://issues.apache.org/jira/browse/BEAM-13810
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Kyle Weaver
> Assignee: Kenneth Knowles
> Priority: P1
> Labels: flake
>
> This happens to many of our tests. It looks like this is a common issue with Gradle and we will have to do more digging to determine the true cause. https://stackoverflow.com/questions/37171043/gradle-build-daemon-disappeared-unexpectedly-it-may-have-been-killed-or-may-hav/37171110
> 10:04:08 > Task :sdks:go:test:sparkValidatesRunner
> 10:04:08 Feb 02, 2022 6:04:08 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
> 10:04:08 INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk, beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix, beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk, beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk, beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq, beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write, beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read, beam:external:java:generate_sequence:v1]
> 10:04:09 The message received from the daemon indicates that the daemon has disappeared.
> 10:04:09 Build request sent: Build{id=37ea63c1-ec5f-492a-ad6a-f26c92fd7f7e, currentDir=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_VR_Spark/src}
> 10:04:09 Attempting to read last messages from the daemon log...
> 10:04:09 Daemon pid: 3299301
> 10:04:09 log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-3299301.out.log
> 10:04:09 ----- Last 20 lines from daemon log file - daemon-3299301.out.log -----
> 10:04:09 2022-02-02T18:04:08.251+0000 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [2bd8c084-af4c-4924-90f5-8b8a89f85fc5 port:32889, addresses:[localhost/127.0.0.1]]
> 10:04:09 2022-02-02T18:04:08.251+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry.
> 10:04:09 2022-02-02T18:04:08.251+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry.
> 10:04:09 2022-02-02T18:04:08.252+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry.
> 10:04:09 2022-02-02T18:04:08.252+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
> 10:04:09 2022-02-02T18:04:08.252+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes.
> 10:04:09 2022-02-02T18:04:08.253+0000 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=37ea63c1-ec5f-492a-ad6a-f26c92fd7f7e, currentDir=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Go_VR_Spark/src}. Dispatching build started information...
> 10:04:09 2022-02-02T18:04:08.253+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 266: dispatching org.gradle.launcher.daemon.protocol.BuildStarted@42569c28
> 10:04:09 2022-02-02T18:04:08.255+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: [PATH, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL, JOB_URL, HUDSON_COOKIE, MOTD_SHOWN, DBUS_SESSION_BUS_ADDRESS, JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL, BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD, GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, CODECOV_TOKEN, NODE_NAME, BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS, SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, JAVA_HOME, BUILD_ID, LANG, XDG_SESSION_ID, XDG_SESSION_TYPE, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE, GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE, ROOT_BUILD_CAUSE_TIMERTRIGGER, XDG_SESSION_CLASS, _, GIT_COMMIT, COVERALLS_REPO_TOKEN, CI, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT, JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL, RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME]
> 10:04:09 2022-02-02T18:04:08.256+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection.
> 10:04:09 2022-02-02T18:04:08.256+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 3299301). The daemon log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-3299301.out.log
> 10:04:09 2022-02-02T18:04:08.257+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 3 mins 43.954 secs, performance: 98%]
> 10:04:09 2022-02-02T18:04:08.264+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 264: received class org.gradle.launcher.daemon.protocol.CloseInput
> 10:04:09 2022-02-02T18:04:08.264+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 264: Received IO message from client: org.gradle.launcher.daemon.protocol.CloseInput@3e111340
> 10:04:09 2022-02-02T18:04:08.271+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build.
> 10:04:09 2022-02-02T18:04:08.271+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=ca7e60a9-87d1-4beb-a056-dcf9ca91d510,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=3299301,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xss10240k,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
> 10:04:09 2022-02-02T18:04:08.271+0000 [INFO] [org.gradle.launcher.daemon.server.exec.ForwardClientInput] Closing daemon's stdin at end of input.
> 10:04:09 2022-02-02T18:04:08.271+0000 [INFO] [org.gradle.launcher.daemon.server.exec.ForwardClientInput] The daemon will no longer process any standard input.
> 10:04:09 Configuration on demand is an incubating feature.
> 10:04:09 Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
> 10:04:09 ----- End of the daemon log -----
--
This message was sent by Atlassian Jira
(v8.20.1#820001)