You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/12/27 12:01:22 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4630
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4630/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 90ada50f8c8b2797c30aae0e032d4b18cbc5b69c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 90ada50f8c8b2797c30aae0e032d4b18cbc5b69c
Commit message: "Merge pull request #10468: [BEAM-9025] Update Dataflow Java container worker version"
> git rev-list --no-walk 90ada50f8c8b2797c30aae0e032d4b18cbc5b69c # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_Java_Nexmark_Dataflow] $ /bin/bash -xe /tmp/jenkins6391847981087928321.sh
+ echo src RUN NEXMARK IN BATCH MODE USING DATAFLOW RUNNER src
src RUN NEXMARK IN BATCH MODE USING DATAFLOW RUNNER src
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pnexmark.runner=:runners:google-cloud-dataflow-java "-Pnexmark.args=--bigQueryTable=nexmark --bigQueryDataset=nexmark --project=apache-beam-testing --resourceNameMode=QUERY_RUNNER_AND_MODE --exportSummaryToBigQuery=true --tempLocation=gs://temp-storage-for-perf-tests/nexmark --runner=DataflowRunner --numWorkers=4 --maxNumWorkers=4 --autoscalingAlgorithm=NONE --nexmarkParallel=16 --streaming=false --suite=STRESS --manageResources=false --monitorJobs=true --enforceEncodability=true --enforceImmutability=true" :sdks:java:testing:nexmark:run
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy
> Task :buildSrc:spotlessGroovyCheck
> Task :buildSrc:spotlessGroovyGradle
> Task :buildSrc:spotlessGroovyGradleCheck
> Task :buildSrc:spotlessCheck
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties FROM-CACHE
> Task :buildSrc:check
> Task :buildSrc:build
Configuration on demand is an incubating feature.
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=3308318a-d076-4bcb-a291-3ecff5e73687, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 4087
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-4087.out.log
----- Last 20 lines from daemon log file - daemon-4087.out.log -----
12:01:18.284 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=3308318a-d076-4bcb-a291-3ecff5e73687, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}.>
12:01:18.285 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=3308318a-d076-4bcb-a291-3ecff5e73687, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}> with connection: socket connection from /0:0:0:0:0:0:0:1:39331 to /0:0:0:0:0:0:0:1:57786.
12:01:18.285 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=3308318a-d076-4bcb-a291-3ecff5e73687, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src},> connection = DefaultDaemonConnection: socket connection from /0:0:0:0:0:0:0:1:39331 to /0:0:0:0:0:0:0:1:57786] after 0.0 minutes of idle
12:01:18.285 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [13d1d7a3-1f1d-4e10-87ee-261fbb0afef2 port:39331, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]]
12:01:18.285 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [13d1d7a3-1f1d-4e10-87ee-261fbb0afef2 port:39331, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]]
12:01:18.285 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry.
12:01:18.286 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry.
12:01:18.286 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry.
12:01:18.287 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
12:01:18.287 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes.
12:01:18.287 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=3308318a-d076-4bcb-a291-3ecff5e73687, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}.> Dispatching build started information...
12:01:18.287 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 26: dispatching class org.gradle.launcher.daemon.protocol.BuildStarted
12:01:18.287 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: {PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games, RUN_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4630/display/redirect, HUDSON_HOME=/x1/jenkins/jenkins-home, RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4630/display/redirect?page=changes, JOB_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/, HUDSON_COOKIE=29f8609d-8e37-4790-873d-1054ce214150, NIX_LABEL=ubuntu, SLACK_WEBHOOK_URL=****, SUDO_USER=gazineu, MAIL=/var/mail/jenkins, WIN_LABEL=Windows, JENKINS_SERVER_COOKIE=f4ebd1e6b0d976e8, USERNAME=root, LOGNAME=jenkins, PWD=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src,> JENKINS_URL=https://builds.apache.org/, SHELL=/bin/bash, BUILD_TAG=jenkins-beam_PostCommit_Java_Nexmark_Dataflow-4630, GIT_AUTHOR_EMAIL=builds@apache.org, LESSOPEN=| /usr/bin/lesspipe %s, ROOT_BUILD_CAUSE=TIMERTRIGGER, BUILD_CAUSE_TIMERTRIGGER=true, GIT_AUTHOR_NAME=jenkins, OLDPWD=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src,> JENKINS_HOME=/x1/jenkins/jenkins-home, sha1=master, NODE_NAME=apache-beam-jenkins-8, BUILD_DISPLAY_NAME=#4630, JOB_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/display/redirect, GIT_BRANCH=origin/master, LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:, SHLVL=1, GIT_PREVIOUS_COMMIT=90ada50f8c8b2797c30aae0e032d4b18cbc5b69c, LESSCLOSE=/usr/bin/lesspipe %s %s, JAVA_HOME=/home/jenkins/tools/java/latest1.8, TERM=xterm-256color, BUILD_ID=4630, LANG=en_US.UTF-8, JOB_NAME=beam_PostCommit_Java_Nexmark_Dataflow, SPARK_LOCAL_IP=127.0.0.1, BUILD_CAUSE=TIMERTRIGGER, SUDO_GID=1030, GIT_PREVIOUS_SUCCESSFUL_COMMIT=90ada50f8c8b2797c30aae0e032d4b18cbc5b69c, NODE_LABELS=apache-beam-jenkins-8 beam, HUDSON_URL=https://builds.apache.org/, WORKSPACE=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/,> ROOT_BUILD_CAUSE_TIMERTRIGGER=true, SUDO_UID=1029, _=/usr/bin/nohup, GIT_COMMIT=90ada50f8c8b2797c30aae0e032d4b18cbc5b69c, COVERALLS_REPO_TOKEN=****, EXECUTOR_NUMBER=1, HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8, GIT_COMMITTER_NAME=jenkins, JOB_BASE_NAME=beam_PostCommit_Java_Nexmark_Dataflow, USER=jenkins, SUDO_COMMAND=/bin/su jenkins, BUILD_NUMBER=4630, BUILD_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4630/, GIT_COMMITTER_EMAIL=builds@apache.org, GIT_URL=https://github.com/apache/beam.git, HOME=/home/jenkins}
12:01:18.289 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection.
12:01:18.289 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 4087). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-4087.out.log
12:01:18.289 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 16.81 secs, performance: 98%]
12:01:18.289 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build.
12:01:18.290 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=3f9ddc90-a05e-40fd-afe5-70893a828be4,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=4087,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Configuration on demand is an incubating feature.
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #4632
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4632/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4631
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4631/display/redirect>
Changes:
------------------------------------------
[...truncated 84.39 KB...]
0011 53.1 188444.6 1839657
0012 39.4 253601.1 199929
0013 *** not run ***
0014 *** not run ***
==========================================================================================
2019-12-27T18:10:19.724Z Waiting for main pipeline to 'finish'
2019-12-27T18:10:19.724Z DONE Query10
==========================================================================================
Run started 2019-12-27T18:04:18.185Z and ran for PT361.582S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 52.0 192429.8 10000000
0001 43.1 231787.3 9200000
0002 29.9 334526.5 83527
0003 44.6 224099.7 59507
0004 44.9 22270.7 140
0005 66.5 150464.2 4567
0006 43.2 23133.2 8902
0007 88.6 112888.5 100
0008 43.0 232358.2 92833
0009 39.1 25605.6 32548
0010 90.2 110813.1 100
0011 53.1 188444.6 1839657
0012 39.4 253601.1 199929
0013 *** not run ***
0014 *** not run ***
==========================================================================================
2019-12-27T18:10:19.804Z Waiting for main pipeline to 'finish'
2019-12-27T18:10:19.804Z DONE BoundedSideInputJoin
2019-12-27T18:10:19.815Z Waiting for main pipeline to 'finish'
2019-12-27T18:10:19.846Z RUNNING BoundedSideInputJoin
==========================================================================================
Run started 2019-12-27T18:04:18.185Z and ran for PT361.700S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 52.0 192429.8 10000000
0001 43.1 231787.3 9200000
0002 29.9 334526.5 83527
0003 44.6 224099.7 59507
0004 44.9 22270.7 140
0005 66.5 150464.2 4567
0006 43.2 23133.2 8902
0007 88.6 112888.5 100
0008 43.0 232358.2 92833
0009 39.1 25605.6 32548
0010 90.2 110813.1 100
0011 53.1 188444.6 1839657
0012 39.4 253601.1 199929
0013 46.8 213501.9 9200000
0014 *** not run ***
==========================================================================================
2019-12-27T18:10:20.725Z new perf {"snapshots":null,"runtimeSec":111.539,"numEvents":10000000,"eventsPerSec":89654.73959780883,"eventBytesPerSec":1.1507767659742333E7,"numResults":9200000,"resultsPerSec":82482.36042998412,"resultBytesPerSec":7064181.990155909,"startupDelaySec":-176.348,"processingDelaySec":58.027,"shutdownDelaySec":64.809,"timeDilation":8.964846376603699,"errors":null,"jobId":null}
2019-12-27T18:10:35.821Z RUNNING BoundedSideInputJoin
2019-12-27T18:10:36.581Z no activity
2019-12-27T18:10:51.682Z DONE BoundedSideInputJoin
==========================================================================================
Run started 2019-12-27T18:04:18.185Z and ran for PT393.555S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 52.0 192429.8 10000000
0001 43.1 231787.3 9200000
0002 29.9 334526.5 83527
0003 44.6 224099.7 59507
0004 44.9 22270.7 140
0005 66.5 150464.2 4567
0006 43.2 23133.2 8902
0007 88.6 112888.5 100
0008 43.0 232358.2 92833
0009 39.1 25605.6 32548
0010 90.2 110813.1 100
0011 53.1 188444.6 1839657
0012 39.4 253601.1 199929
0013 46.8 213501.9 9200000
0014 111.5 89654.7 9200000
==========================================================================================
==========================================================================================
Run started 2019-12-27T18:04:18.185Z and ran for PT396.479S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 52.0 192429.8 10000000
0001 43.1 231787.3 9200000
0002 29.9 334526.5 83527
0003 44.6 224099.7 59507
0004 44.9 22270.7 140
0005 66.5 150464.2 4567
0006 43.2 23133.2 8902
0007 88.6 112888.5 100
0008 43.0 232358.2 92833
0009 39.1 25605.6 32548
0010 90.2 110813.1 100
0011 53.1 188444.6 1839657
0012 39.4 253601.1 199929
0013 46.8 213501.9 9200000
0014 111.5 89654.7 9200000
==========================================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 9m 25s
81 actionable tasks: 55 executed, 26 from cache
Publishing build scan...
https://gradle.com/s/w636tzi6dmoyu
Build step 'Invoke Gradle script' changed build result to SUCCESS
[beam_PostCommit_Java_Nexmark_Dataflow] $ /bin/bash -xe /tmp/jenkins5916634575292905058.sh
+ echo src RUN NEXMARK IN STREAMING MODE USING DATAFLOW RUNNER src
src RUN NEXMARK IN STREAMING MODE USING DATAFLOW RUNNER src
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pnexmark.runner=:runners:google-cloud-dataflow-java "-Pnexmark.args=--bigQueryTable=nexmark --bigQueryDataset=nexmark --project=apache-beam-testing --resourceNameMode=QUERY_RUNNER_AND_MODE --exportSummaryToBigQuery=true --tempLocation=gs://temp-storage-for-perf-tests/nexmark --runner=DataflowRunner --numWorkers=4 --maxNumWorkers=4 --autoscalingAlgorithm=NONE --nexmarkParallel=16 --streaming=true --suite=STRESS --manageResources=false --monitorJobs=true --enforceEncodability=true --enforceImmutability=true" :sdks:java:testing:nexmark:run
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=37dd346c-eede-4ae7-a8b3-fa58723c3c5c, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 731
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-731.out.log
----- Last 20 lines from daemon log file - daemon-731.out.log -----
18:11:09.167 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 1834: Received non-IO message from client: Build{id=37dd346c-eede-4ae7-a8b3-fa58723c3c5c, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}>
18:11:09.167 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=37dd346c-eede-4ae7-a8b3-fa58723c3c5c, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}.>
18:11:09.167 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=37dd346c-eede-4ae7-a8b3-fa58723c3c5c, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}> with connection: socket connection from /0:0:0:0:0:0:0:1:34277 to /0:0:0:0:0:0:0:1:45326.
18:11:09.167 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=37dd346c-eede-4ae7-a8b3-fa58723c3c5c, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src},> connection = DefaultDaemonConnection: socket connection from /0:0:0:0:0:0:0:1:34277 to /0:0:0:0:0:0:0:1:45326] after 0.0 minutes of idle
18:11:09.168 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [de89ee21-7f2c-40b8-b80b-52076ce727db port:34277, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]]
18:11:09.168 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [de89ee21-7f2c-40b8-b80b-52076ce727db port:34277, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]]
18:11:09.168 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry.
18:11:09.168 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry.
18:11:09.176 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry.
18:11:09.177 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
18:11:09.177 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes.
18:11:09.177 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=37dd346c-eede-4ae7-a8b3-fa58723c3c5c, currentDir=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src}.> Dispatching build started information...
18:11:09.177 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 26: dispatching class org.gradle.launcher.daemon.protocol.BuildStarted
18:11:09.177 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: {PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games, RUN_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4631/display/redirect, HUDSON_HOME=/x1/jenkins/jenkins-home, RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4631/display/redirect?page=changes, JOB_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/, HUDSON_COOKIE=7e9f2450-98b9-4cc5-bd43-0569a3fa548b, NIX_LABEL=ubuntu, SLACK_WEBHOOK_URL=****, SUDO_USER=gazineu, MAIL=/var/mail/jenkins, WIN_LABEL=Windows, JENKINS_SERVER_COOKIE=f4ebd1e6b0d976e8, USERNAME=root, LOGNAME=jenkins, PWD=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src,> JENKINS_URL=https://builds.apache.org/, SHELL=/bin/bash, BUILD_TAG=jenkins-beam_PostCommit_Java_Nexmark_Dataflow-4631, GIT_AUTHOR_EMAIL=builds@apache.org, LESSOPEN=| /usr/bin/lesspipe %s, ROOT_BUILD_CAUSE=TIMERTRIGGER, BUILD_CAUSE_TIMERTRIGGER=true, GIT_AUTHOR_NAME=jenkins, OLDPWD=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src,> JENKINS_HOME=/x1/jenkins/jenkins-home, sha1=master, NODE_NAME=apache-beam-jenkins-8, BUILD_DISPLAY_NAME=#4631, JOB_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/display/redirect, GIT_BRANCH=origin/master, LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:, SHLVL=1, GIT_PREVIOUS_COMMIT=90ada50f8c8b2797c30aae0e032d4b18cbc5b69c, LESSCLOSE=/usr/bin/lesspipe %s %s, JAVA_HOME=/home/jenkins/tools/java/latest1.8, TERM=xterm-256color, BUILD_ID=4631, LANG=en_US.UTF-8, JOB_NAME=beam_PostCommit_Java_Nexmark_Dataflow, SPARK_LOCAL_IP=127.0.0.1, BUILD_CAUSE=TIMERTRIGGER, SUDO_GID=1030, GIT_PREVIOUS_SUCCESSFUL_COMMIT=90ada50f8c8b2797c30aae0e032d4b18cbc5b69c, NODE_LABELS=apache-beam-jenkins-8 beam, HUDSON_URL=https://builds.apache.org/, WORKSPACE=<https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/,> ROOT_BUILD_CAUSE_TIMERTRIGGER=true, SUDO_UID=1029, _=/usr/bin/nohup, GIT_COMMIT=90ada50f8c8b2797c30aae0e032d4b18cbc5b69c, COVERALLS_REPO_TOKEN=****, EXECUTOR_NUMBER=0, HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8, GIT_COMMITTER_NAME=jenkins, JOB_BASE_NAME=beam_PostCommit_Java_Nexmark_Dataflow, USER=jenkins, SUDO_COMMAND=/bin/su jenkins, BUILD_NUMBER=4631, BUILD_URL=https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4631/, GIT_COMMITTER_EMAIL=builds@apache.org, GIT_URL=https://github.com/apache/beam.git, HOME=/home/jenkins}
18:11:09.179 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection.
18:11:09.179 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 731). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-731.out.log
18:11:09.180 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 31 mins 4.824 secs, performance: 98%]
18:11:09.181 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build.
18:11:09.181 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=ad2edc62-0a88-4fe3-b61c-3582510d76b8,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=731,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org