You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/06/26 18:23:20 UTC
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #944
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/944/display/redirect>
------------------------------------------
[...truncated 4.37 MB...]
Jun 26, 2018 6:23:11 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:11 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:11 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Undeploy request: [9, 10, 11]
Jun 26, 2018 6:23:11 PM com.datatorrent.stram.engine.StreamingContainer undeploy
INFO: Undeploy complete.
Jun 26, 2018 6:23:11 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln LogicalNode@7d29e50identifier=tcp://localhost:35227/11.output.11, upstream=11.output.11, group=stream9/12.data1, partitions=[], iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@16fe873a{da=com.datatorrent.bufferserver.internal.DataList$Block@72a6a997{identifier=11.output.11, data=1048576, readingOffset=0, writingOffset=132, starting_window=5b32848b00000001, ending_window=5b32848b00000004, refCount=2, uniqueIdentifier=0, next=null, future=null}}} from dl DataList@1c4006cb[identifier=11.output.11]
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-8
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-8 msg: [container-8] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-8 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster run
WARNING: Event loop OptimizedEventLoop@590a5c7a{id=ProcessWideEventLoop, active=true, refCount=2, head=512, tail=512, capacity=1024} is still active
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster run
INFO: Application finished.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-3
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-1
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-3 msg: [container-3] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-2
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-3 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-1 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-2 msg: [container-2] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-2 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-4
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-4 msg: [container-4] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-4 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-7
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-6
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-7 msg: [container-7] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-6 msg: [container-6] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-7 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-6 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-0
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-0 msg: [container-0] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-0 terminating.
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-5
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-5 msg: [container-5] Exiting heartbeat loop..
Jun 26, 2018 6:23:12 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-5 terminating.
Jun 26, 2018 6:23:13 PM com.datatorrent.bufferserver.server.Server$1 run
INFO: Server stopped listening at /0:0:0:0:0:0:0:0:35227
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.StramLocalCluster run
WARNING: Event loop OptimizedEventLoop@590a5c7a{id=ProcessWideEventLoop, active=true, refCount=1, head=513, tail=513, capacity=1024} is still active
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.StramLocalCluster run
INFO: Application finished.
org.apache.beam.runners.apex.translation.ParDoTranslatorTest > testAssertionFailure SKIPPED
org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest > testReadBounded STANDARD_ERROR
Jun 26, 2018 6:23:13 PM com.datatorrent.common.util.AsyncFSStorageAgent save
INFO: using /tmp/chkp8642778912026362941 as the basepath for checkpointing.
Jun 26, 2018 6:23:13 PM com.datatorrent.bufferserver.storage.DiskStorage <init>
INFO: using /tmp as the basepath for spooling.
Jun 26, 2018 6:23:13 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest testReadBounded
INFO: Waiting for expected results.
Jun 26, 2018 6:23:13 PM com.datatorrent.bufferserver.server.Server registered
INFO: Server started listening at /0:0:0:0:0:0:0:0:45095
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.StramLocalCluster run
INFO: Buffer server started: localhost:45095
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-0
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-0 msg: [container-0] Entering heartbeat loop..
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-1
Jun 26, 2018 6:23:13 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Entering heartbeat loop..
Jun 26, 2018 6:23:14 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest testReadBounded
INFO: Waiting for expected results.
Jun 26, 2018 6:23:14 PM com.datatorrent.stram.engine.StreamingContainer heartbeatLoop
INFO: Waiting for pending request.
Jun 26, 2018 6:23:14 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=1,name=GenerateSequence/Read(BoundedCountingSource),type=INPUT,checkpoint={ffffffffffffffff, 0, 0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream0,bufferServer=localhost]]]]
Jun 26, 2018 6:23:14 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=1.output.1, windowId=ffffffffffffffff}
Jun 26, 2018 6:23:14 PM com.datatorrent.stram.engine.WindowGenerator activate
INFO: Catching up from 1530037393500 to 1530037394609
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=2,name=ParDo(EmbeddedCollector)/ParMultiDo(EmbeddedCollector),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream0,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[]]]
Jun 26, 2018 6:23:15 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45095/1.output.1, windowId=ffffffffffffffff, type=stream0/2.input, upstreamIdentifier=1.output.1, mask=0, partitions=null, bufferSize=1024}
org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest > test STANDARD_ERROR
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:15 PM com.datatorrent.common.util.AsyncFSStorageAgent save
INFO: using /tmp/chkp8952705811531740178 as the basepath for checkpointing.
Jun 26, 2018 6:23:15 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest test
INFO: Waiting for expected results.
Jun 26, 2018 6:23:15 PM com.datatorrent.bufferserver.storage.DiskStorage <init>
INFO: using /tmp as the basepath for spooling.
Jun 26, 2018 6:23:15 PM com.datatorrent.bufferserver.server.Server registered
INFO: Server started listening at /0:0:0:0:0:0:0:0:35311
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.StramLocalCluster run
INFO: Buffer server started: localhost:35311
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-0
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-1
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-0 msg: [container-0] Entering heartbeat loop..
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Entering heartbeat loop..
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.engine.Node emitEndStream
INFO: 1 sending EndOfStream
Jun 26, 2018 6:23:15 PM com.datatorrent.stram.engine.Node emitEndStream
INFO: 2 sending EndOfStream
Jun 26, 2018 6:23:16 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:16 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:16 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Undeploy request: [1]
Jun 26, 2018 6:23:16 PM com.datatorrent.stram.engine.StreamingContainer undeploy
INFO: Undeploy complete.
Jun 26, 2018 6:23:16 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln LogicalNode@29d42c00identifier=tcp://localhost:45095/1.output.1, upstream=1.output.1, group=stream0/2.input, partitions=[], iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@2debade2{da=com.datatorrent.bufferserver.internal.DataList$Block@68e9263b{identifier=1.output.1, data=1048576, readingOffset=0, writingOffset=280, starting_window=5b32849100000001, ending_window=5b32849100000006, refCount=2, uniqueIdentifier=0, next=null, future=null}}} from dl DataList@51f75ae2[identifier=1.output.1]
Jun 26, 2018 6:23:16 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest test
INFO: Waiting for expected results.
Jun 26, 2018 6:23:16 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=1,name=Read(CollectionSource),type=INPUT,checkpoint={ffffffffffffffff, 0, 0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream0,bufferServer=localhost]]]]
Jun 26, 2018 6:23:16 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=2,name=ParDo(EmbeddedCollector)/ParMultiDo(EmbeddedCollector),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream0,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[]]]
Jun 26, 2018 6:23:16 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:35311/1.output.1, windowId=ffffffffffffffff, type=stream0/2.input, upstreamIdentifier=1.output.1, mask=0, partitions=null, bufferSize=1024}
Jun 26, 2018 6:23:16 PM com.datatorrent.stram.engine.WindowGenerator activate
INFO: Catching up from 1530037395500 to 1530037396675
Jun 26, 2018 6:23:16 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=1.output.1, windowId=ffffffffffffffff}
Jun 26, 2018 6:23:17 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:23:17 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Undeploy request: [2]
Jun 26, 2018 6:23:17 PM com.datatorrent.stram.engine.StreamingContainer undeploy
INFO: Undeploy complete.
Jun 26, 2018 6:23:17 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-1
Jun 26, 2018 6:23:17 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:23:17 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Exiting heartbeat loop..
Jun 26, 2018 6:23:17 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-1 terminating.
Gradle Test Executor 48 finished executing tests.
> Task :beam-runners-apex:test
Finished generating test XML results (0.003 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/apex/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.003 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/apex/build/reports/tests/test>
Packing task ':beam-runners-apex:test'
:beam-runners-apex:test (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 42.791 secs.
:beam-runners-apex:check (Thread[Task worker for ':' Thread 12,5,main]) started.
> Task :beam-runners-apex:check
Skipping task ':beam-runners-apex:check' as it has no actions.
:beam-runners-apex:check (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.0 secs.
:beam-runners-apex:build (Thread[Task worker for ':' Thread 7,5,main]) started.
> Task :beam-runners-apex:build
Skipping task ':beam-runners-apex:build' as it has no actions.
:beam-runners-apex:build (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:beam-runners-apex:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started.
> Task :beam-runners-apex:buildDependents
Caching disabled for task ':beam-runners-apex:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-apex:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-apex:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-harness:compileJava'.
> Compilation failed with exit code 1; see the compiler error output for details.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 45s
317 actionable tasks: 312 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/46piysqwl6rvm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user apilloud@google.com
Jenkins build is back to normal : beam_PostCommit_Java_GradleBuild
#947
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/947/display/redirect?page=changes>
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #946
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/946/display/redirect?page=changes>
Changes:
[altay] improvements to fanout
------------------------------------------
[...truncated 4.40 MB...]
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/spark-launcher_2.11-2.3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/javax.inject-2.4.0-b34.jar with timestamp 1530039947775
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/javax.inject-2.4.0-b34.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp6726803596282427810.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/javax.inject-2.4.0-b34.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded.jar with timestamp 1530039947734
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp4732580965290437234.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/hadoop-mapreduce-client-common-2.7.3.jar with timestamp 1530039947753
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/hadoop-mapreduce-client-common-2.7.3.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp5356990084138591126.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/hadoop-mapreduce-client-common-2.7.3.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/servlet-api-2.5.jar with timestamp 1530039947766
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/servlet-api-2.5.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp932520885094701482.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/servlet-api-2.5.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/curator-client-2.7.1.jar with timestamp 1530039947755
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/curator-client-2.7.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp2421066044382384793.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/curator-client-2.7.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/osgi-resource-locator-1.0.1.jar with timestamp 1530039947776
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/osgi-resource-locator-1.0.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp4542872723753945653.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/osgi-resource-locator-1.0.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/hadoop-yarn-server-nodemanager-2.7.3.jar with timestamp 1530039947754
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/hadoop-yarn-server-nodemanager-2.7.3.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp9045144490942482936.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/hadoop-yarn-server-nodemanager-2.7.3.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/objenesis-2.6.jar with timestamp 1530039947750
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/objenesis-2.6.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp7630981781920912917.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/objenesis-2.6.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/compress-lzf-1.0.3.jar with timestamp 1530039947761
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/compress-lzf-1.0.3.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp8141468576532237876.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/compress-lzf-1.0.3.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/commons-net-3.1.jar with timestamp 1530039947761
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/commons-net-3.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp1286390574321688776.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/commons-net-3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/minlog-1.3.0.jar with timestamp 1530039947777
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/minlog-1.3.0.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp4075716602660721648.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/minlog-1.3.0.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/htrace-core-3.1.0-incubating.jar with timestamp 1530039947768
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/htrace-core-3.1.0-incubating.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp1359197864037722260.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/htrace-core-3.1.0-incubating.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/jersey-core-1.9.jar with timestamp 1530039947767
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/jersey-core-1.9.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp3788708924688861673.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/jersey-core-1.9.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/asm-3.1.jar with timestamp 1530039947777
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/asm-3.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp3727929162498825825.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/asm-3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/commons-httpclient-3.1.jar with timestamp 1530039947765
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/commons-httpclient-3.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp5620045701955486426.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/commons-httpclient-3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/chill-java-0.8.4.jar with timestamp 1530039947757
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/chill-java-0.8.4.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp2849564941677363240.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/chill-java-0.8.4.jar to class loader
Gradle Test Executor 66 started executing tests.
Gradle Test Executor 66 finished executing tests.
Gradle Test Executor 64 finished executing tests.
> Task :beam-runners-spark:test
[Executor task launch worker for task 3] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 0.0 (TID 3). 7486 bytes result sent to driver
[Executor task launch worker for task 1] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 0.0 (TID 1). 6627 bytes result sent to driver
[Executor task launch worker for task 2] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 0.0 (TID 2). 6670 bytes result sent to driver
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 0.0 (TID 0). 6627 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 0.0 (TID 2) in 6576 ms on localhost (executor driver) (1/4)
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 0.0 (TID 1) in 6609 ms on localhost (executor driver) (2/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 0.0 (TID 0) in 6661 ms on localhost (executor driver) (3/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 0.0 (TID 3) in 6591 ms on localhost (executor driver) (4/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 0.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ShuffleMapStage 0 (mapToPair at GroupCombineFunctions.java:184) finished in 6.996 s
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - looking for newly runnable stages
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - running: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - waiting: Set(ShuffleMapStage 1, ShuffleMapStage 2, ResultStage 3)
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - failed: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting ShuffleMapStage 1 (MapPartitionsRDD[28] at mapToPair at GroupCombineFunctions.java:59), which has no missing parents
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_1 stored as values in memory (estimated size 84.2 KB, free 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_1_piece0 stored as bytes in memory (estimated size 25.4 KB, free 13.5 GB)
[dispatcher-event-loop-3] INFO org.apache.spark.storage.BlockManagerInfo - Added broadcast_1_piece0 in memory on localhost:33537 (size: 25.4 KB, free: 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.SparkContext - Created broadcast 1 from broadcast at DAGScheduler.scala:1039
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting 4 missing tasks from ShuffleMapStage 1 (MapPartitionsRDD[28] at mapToPair at GroupCombineFunctions.java:59) (first 15 tasks are for partitions Vector(0, 1, 2, 3))
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Adding task set 1.0 with 4 tasks
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 1.0 (TID 4, localhost, executor driver, partition 0, NODE_LOCAL, 7638 bytes)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 1.0 (TID 5, localhost, executor driver, partition 2, NODE_LOCAL, 7638 bytes)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 3.0 in stage 1.0 (TID 6, localhost, executor driver, partition 3, NODE_LOCAL, 7638 bytes)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 1.0 (TID 7, localhost, executor driver, partition 1, PROCESS_LOCAL, 7638 bytes)
[Executor task launch worker for task 4] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 1.0 (TID 4)
[Executor task launch worker for task 5] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 1.0 (TID 5)
[Executor task launch worker for task 6] INFO org.apache.spark.executor.Executor - Running task 3.0 in stage 1.0 (TID 6)
[Executor task launch worker for task 7] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 1.0 (TID 7)
[Executor task launch worker for task 6] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 1 non-empty blocks out of 4 blocks
[Executor task launch worker for task 5] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 4 non-empty blocks out of 4 blocks
[Executor task launch worker for task 4] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 2 non-empty blocks out of 4 blocks
[Executor task launch worker for task 5] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 9 ms
[Executor task launch worker for task 4] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 9 ms
[Executor task launch worker for task 6] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 9 ms
[Executor task launch worker for task 7] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 7] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 7] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 1.0 (TID 7). 7615 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 1.0 (TID 7) in 158 ms on localhost (executor driver) (1/4)
[Executor task launch worker for task 5] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 1.0 (TID 5). 11385 bytes result sent to driver
[Executor task launch worker for task 6] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 1.0 (TID 6). 11385 bytes result sent to driver
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 1.0 (TID 5) in 168 ms on localhost (executor driver) (2/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 1.0 (TID 6) in 169 ms on localhost (executor driver) (3/4)
[Executor task launch worker for task 4] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 1.0 (TID 4). 11385 bytes result sent to driver
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 1.0 (TID 4) in 178 ms on localhost (executor driver) (4/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 1.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ShuffleMapStage 1 (mapToPair at GroupCombineFunctions.java:59) finished in 0.197 s
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - looking for newly runnable stages
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - running: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - waiting: Set(ShuffleMapStage 2, ResultStage 3)
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - failed: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting ShuffleMapStage 2 (MapPartitionsRDD[50] at mapToPair at GroupCombineFunctions.java:59), which has no missing parents
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_2 stored as values in memory (estimated size 94.1 KB, free 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_2_piece0 stored as bytes in memory (estimated size 28.4 KB, free 13.5 GB)
[dispatcher-event-loop-2] INFO org.apache.spark.storage.BlockManagerInfo - Added broadcast_2_piece0 in memory on localhost:33537 (size: 28.4 KB, free: 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.SparkContext - Created broadcast 2 from broadcast at DAGScheduler.scala:1039
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting 8 missing tasks from ShuffleMapStage 2 (MapPartitionsRDD[50] at mapToPair at GroupCombineFunctions.java:59) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7))
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Adding task set 2.0 with 8 tasks
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 3.0 in stage 2.0 (TID 8, localhost, executor driver, partition 3, NODE_LOCAL, 7777 bytes)
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 2.0 (TID 9, localhost, executor driver, partition 0, PROCESS_LOCAL, 7777 bytes)
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 2.0 (TID 10, localhost, executor driver, partition 1, PROCESS_LOCAL, 7777 bytes)
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 2.0 (TID 11, localhost, executor driver, partition 2, PROCESS_LOCAL, 7777 bytes)
[Executor task launch worker for task 9] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 2.0 (TID 9)
[Executor task launch worker for task 8] INFO org.apache.spark.executor.Executor - Running task 3.0 in stage 2.0 (TID 8)
[Executor task launch worker for task 10] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 2.0 (TID 10)
[Executor task launch worker for task 11] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 2.0 (TID 11)
[Executor task launch worker for task 11] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 10] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 10] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 9] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 9] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 0 ms
[Executor task launch worker for task 11] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 4 ms
[Executor task launch worker for task 8] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 3 non-empty blocks out of 4 blocks
[Executor task launch worker for task 10] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 2.0 (TID 10). 11134 bytes result sent to driver
[Executor task launch worker for task 11] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 2.0 (TID 11). 11091 bytes result sent to driver
[dispatcher-event-loop-0] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 4.0 in stage 2.0 (TID 12, localhost, executor driver, partition 4, PROCESS_LOCAL, 7983 bytes)
[Executor task launch worker for task 8] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 4 ms
[Executor task launch worker for task 12] INFO org.apache.spark.executor.Executor - Running task 4.0 in stage 2.0 (TID 12)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 5.0 in stage 2.0 (TID 13, localhost, executor driver, partition 5, PROCESS_LOCAL, 7983 bytes)
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 2.0 (TID 11) in 43 ms on localhost (executor driver) (1/8)
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 2.0 (TID 10) in 44 ms on localhost (executor driver) (2/8)
[Executor task launch worker for task 13] INFO org.apache.spark.executor.Executor - Running task 5.0 in stage 2.0 (TID 13)
[Executor task launch worker for task 12] INFO org.apache.spark.executor.Executor - Finished task 4.0 in stage 2.0 (TID 12). 10661 bytes result sent to driver
[dispatcher-event-loop-0] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 6.0 in stage 2.0 (TID 14, localhost, executor driver, partition 6, PROCESS_LOCAL, 7983 bytes)
[Executor task launch worker for task 13] INFO org.apache.spark.executor.Executor - Finished task 5.0 in stage 2.0 (TID 13). 10618 bytes result sent to driver
[Executor task launch worker for task 14] INFO org.apache.spark.executor.Executor - Running task 6.0 in stage 2.0 (TID 14)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 7.0 in stage 2.0 (TID 15, localhost, executor driver, partition 7, PROCESS_LOCAL, 7998 bytes)
[Executor task launch worker for task 9] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 2.0 (TID 9). 11091 bytes result sent to driver
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 5.0 in stage 2.0 (TID 13) in 17 ms on localhost (executor driver) (3/8)
[Executor task launch worker for task 15] INFO org.apache.spark.executor.Executor - Running task 7.0 in stage 2.0 (TID 15)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 4.0 in stage 2.0 (TID 12) in 21 ms on localhost (executor driver) (4/8)
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 2.0 (TID 9) in 62 ms on localhost (executor driver) (5/8)
[Executor task launch worker for task 15] INFO org.apache.spark.executor.Executor - Finished task 7.0 in stage 2.0 (TID 15). 10790 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 7.0 in stage 2.0 (TID 15) in 29 ms on localhost (executor driver) (6/8)
[Executor task launch worker for task 14] INFO org.apache.spark.executor.Executor - Finished task 6.0 in stage 2.0 (TID 14). 10661 bytes result sent to driver
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 6.0 in stage 2.0 (TID 14) in 40 ms on localhost (executor driver) (7/8)
[Executor task launch worker for task 8] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 2.0 (TID 8). 13710 bytes result sent to driver
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 2.0 (TID 8) in 198 ms on localhost (executor driver) (8/8)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 2.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ShuffleMapStage 2 (mapToPair at GroupCombineFunctions.java:59) finished in 0.248 s
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - looking for newly runnable stages
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - running: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - waiting: Set(ResultStage 3)
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - failed: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting ResultStage 3 (PAssert$0/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude).output MapPartitionsRDD[71] at values at TransformTranslator.java:400), which has no missing parents
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_3 stored as values in memory (estimated size 104.3 KB, free 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_3_piece0 stored as bytes in memory (estimated size 32.4 KB, free 13.5 GB)
[dispatcher-event-loop-0] INFO org.apache.spark.storage.BlockManagerInfo - Added broadcast_3_piece0 in memory on localhost:33537 (size: 32.4 KB, free: 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.SparkContext - Created broadcast 3 from broadcast at DAGScheduler.scala:1039
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting 4 missing tasks from ResultStage 3 (PAssert$0/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude).output MapPartitionsRDD[71] at values at TransformTranslator.java:400) (first 15 tasks are for partitions Vector(0, 1, 2, 3))
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Adding task set 3.0 with 4 tasks
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 3.0 (TID 16, localhost, executor driver, partition 1, NODE_LOCAL, 7649 bytes)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 3.0 (TID 17, localhost, executor driver, partition 0, PROCESS_LOCAL, 7649 bytes)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 3.0 (TID 18, localhost, executor driver, partition 2, PROCESS_LOCAL, 7649 bytes)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 3.0 in stage 3.0 (TID 19, localhost, executor driver, partition 3, PROCESS_LOCAL, 7649 bytes)
[Executor task launch worker for task 16] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 3.0 (TID 16)
[Executor task launch worker for task 17] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 3.0 (TID 17)
[Executor task launch worker for task 18] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 3.0 (TID 18)
[Executor task launch worker for task 19] INFO org.apache.spark.executor.Executor - Running task 3.0 in stage 3.0 (TID 19)
[Executor task launch worker for task 18] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 8 blocks
[Executor task launch worker for task 18] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 0 ms
[Executor task launch worker for task 16] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 2 non-empty blocks out of 8 blocks
[Executor task launch worker for task 16] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 17] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 8 blocks
[Executor task launch worker for task 17] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 19] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 8 blocks
[Executor task launch worker for task 19] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 0 ms
[Executor task launch worker for task 16] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 3.0 (TID 16). 19400 bytes result sent to driver
[Executor task launch worker for task 17] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 3.0 (TID 17). 13358 bytes result sent to driver
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 3.0 (TID 16) in 73 ms on localhost (executor driver) (1/4)
[Executor task launch worker for task 18] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 3.0 (TID 18). 13358 bytes result sent to driver
[Executor task launch worker for task 19] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 3.0 (TID 19). 13358 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 3.0 (TID 18) in 75 ms on localhost (executor driver) (2/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 3.0 (TID 17) in 86 ms on localhost (executor driver) (3/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 3.0 (TID 19) in 87 ms on localhost (executor driver) (4/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 3.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ResultStage 3 (foreach at BoundedDataset.java:117) finished in 0.122 s
[pool-1-thread-1] INFO org.apache.spark.scheduler.DAGScheduler - Job 0 finished: foreach at BoundedDataset.java:117, took 7.870278 s
[pool-1-thread-1] INFO org.apache.beam.runners.spark.SparkRunner - Batch pipeline execution complete.
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped!
[Test worker] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared
[Test worker] INFO org.apache.spark.storage.BlockManager - BlockManager stopped
[Test worker] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped!
[Test worker] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext
[Test worker] INFO org.apache.spark.SparkContext - SparkContext already stopped.
Finished generating test XML results (0.073 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.03 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark/build/reports/tests/test>
Packing task ':beam-runners-spark:test'
:beam-runners-spark:test (Thread[Task worker for ':' Thread 13,5,main]) completed. Took 1 mins 1.475 secs.
:beam-runners-spark:check (Thread[Task worker for ':',5,main]) started.
> Task :beam-runners-spark:check
Skipping task ':beam-runners-spark:check' as it has no actions.
:beam-runners-spark:check (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-spark:build (Thread[Task worker for ':',5,main]) started.
> Task :beam-runners-spark:build
Skipping task ':beam-runners-spark:build' as it has no actions.
:beam-runners-spark:build (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-spark:buildDependents (Thread[Task worker for ':',5,main]) started.
> Task :beam-runners-spark:buildDependents
Caching disabled for task ':beam-runners-spark:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-spark:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-spark:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-harness:compileJava'.
> Compilation failed with exit code 1; see the compiler error output for details.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 32s
317 actionable tasks: 312 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/uiqvldinzzjeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #945
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/945/display/redirect?page=changes>
Changes:
[yifanzou] [BEAM-4302] Add Jenkins job to check Beam dependencies and generate
------------------------------------------
[...truncated 4.30 MB...]
INFO: container-2 msg: [container-2] Exiting heartbeat loop..
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-2 terminating.
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-5
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-5 msg: [container-5] Exiting heartbeat loop..
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-5 terminating.
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-4
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-4 msg: [container-4] Exiting heartbeat loop..
Jun 26, 2018 6:53:02 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-4 terminating.
Gradle Test Executor 63 finished executing tests.
> Task :beam-runners-spark:test
[Thread-5] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[Thread-5] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-89736a86-07f0-4863-9c18-384bde769f9e
[Thread-5] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called
[Thread-5] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-0cb8753a-59a4-4bab-a97b-c57b64a54cb7
Starting process 'Gradle Test Executor 65'. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark> Command: /usr/local/asfpackages/java/jdk1.8.0_152/bin/java -Dbeam.spark.test.reuseSparkContext=true -DbeamTestPipelineOptions=[
"--runner=TestSparkRunner",
"--streaming=false",
"--enableSparkMetricSinks=true"
] -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Dorg.gradle.native=false -Dspark.ui.enabled=false -Dspark.ui.showConsoleProgress=false -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/4.8/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 65'
Successfully started process 'Gradle Test Executor 65'
Gradle Test Executor 65 started executing tests.
Gradle Test Executor 65 finished executing tests.
Gradle Test Executor 66 started executing tests.
Gradle Test Executor 66 finished executing tests.
> Task :beam-runners-spark:test
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.25/8dacf9514f0c707cbbcdd6fd699e8940d42fb54e/slf4j-simple-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/jenkins/.m2/repository/org/slf4j/slf4j-log4j12/1.7.25/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
Starting process 'Gradle Test Executor 66'. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark> Command: /usr/local/asfpackages/java/jdk1.8.0_152/bin/java -Dbeam.spark.test.reuseSparkContext=true -DbeamTestPipelineOptions=[
"--runner=TestSparkRunner",
"--streaming=false",
"--enableSparkMetricSinks=true"
] -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Dorg.gradle.native=false -Dspark.ui.enabled=false -Dspark.ui.showConsoleProgress=false -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/4.8/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 66'
Successfully started process 'Gradle Test Executor 66'
Finished generating test XML results (0.012 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.012 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark/build/reports/tests/test>
Packing task ':beam-runners-spark:test'
:beam-runners-spark:test (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 31.022 secs.
:beam-runners-spark:check (Thread[Task worker for ':' Thread 6,5,main]) started.
> Task :beam-runners-spark:check
Skipping task ':beam-runners-spark:check' as it has no actions.
:beam-runners-spark:check (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:beam-runners-spark:build (Thread[Task worker for ':' Thread 6,5,main]) started.
> Task :beam-runners-spark:build
Skipping task ':beam-runners-spark:build' as it has no actions.
:beam-runners-spark:build (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:beam-runners-spark:buildDependents (Thread[Task worker for ':' Thread 6,5,main]) started.
> Task :beam-runners-spark:buildDependents
Caching disabled for task ':beam-runners-spark:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-spark:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-spark:buildDependents (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.0 secs.
> Task :beam-runners-apex:test
Jun 26, 2018 6:53:02 PM com.datatorrent.bufferserver.server.Server$1 run
INFO: Server stopped listening at /0:0:0:0:0:0:0:0:38877
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.StramLocalCluster run
WARNING: Event loop OptimizedEventLoop@19eb67b{id=ProcessWideEventLoop, active=true, refCount=1, head=496, tail=496, capacity=1024} is still active
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.StramLocalCluster run
INFO: Application finished.
org.apache.beam.runners.apex.translation.ParDoTranslatorTest > testAssertionFailure SKIPPED
org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest > testReadBounded STANDARD_ERROR
Jun 26, 2018 6:53:03 PM com.datatorrent.common.util.AsyncFSStorageAgent save
INFO: using /tmp/chkp4718330568463954997 as the basepath for checkpointing.
Jun 26, 2018 6:53:03 PM com.datatorrent.bufferserver.storage.DiskStorage <init>
INFO: using /tmp as the basepath for spooling.
Jun 26, 2018 6:53:03 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest testReadBounded
INFO: Waiting for expected results.
Jun 26, 2018 6:53:03 PM com.datatorrent.bufferserver.server.Server registered
INFO: Server started listening at /0:0:0:0:0:0:0:0:42257
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.StramLocalCluster run
INFO: Buffer server started: localhost:42257
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-0
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-1
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-0 msg: [container-0] Entering heartbeat loop..
Jun 26, 2018 6:53:03 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Entering heartbeat loop..
Jun 26, 2018 6:53:04 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest testReadBounded
INFO: Waiting for expected results.
Jun 26, 2018 6:53:04 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=2,name=ParDo(EmbeddedCollector)/ParMultiDo(EmbeddedCollector),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream0,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[]]]
Jun 26, 2018 6:53:04 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=1,name=GenerateSequence/Read(BoundedCountingSource),type=INPUT,checkpoint={ffffffffffffffff, 0, 0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream0,bufferServer=localhost]]]]
Jun 26, 2018 6:53:04 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:42257/1.output.1, windowId=ffffffffffffffff, type=stream0/2.input, upstreamIdentifier=1.output.1, mask=0, partitions=null, bufferSize=1024}
Jun 26, 2018 6:53:04 PM com.datatorrent.stram.engine.WindowGenerator activate
INFO: Catching up from 1530039183500 to 1530039184406
Jun 26, 2018 6:53:04 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=1.output.1, windowId=ffffffffffffffff}
org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest > test STANDARD_ERROR
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:05 PM com.datatorrent.common.util.AsyncFSStorageAgent save
INFO: using /tmp/chkp8578475302490889445 as the basepath for checkpointing.
Jun 26, 2018 6:53:05 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest test
INFO: Waiting for expected results.
Jun 26, 2018 6:53:05 PM com.datatorrent.bufferserver.storage.DiskStorage <init>
INFO: using /tmp as the basepath for spooling.
Jun 26, 2018 6:53:05 PM com.datatorrent.bufferserver.server.Server registered
INFO: Server started listening at /0:0:0:0:0:0:0:0:41913
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.StramLocalCluster run
INFO: Buffer server started: localhost:41913
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-0
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-0 msg: [container-0] Entering heartbeat loop..
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-1
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Entering heartbeat loop..
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.engine.Node emitEndStream
INFO: 1 sending EndOfStream
Jun 26, 2018 6:53:05 PM com.datatorrent.stram.engine.Node emitEndStream
INFO: 2 sending EndOfStream
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Undeploy request: [2]
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.StreamingContainer undeploy
INFO: Undeploy complete.
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Undeploy request: [1]
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.StreamingContainer undeploy
INFO: Undeploy complete.
Jun 26, 2018 6:53:06 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln LogicalNode@2b7cbff6identifier=tcp://localhost:42257/1.output.1, upstream=1.output.1, group=stream0/2.input, partitions=[], iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@2f433e41{da=com.datatorrent.bufferserver.internal.DataList$Block@6a41b5cd{identifier=1.output.1, data=1048576, readingOffset=0, writingOffset=274, starting_window=5b328b8f00000001, ending_window=5b328b8f00000005, refCount=2, uniqueIdentifier=0, next=null, future=null}}} from dl DataList@152c7769[identifier=1.output.1]
Jun 26, 2018 6:53:06 PM org.apache.beam.runners.apex.translation.ReadUnboundTranslatorTest test
INFO: Waiting for expected results.
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.StreamingContainer heartbeatLoop
INFO: Waiting for pending request.
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=1,name=Read(CollectionSource),type=INPUT,checkpoint={ffffffffffffffff, 0, 0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream0,bufferServer=localhost]]]]
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.WindowGenerator activate
INFO: Catching up from 1530039185500 to 1530039186469
Jun 26, 2018 6:53:06 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=1.output.1, windowId=ffffffffffffffff}
Jun 26, 2018 6:53:06 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Deploy request: [OperatorDeployInfo[id=2,name=ParDo(EmbeddedCollector)/ParMultiDo(EmbeddedCollector),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream0,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[]]]
Jun 26, 2018 6:53:06 PM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:41913/1.output.1, windowId=ffffffffffffffff, type=stream0/2.input, upstreamIdentifier=1.output.1, mask=0, partitions=null, bufferSize=1024}
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-1
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.StreamingContainerManager processHeartbeat
INFO: requesting idle shutdown for container container-0
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Exiting heartbeat loop..
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-1 terminating.
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse
INFO: Received shutdown request type ABORT
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-0 msg: [container-0] Exiting heartbeat loop..
Jun 26, 2018 6:53:07 PM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-0 terminating.
Gradle Test Executor 48 finished executing tests.
> Task :beam-runners-apex:test
Finished generating test XML results (0.002 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/apex/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.003 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/apex/build/reports/tests/test>
Packing task ':beam-runners-apex:test'
:beam-runners-apex:test (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 42.906 secs.
:beam-runners-apex:check (Thread[Task worker for ':' Thread 2,5,main]) started.
> Task :beam-runners-apex:check
Skipping task ':beam-runners-apex:check' as it has no actions.
:beam-runners-apex:check (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-runners-apex:build (Thread[Task worker for ':' Thread 3,5,main]) started.
> Task :beam-runners-apex:build
Skipping task ':beam-runners-apex:build' as it has no actions.
:beam-runners-apex:build (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-runners-apex:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) started.
> Task :beam-runners-apex:buildDependents
Caching disabled for task ':beam-runners-apex:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-apex:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-apex:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-harness:compileJava'.
> Compilation failed with exit code 1; see the compiler error output for details.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 41s
317 actionable tasks: 315 executed, 2 from cache
Publishing build scan...
https://gradle.com/s/gvskipeqldwuy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com