You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/06/26 19:06:07 UTC
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #946
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/946/display/redirect?page=changes>
Changes:
[altay] improvements to fanout
------------------------------------------
[...truncated 4.40 MB...]
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/spark-launcher_2.11-2.3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/javax.inject-2.4.0-b34.jar with timestamp 1530039947775
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/javax.inject-2.4.0-b34.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp6726803596282427810.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/javax.inject-2.4.0-b34.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded.jar with timestamp 1530039947734
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp4732580965290437234.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/hadoop-mapreduce-client-common-2.7.3.jar with timestamp 1530039947753
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/hadoop-mapreduce-client-common-2.7.3.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp5356990084138591126.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/hadoop-mapreduce-client-common-2.7.3.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/servlet-api-2.5.jar with timestamp 1530039947766
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/servlet-api-2.5.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp932520885094701482.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/servlet-api-2.5.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/curator-client-2.7.1.jar with timestamp 1530039947755
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/curator-client-2.7.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp2421066044382384793.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/curator-client-2.7.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/osgi-resource-locator-1.0.1.jar with timestamp 1530039947776
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/osgi-resource-locator-1.0.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp4542872723753945653.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/osgi-resource-locator-1.0.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/hadoop-yarn-server-nodemanager-2.7.3.jar with timestamp 1530039947754
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/hadoop-yarn-server-nodemanager-2.7.3.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp9045144490942482936.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/hadoop-yarn-server-nodemanager-2.7.3.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/objenesis-2.6.jar with timestamp 1530039947750
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/objenesis-2.6.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp7630981781920912917.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/objenesis-2.6.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/compress-lzf-1.0.3.jar with timestamp 1530039947761
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/compress-lzf-1.0.3.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp8141468576532237876.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/compress-lzf-1.0.3.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/commons-net-3.1.jar with timestamp 1530039947761
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/commons-net-3.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp1286390574321688776.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/commons-net-3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/minlog-1.3.0.jar with timestamp 1530039947777
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/minlog-1.3.0.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp4075716602660721648.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/minlog-1.3.0.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/htrace-core-3.1.0-incubating.jar with timestamp 1530039947768
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/htrace-core-3.1.0-incubating.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp1359197864037722260.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/htrace-core-3.1.0-incubating.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/jersey-core-1.9.jar with timestamp 1530039947767
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/jersey-core-1.9.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp3788708924688861673.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/jersey-core-1.9.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/asm-3.1.jar with timestamp 1530039947777
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/asm-3.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp3727929162498825825.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/asm-3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/commons-httpclient-3.1.jar with timestamp 1530039947765
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/commons-httpclient-3.1.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp5620045701955486426.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/commons-httpclient-3.1.jar to class loader
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Fetching spark://localhost:46327/jars/chill-java-0.8.4.jar with timestamp 1530039947757
[Executor task launch worker for task 0] INFO org.apache.spark.util.Utils - Fetching spark://localhost:46327/jars/chill-java-0.8.4.jar to /tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/fetchFileTemp2849564941677363240.tmp
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Adding file:/tmp/spark-4ea4a4d7-4727-4cc2-840b-c5051a0892d3/userFiles-48f9da03-b82b-4d41-9bf2-a6652a519a46/chill-java-0.8.4.jar to class loader
Gradle Test Executor 66 started executing tests.
Gradle Test Executor 66 finished executing tests.
Gradle Test Executor 64 finished executing tests.
> Task :beam-runners-spark:test
[Executor task launch worker for task 3] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 0.0 (TID 3). 7486 bytes result sent to driver
[Executor task launch worker for task 1] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 0.0 (TID 1). 6627 bytes result sent to driver
[Executor task launch worker for task 2] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 0.0 (TID 2). 6670 bytes result sent to driver
[Executor task launch worker for task 0] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 0.0 (TID 0). 6627 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 0.0 (TID 2) in 6576 ms on localhost (executor driver) (1/4)
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 0.0 (TID 1) in 6609 ms on localhost (executor driver) (2/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 0.0 (TID 0) in 6661 ms on localhost (executor driver) (3/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 0.0 (TID 3) in 6591 ms on localhost (executor driver) (4/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 0.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ShuffleMapStage 0 (mapToPair at GroupCombineFunctions.java:184) finished in 6.996 s
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - looking for newly runnable stages
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - running: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - waiting: Set(ShuffleMapStage 1, ShuffleMapStage 2, ResultStage 3)
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - failed: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting ShuffleMapStage 1 (MapPartitionsRDD[28] at mapToPair at GroupCombineFunctions.java:59), which has no missing parents
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_1 stored as values in memory (estimated size 84.2 KB, free 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_1_piece0 stored as bytes in memory (estimated size 25.4 KB, free 13.5 GB)
[dispatcher-event-loop-3] INFO org.apache.spark.storage.BlockManagerInfo - Added broadcast_1_piece0 in memory on localhost:33537 (size: 25.4 KB, free: 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.SparkContext - Created broadcast 1 from broadcast at DAGScheduler.scala:1039
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting 4 missing tasks from ShuffleMapStage 1 (MapPartitionsRDD[28] at mapToPair at GroupCombineFunctions.java:59) (first 15 tasks are for partitions Vector(0, 1, 2, 3))
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Adding task set 1.0 with 4 tasks
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 1.0 (TID 4, localhost, executor driver, partition 0, NODE_LOCAL, 7638 bytes)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 1.0 (TID 5, localhost, executor driver, partition 2, NODE_LOCAL, 7638 bytes)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 3.0 in stage 1.0 (TID 6, localhost, executor driver, partition 3, NODE_LOCAL, 7638 bytes)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 1.0 (TID 7, localhost, executor driver, partition 1, PROCESS_LOCAL, 7638 bytes)
[Executor task launch worker for task 4] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 1.0 (TID 4)
[Executor task launch worker for task 5] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 1.0 (TID 5)
[Executor task launch worker for task 6] INFO org.apache.spark.executor.Executor - Running task 3.0 in stage 1.0 (TID 6)
[Executor task launch worker for task 7] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 1.0 (TID 7)
[Executor task launch worker for task 6] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 1 non-empty blocks out of 4 blocks
[Executor task launch worker for task 5] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 4 non-empty blocks out of 4 blocks
[Executor task launch worker for task 4] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 2 non-empty blocks out of 4 blocks
[Executor task launch worker for task 5] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 9 ms
[Executor task launch worker for task 4] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 9 ms
[Executor task launch worker for task 6] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 9 ms
[Executor task launch worker for task 7] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 7] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 7] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 1.0 (TID 7). 7615 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 1.0 (TID 7) in 158 ms on localhost (executor driver) (1/4)
[Executor task launch worker for task 5] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 1.0 (TID 5). 11385 bytes result sent to driver
[Executor task launch worker for task 6] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 1.0 (TID 6). 11385 bytes result sent to driver
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 1.0 (TID 5) in 168 ms on localhost (executor driver) (2/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 1.0 (TID 6) in 169 ms on localhost (executor driver) (3/4)
[Executor task launch worker for task 4] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 1.0 (TID 4). 11385 bytes result sent to driver
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 1.0 (TID 4) in 178 ms on localhost (executor driver) (4/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 1.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ShuffleMapStage 1 (mapToPair at GroupCombineFunctions.java:59) finished in 0.197 s
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - looking for newly runnable stages
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - running: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - waiting: Set(ShuffleMapStage 2, ResultStage 3)
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - failed: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting ShuffleMapStage 2 (MapPartitionsRDD[50] at mapToPair at GroupCombineFunctions.java:59), which has no missing parents
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_2 stored as values in memory (estimated size 94.1 KB, free 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_2_piece0 stored as bytes in memory (estimated size 28.4 KB, free 13.5 GB)
[dispatcher-event-loop-2] INFO org.apache.spark.storage.BlockManagerInfo - Added broadcast_2_piece0 in memory on localhost:33537 (size: 28.4 KB, free: 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.SparkContext - Created broadcast 2 from broadcast at DAGScheduler.scala:1039
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting 8 missing tasks from ShuffleMapStage 2 (MapPartitionsRDD[50] at mapToPair at GroupCombineFunctions.java:59) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7))
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Adding task set 2.0 with 8 tasks
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 3.0 in stage 2.0 (TID 8, localhost, executor driver, partition 3, NODE_LOCAL, 7777 bytes)
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 2.0 (TID 9, localhost, executor driver, partition 0, PROCESS_LOCAL, 7777 bytes)
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 2.0 (TID 10, localhost, executor driver, partition 1, PROCESS_LOCAL, 7777 bytes)
[dispatcher-event-loop-3] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 2.0 (TID 11, localhost, executor driver, partition 2, PROCESS_LOCAL, 7777 bytes)
[Executor task launch worker for task 9] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 2.0 (TID 9)
[Executor task launch worker for task 8] INFO org.apache.spark.executor.Executor - Running task 3.0 in stage 2.0 (TID 8)
[Executor task launch worker for task 10] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 2.0 (TID 10)
[Executor task launch worker for task 11] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 2.0 (TID 11)
[Executor task launch worker for task 11] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 10] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 10] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 9] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 4 blocks
[Executor task launch worker for task 9] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 0 ms
[Executor task launch worker for task 11] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 4 ms
[Executor task launch worker for task 8] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 3 non-empty blocks out of 4 blocks
[Executor task launch worker for task 10] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 2.0 (TID 10). 11134 bytes result sent to driver
[Executor task launch worker for task 11] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 2.0 (TID 11). 11091 bytes result sent to driver
[dispatcher-event-loop-0] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 4.0 in stage 2.0 (TID 12, localhost, executor driver, partition 4, PROCESS_LOCAL, 7983 bytes)
[Executor task launch worker for task 8] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 4 ms
[Executor task launch worker for task 12] INFO org.apache.spark.executor.Executor - Running task 4.0 in stage 2.0 (TID 12)
[dispatcher-event-loop-1] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 5.0 in stage 2.0 (TID 13, localhost, executor driver, partition 5, PROCESS_LOCAL, 7983 bytes)
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 2.0 (TID 11) in 43 ms on localhost (executor driver) (1/8)
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 2.0 (TID 10) in 44 ms on localhost (executor driver) (2/8)
[Executor task launch worker for task 13] INFO org.apache.spark.executor.Executor - Running task 5.0 in stage 2.0 (TID 13)
[Executor task launch worker for task 12] INFO org.apache.spark.executor.Executor - Finished task 4.0 in stage 2.0 (TID 12). 10661 bytes result sent to driver
[dispatcher-event-loop-0] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 6.0 in stage 2.0 (TID 14, localhost, executor driver, partition 6, PROCESS_LOCAL, 7983 bytes)
[Executor task launch worker for task 13] INFO org.apache.spark.executor.Executor - Finished task 5.0 in stage 2.0 (TID 13). 10618 bytes result sent to driver
[Executor task launch worker for task 14] INFO org.apache.spark.executor.Executor - Running task 6.0 in stage 2.0 (TID 14)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 7.0 in stage 2.0 (TID 15, localhost, executor driver, partition 7, PROCESS_LOCAL, 7998 bytes)
[Executor task launch worker for task 9] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 2.0 (TID 9). 11091 bytes result sent to driver
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 5.0 in stage 2.0 (TID 13) in 17 ms on localhost (executor driver) (3/8)
[Executor task launch worker for task 15] INFO org.apache.spark.executor.Executor - Running task 7.0 in stage 2.0 (TID 15)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 4.0 in stage 2.0 (TID 12) in 21 ms on localhost (executor driver) (4/8)
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 2.0 (TID 9) in 62 ms on localhost (executor driver) (5/8)
[Executor task launch worker for task 15] INFO org.apache.spark.executor.Executor - Finished task 7.0 in stage 2.0 (TID 15). 10790 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 7.0 in stage 2.0 (TID 15) in 29 ms on localhost (executor driver) (6/8)
[Executor task launch worker for task 14] INFO org.apache.spark.executor.Executor - Finished task 6.0 in stage 2.0 (TID 14). 10661 bytes result sent to driver
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 6.0 in stage 2.0 (TID 14) in 40 ms on localhost (executor driver) (7/8)
[Executor task launch worker for task 8] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 2.0 (TID 8). 13710 bytes result sent to driver
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 2.0 (TID 8) in 198 ms on localhost (executor driver) (8/8)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 2.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ShuffleMapStage 2 (mapToPair at GroupCombineFunctions.java:59) finished in 0.248 s
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - looking for newly runnable stages
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - running: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - waiting: Set(ResultStage 3)
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - failed: Set()
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting ResultStage 3 (PAssert$0/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude).output MapPartitionsRDD[71] at values at TransformTranslator.java:400), which has no missing parents
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_3 stored as values in memory (estimated size 104.3 KB, free 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.storage.memory.MemoryStore - Block broadcast_3_piece0 stored as bytes in memory (estimated size 32.4 KB, free 13.5 GB)
[dispatcher-event-loop-0] INFO org.apache.spark.storage.BlockManagerInfo - Added broadcast_3_piece0 in memory on localhost:33537 (size: 32.4 KB, free: 13.5 GB)
[dag-scheduler-event-loop] INFO org.apache.spark.SparkContext - Created broadcast 3 from broadcast at DAGScheduler.scala:1039
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - Submitting 4 missing tasks from ResultStage 3 (PAssert$0/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude).output MapPartitionsRDD[71] at values at TransformTranslator.java:400) (first 15 tasks are for partitions Vector(0, 1, 2, 3))
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Adding task set 3.0 with 4 tasks
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 1.0 in stage 3.0 (TID 16, localhost, executor driver, partition 1, NODE_LOCAL, 7649 bytes)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 0.0 in stage 3.0 (TID 17, localhost, executor driver, partition 0, PROCESS_LOCAL, 7649 bytes)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 2.0 in stage 3.0 (TID 18, localhost, executor driver, partition 2, PROCESS_LOCAL, 7649 bytes)
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.TaskSetManager - Starting task 3.0 in stage 3.0 (TID 19, localhost, executor driver, partition 3, PROCESS_LOCAL, 7649 bytes)
[Executor task launch worker for task 16] INFO org.apache.spark.executor.Executor - Running task 1.0 in stage 3.0 (TID 16)
[Executor task launch worker for task 17] INFO org.apache.spark.executor.Executor - Running task 0.0 in stage 3.0 (TID 17)
[Executor task launch worker for task 18] INFO org.apache.spark.executor.Executor - Running task 2.0 in stage 3.0 (TID 18)
[Executor task launch worker for task 19] INFO org.apache.spark.executor.Executor - Running task 3.0 in stage 3.0 (TID 19)
[Executor task launch worker for task 18] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 8 blocks
[Executor task launch worker for task 18] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 0 ms
[Executor task launch worker for task 16] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 2 non-empty blocks out of 8 blocks
[Executor task launch worker for task 16] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 17] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 8 blocks
[Executor task launch worker for task 17] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 1 ms
[Executor task launch worker for task 19] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Getting 0 non-empty blocks out of 8 blocks
[Executor task launch worker for task 19] INFO org.apache.spark.storage.ShuffleBlockFetcherIterator - Started 0 remote fetches in 0 ms
[Executor task launch worker for task 16] INFO org.apache.spark.executor.Executor - Finished task 1.0 in stage 3.0 (TID 16). 19400 bytes result sent to driver
[Executor task launch worker for task 17] INFO org.apache.spark.executor.Executor - Finished task 0.0 in stage 3.0 (TID 17). 13358 bytes result sent to driver
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 1.0 in stage 3.0 (TID 16) in 73 ms on localhost (executor driver) (1/4)
[Executor task launch worker for task 18] INFO org.apache.spark.executor.Executor - Finished task 2.0 in stage 3.0 (TID 18). 13358 bytes result sent to driver
[Executor task launch worker for task 19] INFO org.apache.spark.executor.Executor - Finished task 3.0 in stage 3.0 (TID 19). 13358 bytes result sent to driver
[task-result-getter-1] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 2.0 in stage 3.0 (TID 18) in 75 ms on localhost (executor driver) (2/4)
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 0.0 in stage 3.0 (TID 17) in 86 ms on localhost (executor driver) (3/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - Finished task 3.0 in stage 3.0 (TID 19) in 87 ms on localhost (executor driver) (4/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSchedulerImpl - Removed TaskSet 3.0, whose tasks have all completed, from pool
[dag-scheduler-event-loop] INFO org.apache.spark.scheduler.DAGScheduler - ResultStage 3 (foreach at BoundedDataset.java:117) finished in 0.122 s
[pool-1-thread-1] INFO org.apache.spark.scheduler.DAGScheduler - Job 0 finished: foreach at BoundedDataset.java:117, took 7.870278 s
[pool-1-thread-1] INFO org.apache.beam.runners.spark.SparkRunner - Batch pipeline execution complete.
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped!
[Test worker] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared
[Test worker] INFO org.apache.spark.storage.BlockManager - BlockManager stopped
[Test worker] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped!
[Test worker] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext
[Test worker] INFO org.apache.spark.SparkContext - SparkContext already stopped.
Finished generating test XML results (0.073 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.03 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/spark/build/reports/tests/test>
Packing task ':beam-runners-spark:test'
:beam-runners-spark:test (Thread[Task worker for ':' Thread 13,5,main]) completed. Took 1 mins 1.475 secs.
:beam-runners-spark:check (Thread[Task worker for ':',5,main]) started.
> Task :beam-runners-spark:check
Skipping task ':beam-runners-spark:check' as it has no actions.
:beam-runners-spark:check (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-spark:build (Thread[Task worker for ':',5,main]) started.
> Task :beam-runners-spark:build
Skipping task ':beam-runners-spark:build' as it has no actions.
:beam-runners-spark:build (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-spark:buildDependents (Thread[Task worker for ':',5,main]) started.
> Task :beam-runners-spark:buildDependents
Caching disabled for task ':beam-runners-spark:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-spark:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-spark:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-harness:compileJava'.
> Compilation failed with exit code 1; see the compiler error output for details.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 32s
317 actionable tasks: 312 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/uiqvldinzzjeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Jenkins build is back to normal : beam_PostCommit_Java_GradleBuild
#947
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/947/display/redirect?page=changes>