You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/11/03 00:21:07 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #998
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/998/display/redirect>
------------------------------------------
[...truncated 22.98 MB...]
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@7db5c2b4) 3e79960d333dcf2df858e63c7fd80994.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@7db5c2b4) ba6532c7c0f884e49d78ae1045d30576.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@7db5c2b4) (11/16) (4059bf8e7d920b54370289dc3acd5c13) switched from RUNNING to FINISHED.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@7db5c2b4) (15/16) (3e79960d333dcf2df858e63c7fd80994) switched from RUNNING to FINISHED.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@7db5c2b4) (9/16) (ba6532c7c0f884e49d78ae1045d30576) switched from RUNNING to FINISHED.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job run-jenkins-1103002055-45cde162 (30ef739936dafa90bba6ff9f92220129) switched from state RUNNING to FINISHED.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job 30ef739936dafa90bba6ff9f92220129 reached globally terminal state FINISHED.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.jobmaster.JobMaster postStop
INFO: Stopping the JobMaster for job run-jenkins-1103002055-45cde162(30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor closeJobManagerConnection
INFO: Close JobManager connection for job 30ef739936dafa90bba6ff9f92220129.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 4a692f3ca87fc9583a88552ac434ab78: JobManager is shutting down..
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPool suspend
INFO: Suspending SlotPool.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager a51c03c3a21dd2002673014528dc43fd@akka://flink/user/jobmanager_25 for job 30ef739936dafa90bba6ff9f92220129 from the resource manager.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPool postStop
INFO: Stopping SlotPool.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.minicluster.MiniCluster closeAsync
INFO: Shutting down Flink Mini Cluster
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.rest.RestServerEndpoint closeAsync
INFO: Shutting down rest endpoint.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.dispatcher.Dispatcher postStop
INFO: Stopping dispatcher akka://flink/user/dispatchercbdfcc66-6d58-4464-8ac8-16bb02c1c188.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateJobManagerRunners
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/dispatchercbdfcc66-6d58-4464-8ac8-16bb02c1c188.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO: JobManager for job 30ef739936dafa90bba6ff9f92220129 with leader id a51c03c3a21dd2002673014528dc43fd lost leadership.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:14, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{220bcc1522cd39e286503f6391af3cee}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager close
INFO: Closing the SlotManager.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager suspend
INFO: Suspending the SlotManager.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager unregisterTaskManager
INFO: Unregister TaskManager 73c35bb26f8730ba492d2db037841547 from the SlotManager.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:5, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{7b2fd0b150f2b187d3779790407fbef4}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:3, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{a282727b2673833a8419987d5c014ff3}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:9, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{a5bde6e3f532581d36f0b979657ade7c}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:6, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{38f5a0096b071402355a59819e5eca0a}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:11, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{4da9db66804c197bd1bcf8484dc967a2}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:8, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{92ae899fc59964f756609dd582050477}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:10, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{9dfd5c6cd1682ff813a974997dd23043}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:7, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{91453c56911ab0fbb6b94982c489d0a3}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:2, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{16f902fc5a28fc18c08bffeb0cf1ffb3}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:15, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{670615693b70bc3403ec21503d2b9791}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:13, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{c6501d014234002740799efb2180a15b}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:12, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{50c462b54550ef455548216c738fe892}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{d1f40b1a8dbbb7f8a39aaa2a57b372f4}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:1, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{69cffb4d5334ff0d18be945bb0644f44}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:4, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{9e80b43087ee9b2081ee90f2370b41bd}, jobId: 30ef739936dafa90bba6ff9f92220129).
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.JobLeaderService removeJob
INFO: Remove job 30ef739936dafa90bba6ff9f92220129 from job leader monitoring.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor closeJobManagerConnection
INFO: Close JobManager connection for job 30ef739936dafa90bba6ff9f92220129.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor postStop
INFO: Stopping TaskExecutor akka://flink/user/taskmanager_24.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator shutDown
INFO: Shutting down stack trace sample coordinator.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$4
INFO: Removing cache directory /tmp/flink-web-ui
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$postStop$0
INFO: Stopped dispatcher akka://flink/user/dispatchercbdfcc66-6d58-4464-8ac8-16bb02c1c188.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.io.disk.iomanager.IOManager shutdown
INFO: I/O manager removed spill file directory /tmp/flink-io-5981c766-d860-402e-be12-de03133415fa
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.io.network.NetworkEnvironment shutdown
INFO: Shutting down the network environment and its components.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.JobLeaderService stop
INFO: Stop job leader service.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.taskexecutor.TaskExecutor postStop
INFO: Stopped TaskExecutor akka://flink/user/taskmanager_24.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:37027
Nov 03, 2018 12:21:01 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$4
INFO: Stopped Akka RPC service.
Nov 03, 2018 12:21:01 AM org.apache.beam.runners.flink.FlinkRunner createPipelineResult
INFO: Execution finished in 5960 msecs
Nov 03, 2018 12:21:01 AM org.apache.beam.runners.flink.FlinkRunner createPipelineResult
INFO: Final accumulator values:
Nov 03, 2018 12:21:01 AM org.apache.beam.runners.flink.FlinkRunner createPipelineResult
INFO: __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@c8a73919
2018-11-03T00:21:01.850Z Waiting for main pipeline to 'finish'
2018-11-03T00:21:01.850Z DONE Query12
2018-11-03T00:21:01.850Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
==========================================================================================
Run started 2018-11-03T00:19:28.660Z and ran for PT93.190S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 2.3 42826.6 100000
0001 1.1 93985.0 92000
0002 0.7 140252.5 351
0003 9.9 10142.0 580
0004 6.0 1679.0 40
0005 5.8 17268.2 12
0006 5.3 1881.5 103
0007 7.1 14156.3 1
0008 6.5 15460.7 6000
0009 7.9 1261.4 298
0010 5.7 17485.6 1
0011 8.2 12147.7 1919
0012 5.8 17140.9 1919
0013 *** not run ***
==========================================================================================
Nov 03, 2018 12:21:01 AM org.apache.beam.runners.flink.FlinkRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 168 files. Enable logging at DEBUG level to see which files will be staged.
2018-11-03T00:21:01.853Z Generating 100000 events in batch mode
==========================================================================================
Run started 2018-11-03T00:19:28.660Z and ran for PT93.200S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
Exception in thread "main" 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 2.3 42826.6 100000
0001 1.1 93985.0 92000
0002 0.7 140252.5 351
0003 9.9 10142.0 580
0004 6.0 1679.0 40
0005 5.8 17268.2 12
0006 5.3 1881.5 103
0007 7.1 14156.3 1
0008 6.5 15460.7 6000
0009 7.9 1261.4 298
0010 5.7 17485.6 1
0011 8.2 12147.7 1919
0012 5.8 17140.9 1919
0013 *** not run ***
==========================================================================================
java.lang.RuntimeException: java.lang.IllegalStateException: Configuration error: side input is null
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
Caused by: java.lang.IllegalStateException: Configuration error: side input is null
at org.apache.beam.repackaged.beam_sdks_java_nexmark.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.nexmark.queries.BoundedSideInputJoin.applyTyped(BoundedSideInputJoin.java:50)
at org.apache.beam.sdk.nexmark.queries.BoundedSideInputJoin.applyPrim(BoundedSideInputJoin.java:81)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:267)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:45)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1144)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 1 mins 36.66 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 41s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/fsv7tul6pykbg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Flink #1000
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/1000/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #999
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/999/display/redirect?page=changes>
Changes:
[valentyn] Disambiguate between snappy and python-snappy PyPi packages in test
------------------------------------------
[...truncated 22.92 MB...]
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@75e07f2c) 9ec42e39cede969bbd48f2c229078786.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@75e07f2c) (6/16) (84f0e48c5dd92315f90fd93d1e6ac036) switched from RUNNING to FINISHED.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@75e07f2c) 7ddc4f28cd989bc3ec615489fd99557c.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@75e07f2c) (3/16) (9ec42e39cede969bbd48f2c229078786) switched from RUNNING to FINISHED.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (org.apache.flink.api.java.io.DiscardingOutputFormat@75e07f2c) (10/16) (7ddc4f28cd989bc3ec615489fd99557c) switched from RUNNING to FINISHED.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job run-jenkins-1103010701-50b86a6c (a383d791abd7344de9cb95b162895683) switched from state RUNNING to FINISHED.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job a383d791abd7344de9cb95b162895683 reached globally terminal state FINISHED.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.jobmaster.JobMaster postStop
INFO: Stopping the JobMaster for job run-jenkins-1103010701-50b86a6c(a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutor closeJobManagerConnection
INFO: Close JobManager connection for job a383d791abd7344de9cb95b162895683.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection a3b7d25d98a114a606021e305ca333a4: JobManager is shutting down..
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPool suspend
INFO: Suspending SlotPool.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager b01f113979d806750373635f56744821@akka://flink/user/jobmanager_25 for job a383d791abd7344de9cb95b162895683 from the resource manager.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPool postStop
INFO: Stopping SlotPool.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.minicluster.MiniCluster closeAsync
INFO: Shutting down Flink Mini Cluster
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO: JobManager for job a383d791abd7344de9cb95b162895683 with leader id b01f113979d806750373635f56744821 lost leadership.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.rest.RestServerEndpoint closeAsync
INFO: Shutting down rest endpoint.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.dispatcher.Dispatcher postStop
INFO: Stopping dispatcher akka://flink/user/dispatcher0400d956-aefc-42de-af90-31a67aadc9f6.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:10, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{09039e7a4c4b1b6cdee1db452c665bc4}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateJobManagerRunners
INFO: Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher0400d956-aefc-42de-af90-31a67aadc9f6.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager close
INFO: Closing the SlotManager.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager suspend
INFO: Suspending the SlotManager.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager unregisterTaskManager
INFO: Unregister TaskManager 8a995093c305962390f609ff769a1664 from the SlotManager.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:15, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{3ad60aeb4e944127f524452ec38eadfd}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:4, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{f3f676cb6146cc59ffb94ac35e70c334}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:8, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{496dc18d6e2dc57f27b54c3e39675326}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:6, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{d8547294ad26fe946fd565f994406b46}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:13, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{8600b90941280875ee0d7ad527710366}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:12, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{f0951a5729a5e6d2579ed41b2efea8d3}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:3, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{13c05f29e71617123a982a6e354c8a60}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:5, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{a14e9cd65b2a7d7bdee131308f193932}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator shutDown
INFO: Shutting down stack trace sample coordinator.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$postStop$0
INFO: Stopped dispatcher akka://flink/user/dispatcher0400d956-aefc-42de-af90-31a67aadc9f6.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{f634fdaa7e068660e7cc183d5cfef194}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:7, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{267ef7b96b5919312c4d323c0fda245d}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:14, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{12a82ed10357dacbd09c719e9a05b549}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:1, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{f8573d8b7da467ea9d650e08e278ebae}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:2, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{663d271bdce1d0200613b9b3bb2fb846}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:11, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{b62ba6884dcac0284afb57324e274733}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:9, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{e265f16dcef351a48a91750ab6891a1c}, jobId: a383d791abd7344de9cb95b162895683).
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.JobLeaderService removeJob
INFO: Remove job a383d791abd7344de9cb95b162895683 from job leader monitoring.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutor closeJobManagerConnection
INFO: Close JobManager connection for job a383d791abd7344de9cb95b162895683.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutor postStop
INFO: Stopping TaskExecutor akka://flink/user/taskmanager_24.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$4
INFO: Removing cache directory /tmp/flink-web-ui
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.io.disk.iomanager.IOManager shutdown
INFO: I/O manager removed spill file directory /tmp/flink-io-44016c75-98df-4cee-a9ca-a99ddd310a6e
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.io.network.NetworkEnvironment shutdown
INFO: Shutting down the network environment and its components.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.JobLeaderService stop
INFO: Stop job leader service.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutor postStop
INFO: Stopped TaskExecutor akka://flink/user/taskmanager_24.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO: Stopping Akka RPC service.
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:45779
Nov 03, 2018 1:07:08 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$4
INFO: Stopped Akka RPC service.
Nov 03, 2018 1:07:08 AM org.apache.beam.runners.flink.FlinkRunner createPipelineResult
INFO: Execution finished in 6582 msecs
Nov 03, 2018 1:07:08 AM org.apache.beam.runners.flink.FlinkRunner createPipelineResult
INFO: Final accumulator values:
Nov 03, 2018 1:07:08 AM org.apache.beam.runners.flink.FlinkRunner createPipelineResult
INFO: __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@dee16f13
2018-11-03T01:07:08.545Z Waiting for main pipeline to 'finish'
2018-11-03T01:07:08.545Z DONE Query12
2018-11-03T01:07:08.546Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
==========================================================================================
Run started 2018-11-03T01:05:35.557Z and ran for PT92.989S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Nov 03, 2018 1:07:08 AM org.apache.beam.runners.flink.FlinkRunner fromOptions
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 168 files. Enable logging at DEBUG level to see which files will be staged.
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 2.4 42444.8 100000
0001 1.2 85324.2 92000
0002 0.6 169779.3 351
0003 9.6 10387.5 580
0004 5.9 1707.9 40
0005 6.0 16570.0 12
0006 5.4 1868.5 103
0007 7.4 13439.1 1
0008 5.7 17467.2 6000
0009 7.5 1336.5 298
0010 5.8 17391.3 1
0011 8.1 12304.7 1919
0012 6.5 15456.0 1919
0013 *** not run ***
==========================================================================================
2018-11-03T01:07:08.549Z Generating 100000 events in batch mode
==========================================================================================
Run started 2018-11-03T01:05:35.557Z and ran for PT92.998S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":null,"sideInputRowCount":0,"sideInputNumShards":0,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
Exception in thread "main" 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 2.4 42444.8 100000
0001 1.2 85324.2 92000
0002 0.6 169779.3 351
0003 9.6 10387.5 580
0004 5.9 1707.9 40
0005 6.0 16570.0 12
0006 5.4 1868.5 103
0007 7.4 13439.1 1
0008 5.7 17467.2 6000
0009 7.5 1336.5 298
0010 5.8 17391.3 1
0011 8.1 12304.7 1919
0012 6.5 15456.0 1919
0013 *** not run ***
java.lang.RuntimeException: java.lang.IllegalStateException: Configuration error: side input is null
==========================================================================================
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
Caused by: java.lang.IllegalStateException: Configuration error: side input is null
at org.apache.beam.repackaged.beam_sdks_java_nexmark.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.nexmark.queries.BoundedSideInputJoin.applyTyped(BoundedSideInputJoin.java:50)
at org.apache.beam.sdk.nexmark.queries.BoundedSideInputJoin.applyPrim(BoundedSideInputJoin.java:81)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:267)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:45)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1144)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 1 mins 36.804 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 33s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/pvanl6dwymizk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org