You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/11/15 18:32:15 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Spark #1079
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Spark/1079/display/redirect>
------------------------------------------
[...truncated 759.25 KB...]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Transform to: rel#472 via ProjectToCalcRule
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2319 generated 1 successors: [rel#472:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: PLANNER = org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.volcano.VolcanoPlanner@23d396c; TICK = 39/37; PHASE = OPTIMIZE; COST = {inf}
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Pop match: rule [BeamCalcRule] rels [rel#472:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2525: Apply rule [BeamCalcRule] to [rel#472:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Transform to: rel#473 via BeamCalcRule
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2525 generated 1 successors: [rel#473:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: PLANNER = org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.volcano.VolcanoPlanner@23d396c; TICK = 40/38; PHASE = OPTIMIZE; COST = {inf}
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Pop match: rule [BeamEnumerableConverterRule] rels [rel#473:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2531: Apply rule [BeamEnumerableConverterRule] to [rel#473:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Transform to: rel#474 via BeamEnumerableConverterRule
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2531 generated 1 successors: [BeamEnumerableConverter#474]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: PLANNER = org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.volcano.VolcanoPlanner@23d396c; TICK = 41/39; PHASE = OPTIMIZE; COST = {inf}
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Pop match: rule [ProjectToCalcRule] rels [rel#447:LogicalProject.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,auction=$0,price=$2,bidder=$1,dateTime=$3,extra=$4,$f5=$3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2372: Apply rule [ProjectToCalcRule] to [rel#447:LogicalProject.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,auction=$0,price=$2,bidder=$1,dateTime=$3,extra=$4,$f5=$3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Transform to: rel#477 via ProjectToCalcRule
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2372 generated 1 successors: [rel#477:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: PLANNER = org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.volcano.VolcanoPlanner@23d396c; TICK = 42/40; PHASE = OPTIMIZE; COST = {inf}
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Pop match: rule [BeamCalcRule] rels [rel#477:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2562: Apply rule [BeamCalcRule] to [rel#477:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Transform to: rel#478 via BeamCalcRule
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2562 generated 1 successors: [rel#478:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: PLANNER = org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.volcano.VolcanoPlanner@23d396c; TICK = 43/41; PHASE = OPTIMIZE; COST = {445.75 rows, 2191.25 cpu, 0.0 io}
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Pop match: rule [BeamEnumerableConverterRule] rels [rel#478:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2568: Apply rule [BeamEnumerableConverterRule] to [rel#478:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Transform to: rel#479 via BeamEnumerableConverterRule
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: call#2568 generated 1 successors: [BeamEnumerableConverter#479]
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: PLANNER = org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.volcano.VolcanoPlanner@23d396c; TICK = 44/42; PHASE = OPTIMIZE; COST = {445.75 rows, 2191.25 cpu, 0.0 io}
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: PLANNER = org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.volcano.VolcanoPlanner@23d396c; TICK = 45/1; PHASE = CLEANUP; COST = {445.75 rows, 2191.25 cpu, 0.0 io}
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Cheapest plan:
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}]): rowcount = 2.25, cumulative cost = {445.75 rows, 2191.25 cpu, 0.0 io}, id = 489
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner]): rowcount = 2.25, cumulative cost = {443.5 rows, 2162.0 cpu, 0.0 io}, id = 488
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}]): rowcount = 10.0, cumulative cost = {220.0 rows, 1321.0 cpu, 0.0 io}, id = 484
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)]): rowcount = 10.0, cumulative cost = {210.0 rows, 1201.0 cpu, 0.0 io}, id = 483
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3]): rowcount = 100.0, cumulative cost = {200.0 rows, 1201.0 cpu, 0.0 io}, id = 482
BeamIOSourceRel(table=[[beam, Bid]]): rowcount = 100.0, cumulative cost = {100.0 rows, 101.0 cpu, 0.0 io}, id = 385
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0]): rowcount = 10.0, cumulative cost = {221.25 rows, 841.0 cpu, 0.0 io}, id = 487
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)]): rowcount = 10.0, cumulative cost = {211.25 rows, 801.0 cpu, 0.0 io}, id = 486
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2]): rowcount = 100.0, cumulative cost = {200.0 rows, 801.0 cpu, 0.0 io}, id = 485
BeamIOSourceRel(table=[[beam, Bid]]): rowcount = 100.0, cumulative cost = {100.0 rows, 101.0 cpu, 0.0 io}, id = 385
18/11/15 18:32:00 DEBUG org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.plan.RelOptPlanner: Provenance:
BeamCalcRel#489
direct
rel#416:BeamCalcRel.BEAM_LOGICAL(input=rel#415:Subset#7.BEAM_LOGICAL,expr#0..7={inputs},auction=$t0,price=$t1,bidder=$t2,dateTime=$t3,extra=$t4)
call#2175 rule [BeamCalcRule]
rel#414:LogicalCalc.NONE(input=rel#409:Subset#7.NONE,expr#0..7={inputs},auction=$t0,price=$t1,bidder=$t2,dateTime=$t3,extra=$t4)
call#2147 rule [ProjectToCalcRule]
rel#410:LogicalProject.NONE(input=rel#409:Subset#7.NONE,auction=$0,price=$1,bidder=$2,dateTime=$3,extra=$4)
no parent
BeamJoinRel#488
direct
rel#422:BeamJoinRel.BEAM_LOGICAL(left=rel#420:Subset#3.BEAM_LOGICAL,right=rel#421:Subset#6.BEAM_LOGICAL,condition=AND(=($5, $7), =($1, $6)),joinType=inner)
call#2116 rule [BeamJoinRule]
rel#408:LogicalJoin.NONE(left=rel#401:Subset#3.NONE,right=rel#407:Subset#6.NONE,condition=AND(=($5, $7), =($1, $6)),joinType=inner)
no parent
BeamCalcRel#484
direct
rel#436:BeamCalcRel.BEAM_LOGICAL(input=rel#435:Subset#2.BEAM_LOGICAL,expr#0..5={inputs},auction=$t0,price=$t1,bidder=$t2,dateTime=$t3,extra=$t4,starttime=$t5)
call#2277 rule [BeamCalcRule]
rel#434:LogicalCalc.NONE(input=rel#399:Subset#2.NONE,expr#0..5={inputs},auction=$t0,price=$t1,bidder=$t2,dateTime=$t3,extra=$t4,starttime=$t5)
call#2023 rule [ProjectToCalcRule]
rel#400:LogicalProject.NONE(input=rel#399:Subset#2.NONE,auction=$0,price=$1,bidder=$2,dateTime=$3,extra=$4,starttime=$5)
no parent
BeamAggregationRel#483
direct
rel#450:BeamAggregationRel.BEAM_LOGICAL(input=rel#449:Subset#10.BEAM_LOGICAL,group={0, 1, 2, 3, 4, 5},window=FixedWindows($5, PT10S, PT0S))
call#1999 rule [BeamAggregationRule]
rel#398:LogicalAggregate.NONE(input=rel#397:Subset#1.NONE,group={0, 1, 2, 3, 4, 5})
no parent
rel#396:LogicalProject.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,auction=$0,price=$2,bidder=$1,dateTime=$3,extra=$4,$f5=TUMBLE($3, 10000))
no parent
BeamCalcRel#482
direct
rel#478:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)
call#2562 rule [BeamCalcRule]
rel#477:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},auction=$t0,price=$t2,bidder=$t1,dateTime=$t3,extra=$t4,$f5=$t3)
call#2372 rule [ProjectToCalcRule]
rel#447:LogicalProject.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,auction=$0,price=$2,bidder=$1,dateTime=$3,extra=$4,$f5=$3)
no parent
rel#385:BeamIOSourceRel.BEAM_LOGICAL(table=[beam, Bid])
no parent
BeamCalcRel#487
direct
rel#430:BeamCalcRel.BEAM_LOGICAL(input=rel#429:Subset#5.BEAM_LOGICAL,expr#0..1={inputs},maxprice=$t1,starttime=$t0)
call#2240 rule [BeamCalcRule]
rel#428:LogicalCalc.NONE(input=rel#405:Subset#5.NONE,expr#0..1={inputs},maxprice=$t1,starttime=$t0)
call#2099 rule [ProjectToCalcRule]
rel#406:LogicalProject.NONE(input=rel#405:Subset#5.NONE,maxprice=$1,starttime=$0)
no parent
BeamAggregationRel#486
direct
rel#443:BeamAggregationRel.BEAM_LOGICAL(input=rel#442:Subset#9.BEAM_LOGICAL,group={0},maxprice=MAX($1),window=FixedWindows($0, PT10S, PT0S))
call#2075 rule [BeamAggregationRule]
rel#404:LogicalAggregate.NONE(input=rel#403:Subset#4.NONE,group={0},maxprice=MAX($1))
no parent
rel#402:LogicalProject.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,$f0=TUMBLE($3, 10000),price=$2)
no parent
BeamCalcRel#485
direct
rel#473:BeamCalcRel.BEAM_LOGICAL(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)
call#2525 rule [BeamCalcRule]
rel#472:LogicalCalc.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,expr#0..4={inputs},$f0=$t3,price=$t2)
call#2319 rule [ProjectToCalcRule]
rel#440:LogicalProject.NONE(input=rel#395:Subset#0.BEAM_LOGICAL,$f0=$3,price=$2)
no parent
rel#385 (see above)
2018-11-15T18:32:11.746Z Waiting for main pipeline to 'finish'
2018-11-15T18:32:11.747Z DONE SqlQuery7
2018-11-15T18:32:11.747Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2018-11-15T18:32:11.748Z skipping since configuration is not implemented
==========================================================================================
Run started 2018-11-15T18:31:26.997Z and ran for PT44.750S
2018-11-15T18:32:11.749Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 2.8 35727.0 92000
0001 1.6 62111.8 92000
0002 1.5 68870.5 351
0003 4.9 20358.3 580
0004 3.5 2871.9 4
0005 7.9 12658.2 1
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
==========================================================================================
2018-11-15T18:32:11.749Z skipping since configuration is not implemented
2018-11-15T18:32:11.749Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2018-11-15T18:32:11.749Z skipping since configuration is not implemented
2018-11-15T18:32:11.749Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2018-11-15T18:32:11.749Z skipping since configuration is not implemented
2018-11-15T18:32:11.749Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2018-11-15T18:32:11.750Z skipping since configuration is not implemented
2018-11-15T18:32:11.750Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2018-11-15T18:32:11.750Z skipping since configuration is not implemented
2018-11-15T18:32:11.750Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2018-11-15T18:32:11.750Z skipping since configuration is not implemented
2018-11-15T18:32:11.750Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2018-11-15T18:32:11.751Z skipping since configuration is not implemented
==========================================================================================
Run started 2018-11-15T18:31:26.997Z and ran for PT45.922S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; streamTimeout:60
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; streamTimeout:60
0002 query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.NullPointerException
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
at com.google.cloud.bigquery.StandardTableDefinition$StreamingBuffer.fromPb(StandardTableDefinition.java:116)
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at com.google.cloud.bigquery.StandardTableDefinition.fromPb(StandardTableDefinition.java:225)
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
at com.google.cloud.bigquery.TableDefinition.fromPb(TableDefinition.java:155)
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
at com.google.cloud.bigquery.TableInfo$BuilderImpl.<init>(TableInfo.java:183)
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
at com.google.cloud.bigquery.Table.fromPb(Table.java:593)
Performance:
at com.google.cloud.bigquery.BigQueryImpl.getTable(BigQueryImpl.java:410)
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
at org.apache.beam.sdk.testutils.publishing.BigQueryClient.createTableIfNotExists(BigQueryClient.java:74)
0000 2.8 35727.0 92000
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:184)
0001 1.6 62111.8 92000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:148)
0002 1.5 68870.5 351
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:98)
0003 4.9 20358.3 580
at org.apache.beam.sdk.nexmark.Main.main(Main.java:423)
0004 3.5 2871.9 4
0005 7.9 12658.2 1
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
==========================================================================================
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 48.796 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 19s
67 actionable tasks: 15 executed, 52 up-to-date
Publishing build scan...
https://gradle.com/s/hjotjlaf3mvia
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Spark #1080
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Spark/1080/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org