You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/04/28 18:15:03 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2558
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2558/display/redirect>
------------------------------------------
[...truncated 286.61 KB...]
Apr 28, 2019 6:13:25 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-28T18:13:30.038Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:13:30.040Z Generating 100000 events in batch mode
Apr 28, 2019 6:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 28, 2019 6:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 28, 2019 6:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-28T18:13:31.935Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:13:31.937Z Generating 100000 events in batch mode
Apr 28, 2019 6:13:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 28, 2019 6:13:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 28, 2019 6:13:32 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-28T18:13:35.518Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-28T18:13:35.518Z skipping since configuration is not implemented
2019-04-28T18:13:35.519Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:13:35.521Z Generating 100000 events in batch mode
Apr 28, 2019 6:13:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 28, 2019 6:13:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 28, 2019 6:13:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-28T18:13:35.868Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-28T18:13:35.869Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-28T18:13:35.869Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2019-04-28T18:13:35.871Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
Generating 100000 events in batch mode
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 28, 2019 6:13:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 28, 2019 6:13:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 28, 2019 6:13:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-28T18:14:50.286Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:14:50.287Z skipping since configuration is not implemented
2019-04-28T18:14:50.287Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-28T18:14:50.287Z skipping since configuration is not implemented
2019-04-28T18:14:50.287Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:14:50.288Z skipping since configuration is not implemented
2019-04-28T18:14:50.288Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:14:50.288Z skipping since configuration is not implemented
2019-04-28T18:14:50.289Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:14:50.289Z skipping since configuration is not implemented
2019-04-28T18:14:50.289Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:14:50.291Z Generating 100000 events in batch mode
Apr 28, 2019 6:14:50 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 28, 2019 6:14:50 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 28, 2019 6:14:50 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-28T18:15:01.383Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-28T18:15:01.383Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 0s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/ssxlq74vqborg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Flink #2574
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2574/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2573
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2573/display/redirect?page=changes>
Changes:
[relax] Ensure that all nested schemas are given ids, and fix bug where nullable
------------------------------------------
[...truncated 286.21 KB...]
Apr 29, 2019 9:17:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T21:17:46.602Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:17:46.604Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:46 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 9:17:46 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 9:17:46 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T21:17:48.415Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:17:48.417Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 9:17:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 9:17:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T21:17:51.817Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T21:17:51.817Z skipping since configuration is not implemented
2019-04-29T21:17:51.817Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:17:51.820Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:51 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 9:17:51 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T21:17:52.162Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T21:17:52.163Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T21:17:52.163Z at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2019-04-29T21:17:52.165Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T21:19:03.797Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.798Z skipping since configuration is not implemented
2019-04-29T21:19:03.798Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T21:19:03.798Z skipping since configuration is not implemented
2019-04-29T21:19:03.798Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.799Z skipping since configuration is not implemented
2019-04-29T21:19:03.799Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.799Z skipping since configuration is not implemented
2019-04-29T21:19:03.799Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.799Z skipping since configuration is not implemented
2019-04-29T21:19:03.800Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.802Z Generating 100000 events in batch mode
Apr 29, 2019 9:19:03 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 9:19:03 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 9:19:03 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T21:19:14.714Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:14.715Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 45s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/h32zxxpvcqtvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2572
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2572/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-6526] Add ReadFiles and ParseFiles transforms for AvroIO
[chamikara] Updates Dataflow runner to support external ParDos.
------------------------------------------
[...truncated 286.90 KB...]
Apr 29, 2019 8:18:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T20:18:32.014Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:18:32.017Z Generating 100000 events in batch mode
Apr 29, 2019 8:18:32 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 8:18:32 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 8:18:32 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T20:18:33.915Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:18:33.918Z Generating 100000 events in batch mode
Apr 29, 2019 8:18:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 8:18:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 8:18:34 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T20:18:37.358Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T20:18:37.359Z skipping since configuration is not implemented
2019-04-29T20:18:37.359Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:18:37.361Z Generating 100000 events in batch mode
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T20:18:37.682Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T20:18:37.682Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T20:18:37.682Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
2019-04-29T20:18:37.684Z Generating 100000 events in batch mode at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T20:19:55.892Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.893Z skipping since configuration is not implemented
2019-04-29T20:19:55.893Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T20:19:55.894Z skipping since configuration is not implemented
2019-04-29T20:19:55.894Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.894Z skipping since configuration is not implemented
2019-04-29T20:19:55.894Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.895Z skipping since configuration is not implemented
2019-04-29T20:19:55.895Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.895Z skipping since configuration is not implemented
2019-04-29T20:19:55.895Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.898Z Generating 100000 events in batch mode
Apr 29, 2019 8:19:55 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 8:19:55 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 8:19:55 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T20:20:07.049Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:20:07.050Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 3s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/tjyqr4q4473o4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2571
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2571/display/redirect?page=changes>
Changes:
[daniel.o.programmer] [BEAM-7087] Updating Go SDK errors in base beam directory
[daniel.o.programmer] [BEAM-7087] Moving "errors" package to its own subdirectory.
------------------------------------------
[...truncated 286.58 KB...]
Apr 29, 2019 7:20:25 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:20:29.649Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:20:29.651Z Generating 100000 events in batch mode
Apr 29, 2019 7:20:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 7:20:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 7:20:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:20:31.726Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:20:31.729Z Generating 100000 events in batch mode
Apr 29, 2019 7:20:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 7:20:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 7:20:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T19:20:35.489Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:20:35.490Z skipping since configuration is not implemented
2019-04-29T19:20:35.490Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:20:35.492Z Generating 100000 events in batch mode
Apr 29, 2019 7:20:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 7:20:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:20:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:20:35.865Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T19:20:35.865Z skipping since configuration is not implemented
2019-04-29T19:20:35.865Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
2019-04-29T19:20:35.868Z Generating 100000 events in batch mode
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 7:20:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 7:20:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:20:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:21:45.553Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.554Z skipping since configuration is not implemented
2019-04-29T19:21:45.554Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:21:45.554Z skipping since configuration is not implemented
2019-04-29T19:21:45.554Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.554Z skipping since configuration is not implemented
2019-04-29T19:21:45.554Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.555Z skipping since configuration is not implemented
2019-04-29T19:21:45.555Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.556Z skipping since configuration is not implemented
2019-04-29T19:21:45.556Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.558Z Generating 100000 events in batch mode
Apr 29, 2019 7:21:45 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 7:21:45 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 7:21:45 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T19:21:56.812Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:56.813Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 56s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/ii4za2kafg622
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2570
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2570/display/redirect?page=changes>
Changes:
[ajamato] Update dataflow container version to beam-master-20190426
------------------------------------------
[...truncated 286.00 KB...]
Apr 29, 2019 7:04:38 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:04:42.497Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:04:42.499Z Generating 100000 events in batch mode
Apr 29, 2019 7:04:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 7:04:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 7:04:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:04:44.286Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:04:44.289Z Generating 100000 events in batch mode
Apr 29, 2019 7:04:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 7:04:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 7:04:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T19:04:47.599Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:04:47.600Z skipping since configuration is not implemented
2019-04-29T19:04:47.600Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:04:47.602Z Generating 100000 events in batch mode
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:04:47.929Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:04:47.930Z skipping since configuration is not implemented
Exception in thread "main" 2019-04-29T19:04:47.930Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2019-04-29T19:04:47.932Z at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
Generating 100000 events in batch mode
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:05:57.482Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.482Z skipping since configuration is not implemented
2019-04-29T19:05:57.482Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:05:57.483Z skipping since configuration is not implemented
2019-04-29T19:05:57.483Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.483Z skipping since configuration is not implemented
2019-04-29T19:05:57.483Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.483Z skipping since configuration is not implemented
2019-04-29T19:05:57.483Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.484Z skipping since configuration is not implemented
2019-04-29T19:05:57.484Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.487Z Generating 100000 events in batch mode
Apr 29, 2019 7:05:57 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 7:05:57 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 7:05:57 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T19:06:08.318Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:06:08.319Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 43s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/yxnu7wpjwa4zu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2569
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2569/display/redirect>
------------------------------------------
[...truncated 286.62 KB...]
Apr 29, 2019 6:13:23 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T18:13:27.511Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:13:27.514Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 6:13:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 6:13:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T18:13:29.486Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:13:29.489Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 6:13:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 6:13:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T18:13:33.245Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T18:13:33.246Z skipping since configuration is not implemented
2019-04-29T18:13:33.246Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:13:33.248Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T18:13:33.580Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T18:13:33.581Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T18:13:33.581Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60 at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
2019-04-29T18:13:33.583Z at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
Generating 100000 events in batch mode
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T18:14:44.281Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.281Z skipping since configuration is not implemented
2019-04-29T18:14:44.281Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T18:14:44.281Z skipping since configuration is not implemented
2019-04-29T18:14:44.282Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.282Z skipping since configuration is not implemented
2019-04-29T18:14:44.282Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.283Z skipping since configuration is not implemented
2019-04-29T18:14:44.283Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.283Z skipping since configuration is not implemented
2019-04-29T18:14:44.283Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.286Z Generating 100000 events in batch mode
Apr 29, 2019 6:14:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 6:14:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 6:14:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T18:14:55.637Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:55.638Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 58s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/ociwdths6iwce
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2568
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2568/display/redirect?page=changes>
Changes:
[valentyn] Adds a possibility to pass a project that hosts Cloud Spanner instance
------------------------------------------
[...truncated 286.85 KB...]
Apr 29, 2019 5:49:10 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T17:49:14.355Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:49:14.357Z Generating 100000 events in batch mode
Apr 29, 2019 5:49:14 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 5:49:14 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 5:49:14 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T17:49:16.206Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:49:16.208Z Generating 100000 events in batch mode
Apr 29, 2019 5:49:16 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 5:49:16 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 5:49:16 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T17:49:19.928Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T17:49:19.929Z skipping since configuration is not implemented
2019-04-29T17:49:19.929Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:49:19.931Z Generating 100000 events in batch mode
Apr 29, 2019 5:49:19 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 5:49:19 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 5:49:20 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T17:49:20.257Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T17:49:20.257Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T17:49:20.257Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
2019-04-29T17:49:20.259Z at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
Generating 100000 events in batch mode
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 5:49:20 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 5:49:20 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 5:49:20 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T17:50:31.597Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:50:31.598Z skipping since configuration is not implemented
2019-04-29T17:50:31.598Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T17:50:31.598Z skipping since configuration is not implemented
2019-04-29T17:50:31.598Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:50:31.598Z skipping since configuration is not implemented
2019-04-29T17:50:31.598Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:50:31.599Z skipping since configuration is not implemented
2019-04-29T17:50:31.599Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:50:31.599Z skipping since configuration is not implemented
2019-04-29T17:50:31.599Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:50:31.602Z Generating 100000 events in batch mode
Apr 29, 2019 5:50:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 5:50:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 5:50:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T17:50:42.716Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:50:42.717Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 56s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/7gnsq5ninwq2c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2567
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2567/display/redirect?page=changes>
Changes:
[ehudm] Python Datastore IO using google-cloud-datastore
------------------------------------------
[...truncated 286.03 KB...]
Apr 29, 2019 5:29:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T17:29:52.136Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:29:52.138Z Generating 100000 events in batch mode
Apr 29, 2019 5:29:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 5:29:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 5:29:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T17:29:53.910Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:29:53.912Z Generating 100000 events in batch mode
Apr 29, 2019 5:29:53 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 5:29:53 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 5:29:54 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T17:29:59.176Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T17:29:59.177Z skipping since configuration is not implemented
2019-04-29T17:29:59.178Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:29:59.182Z Generating 100000 events in batch mode
Apr 29, 2019 5:29:59 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 5:29:59 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 5:29:59 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T17:29:59.852Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T17:29:59.852Z skipping since configuration is not implemented
2019-04-29T17:29:59.853Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2019-04-29T17:29:59.856Z Generating 100000 events in batch mode
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 5:29:59 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 5:29:59 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 5:29:59 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T17:31:17.754Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:31:17.755Z skipping since configuration is not implemented
2019-04-29T17:31:17.755Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T17:31:17.755Z skipping since configuration is not implemented
2019-04-29T17:31:17.755Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:31:17.755Z skipping since configuration is not implemented
2019-04-29T17:31:17.756Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:31:17.756Z skipping since configuration is not implemented
2019-04-29T17:31:17.756Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:31:17.757Z skipping since configuration is not implemented
2019-04-29T17:31:17.757Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:31:17.760Z Generating 100000 events in batch mode
Apr 29, 2019 5:31:17 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 5:31:17 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 5:31:17 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T17:31:28.349Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T17:31:28.349Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 53s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/3ckm2lm66ynte
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2566
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2566/display/redirect?page=changes>
Changes:
[thw] [BEAM-7112] Timer race with state cleanup - take two
------------------------------------------
[...truncated 286.23 KB...]
Apr 29, 2019 1:52:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T13:52:33.481Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:52:33.483Z Generating 100000 events in batch mode
Apr 29, 2019 1:52:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 1:52:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 1:52:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T13:52:35.323Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:52:35.325Z Generating 100000 events in batch mode
Apr 29, 2019 1:52:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 1:52:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 1:52:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T13:52:39.061Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T13:52:39.062Z skipping since configuration is not implemented
2019-04-29T13:52:39.062Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:52:39.063Z Generating 100000 events in batch mode
Apr 29, 2019 1:52:39 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 1:52:39 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 1:52:39 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T13:52:39.351Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T13:52:39.352Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!2019-04-29T13:52:39.352Z
Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
2019-04-29T13:52:39.354Z Generating 100000 events in batch mode
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 1:52:39 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 1:52:39 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 1:52:39 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T13:53:47.813Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:53:47.813Z skipping since configuration is not implemented
2019-04-29T13:53:47.814Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T13:53:47.814Z skipping since configuration is not implemented
2019-04-29T13:53:47.814Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:53:47.814Z skipping since configuration is not implemented
2019-04-29T13:53:47.814Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:53:47.815Z skipping since configuration is not implemented
2019-04-29T13:53:47.815Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:53:47.815Z skipping since configuration is not implemented
2019-04-29T13:53:47.815Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:53:47.817Z Generating 100000 events in batch mode
Apr 29, 2019 1:53:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 1:53:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 1:53:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T13:53:58.241Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:53:58.241Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 42s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/kuv63yylmt2ks
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2565
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2565/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-5311] Delete docker build images
------------------------------------------
[...truncated 286.65 KB...]
Apr 29, 2019 1:36:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T13:36:31.353Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:36:31.356Z Generating 100000 events in batch mode
Apr 29, 2019 1:36:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 1:36:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 1:36:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T13:36:33.227Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:36:33.229Z Generating 100000 events in batch mode
Apr 29, 2019 1:36:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 1:36:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 1:36:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T13:36:36.643Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T13:36:36.643Z skipping since configuration is not implemented
2019-04-29T13:36:36.644Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:36:36.646Z Generating 100000 events in batch mode
Apr 29, 2019 1:36:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 1:36:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 1:36:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T13:36:37.010Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60Exception in thread "main"
2019-04-29T13:36:37.010Z skipping since configuration is not implemented
2019-04-29T13:36:37.011Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
2019-04-29T13:36:37.013Z at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
Generating 100000 events in batch mode
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 1:36:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 1:36:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 1:36:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T13:37:53.185Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:37:53.185Z skipping since configuration is not implemented
2019-04-29T13:37:53.185Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T13:37:53.185Z skipping since configuration is not implemented
2019-04-29T13:37:53.186Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:37:53.186Z skipping since configuration is not implemented
2019-04-29T13:37:53.186Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:37:53.186Z skipping since configuration is not implemented
2019-04-29T13:37:53.187Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:37:53.187Z skipping since configuration is not implemented
2019-04-29T13:37:53.187Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:37:53.190Z Generating 100000 events in batch mode
Apr 29, 2019 1:37:53 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 1:37:53 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 1:37:53 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T13:38:04.306Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:38:04.306Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 0s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/bll7x3cuowpsc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2564
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2564/display/redirect?page=changes>
Changes:
[mxm] [BEAM-7170] Fix exception when retrieving ExpansionServer port after
------------------------------------------
[...truncated 287.00 KB...]
Apr 29, 2019 1:00:23 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T13:00:27.786Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:00:27.788Z Generating 100000 events in batch mode
Apr 29, 2019 1:00:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 1:00:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 1:00:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T13:00:29.628Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:00:29.631Z Generating 100000 events in batch mode
Apr 29, 2019 1:00:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 1:00:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 1:00:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T13:00:33.354Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T13:00:33.355Z skipping since configuration is not implemented
2019-04-29T13:00:33.355Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:00:33.357Z Generating 100000 events in batch mode
Apr 29, 2019 1:00:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 1:00:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 1:00:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T13:00:33.867Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T13:00:33.867Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T13:00:33.867Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2019-04-29T13:00:33.869Z at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
Generating 100000 events in batch mode
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 1:00:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 1:00:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 1:00:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T13:01:43.523Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:01:43.524Z skipping since configuration is not implemented
2019-04-29T13:01:43.524Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T13:01:43.524Z skipping since configuration is not implemented
2019-04-29T13:01:43.524Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:01:43.525Z skipping since configuration is not implemented
2019-04-29T13:01:43.525Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:01:43.525Z skipping since configuration is not implemented
2019-04-29T13:01:43.525Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:01:43.525Z skipping since configuration is not implemented
2019-04-29T13:01:43.526Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:01:43.528Z Generating 100000 events in batch mode
Apr 29, 2019 1:01:43 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 1:01:43 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 1:01:43 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T13:01:54.682Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T13:01:54.682Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 55s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/rrp5b3drkc5jq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2563
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2563/display/redirect>
------------------------------------------
[...truncated 286.97 KB...]
Apr 29, 2019 12:13:20 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T12:13:24.780Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:13:24.782Z Generating 100000 events in batch mode
Apr 29, 2019 12:13:24 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 12:13:24 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 12:13:24 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T12:13:26.623Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:13:26.625Z Generating 100000 events in batch mode
Apr 29, 2019 12:13:26 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 12:13:26 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 12:13:26 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T12:13:30.141Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T12:13:30.142Z skipping since configuration is not implemented
2019-04-29T12:13:30.142Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:13:30.145Z Generating 100000 events in batch mode
Apr 29, 2019 12:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 12:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 12:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T12:13:30.488Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T12:13:30.488Z skipping since configuration is not implemented
2019-04-29T12:13:30.488Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
2019-04-29T12:13:30.491Z Generating 100000 events in batch mode
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 12:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 12:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 12:13:30 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T12:14:48.370Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:14:48.370Z skipping since configuration is not implemented
2019-04-29T12:14:48.370Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T12:14:48.371Z skipping since configuration is not implemented
2019-04-29T12:14:48.371Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:14:48.371Z skipping since configuration is not implemented
2019-04-29T12:14:48.371Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:14:48.372Z skipping since configuration is not implemented
2019-04-29T12:14:48.372Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:14:48.372Z skipping since configuration is not implemented
2019-04-29T12:14:48.372Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:14:48.375Z Generating 100000 events in batch mode
Apr 29, 2019 12:14:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 12:14:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 12:14:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T12:14:59.583Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T12:14:59.583Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 2s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/33ps4w5mdwkja
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2562
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2562/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-7076] Update Spark runner to use spark version 2.4.2
------------------------------------------
[...truncated 289.62 KB...]
Apr 29, 2019 9:34:20 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T09:34:24.393Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:34:24.395Z Generating 100000 events in batch mode
Apr 29, 2019 9:34:24 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 9:34:24 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 9:34:24 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T09:34:26.173Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:34:26.175Z Generating 100000 events in batch mode
Apr 29, 2019 9:34:26 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 9:34:26 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 9:34:26 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T09:34:29.266Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T09:34:29.267Z skipping since configuration is not implemented
2019-04-29T09:34:29.267Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:34:29.269Z Generating 100000 events in batch mode
Apr 29, 2019 9:34:29 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 9:34:29 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 9:34:29 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T09:34:29.572Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T09:34:29.572Z skipping since configuration is not implemented
2019-04-29T09:34:29.572Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
Exception in thread "main" java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
2019-04-29T09:34:29.574Z Generating 100000 events in batch mode at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 9:34:29 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 9:34:29 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 9:34:29 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T09:35:40.333Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:35:40.333Z skipping since configuration is not implemented
2019-04-29T09:35:40.333Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T09:35:40.334Z skipping since configuration is not implemented
2019-04-29T09:35:40.334Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:35:40.334Z skipping since configuration is not implemented
2019-04-29T09:35:40.334Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:35:40.334Z skipping since configuration is not implemented
2019-04-29T09:35:40.334Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:35:40.335Z skipping since configuration is not implemented
2019-04-29T09:35:40.335Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:35:40.337Z Generating 100000 events in batch mode
Apr 29, 2019 9:35:40 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 9:35:40 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 9:35:40 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T09:35:50.972Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T09:35:50.972Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 43s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/4kvd4z4wjc46k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2561
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2561/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-2939] Support SDF expansion in the Flink runner.
------------------------------------------
[...truncated 286.83 KB...]
Apr 29, 2019 8:12:38 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T08:12:42.604Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:12:42.606Z Generating 100000 events in batch mode
Apr 29, 2019 8:12:42 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 8:12:42 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 8:12:42 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T08:12:44.530Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:12:44.533Z Generating 100000 events in batch mode
Apr 29, 2019 8:12:44 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 8:12:44 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 8:12:44 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T08:12:47.871Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T08:12:47.872Z skipping since configuration is not implemented
2019-04-29T08:12:47.872Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:12:47.874Z Generating 100000 events in batch mode
Apr 29, 2019 8:12:47 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 8:12:47 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 8:12:48 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T08:12:48.371Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T08:12:48.371Z skipping since configuration is not implemented
Exception in thread "main" 2019-04-29T08:12:48.371Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
2019-04-29T08:12:48.373Z Generating 100000 events in batch mode at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 8:12:48 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 8:12:48 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 8:12:48 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T08:14:08.696Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:14:08.696Z skipping since configuration is not implemented
2019-04-29T08:14:08.696Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T08:14:08.697Z skipping since configuration is not implemented
2019-04-29T08:14:08.697Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:14:08.697Z skipping since configuration is not implemented
2019-04-29T08:14:08.697Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:14:08.698Z skipping since configuration is not implemented
2019-04-29T08:14:08.698Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:14:08.698Z skipping since configuration is not implemented
2019-04-29T08:14:08.698Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:14:08.701Z Generating 100000 events in batch mode
Apr 29, 2019 8:14:08 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 8:14:08 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 8:14:08 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T08:14:19.793Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T08:14:19.794Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 5s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/vhpi4vrc75vyu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2560
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2560/display/redirect>
------------------------------------------
[...truncated 286.61 KB...]
Apr 29, 2019 6:13:06 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T06:13:10.538Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:13:10.540Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:10 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 6:13:10 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 6:13:10 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T06:13:12.397Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:13:12.400Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:12 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 6:13:12 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 6:13:12 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T06:13:16.012Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T06:13:16.013Z skipping since configuration is not implemented
2019-04-29T06:13:16.013Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:13:16.015Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 6:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 6:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
Exception in thread "main" java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
2019-04-29T06:13:16.343Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T06:13:16.344Z skipping since configuration is not implemented
2019-04-29T06:13:16.344Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:13:16.345Z Generating 100000 events in batch mode
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 6:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 6:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 6:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T06:14:35.879Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:14:35.880Z skipping since configuration is not implemented
2019-04-29T06:14:35.880Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T06:14:35.880Z skipping since configuration is not implemented
2019-04-29T06:14:35.880Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:14:35.880Z skipping since configuration is not implemented
2019-04-29T06:14:35.881Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:14:35.882Z skipping since configuration is not implemented
2019-04-29T06:14:35.882Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:14:35.883Z skipping since configuration is not implemented
2019-04-29T06:14:35.883Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:14:35.885Z Generating 100000 events in batch mode
Apr 29, 2019 6:14:35 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 6:14:35 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 6:14:35 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T06:14:46.858Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T06:14:46.858Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 3s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/uueohbfcrsww2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2559
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2559/display/redirect>
------------------------------------------
[...truncated 286.78 KB...]
Apr 29, 2019 12:13:11 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T00:13:16.219Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:13:16.222Z Generating 100000 events in batch mode
Apr 29, 2019 12:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 12:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 12:13:16 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T00:13:18.160Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:13:18.163Z Generating 100000 events in batch mode
Apr 29, 2019 12:13:18 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 12:13:18 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 12:13:18 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T00:13:21.867Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T00:13:21.868Z skipping since configuration is not implemented
2019-04-29T00:13:21.868Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:13:21.870Z Generating 100000 events in batch mode
Apr 29, 2019 12:13:21 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 12:13:21 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 12:13:22 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T00:13:22.214Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T00:13:22.214Z skipping since configuration is not implemented
2019-04-29T00:13:22.214Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2019-04-29T00:13:22.217Z Generating 100000 events in batch mode at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 12:13:22 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 12:13:22 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 12:13:22 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T00:14:41.893Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:14:41.894Z skipping since configuration is not implemented
2019-04-29T00:14:41.894Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T00:14:41.894Z skipping since configuration is not implemented
2019-04-29T00:14:41.894Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:14:41.894Z skipping since configuration is not implemented
2019-04-29T00:14:41.895Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:14:41.895Z skipping since configuration is not implemented
2019-04-29T00:14:41.895Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:14:41.895Z skipping since configuration is not implemented
2019-04-29T00:14:41.896Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:14:41.898Z Generating 100000 events in batch mode
Apr 29, 2019 12:14:41 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 12:14:41 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 12:14:41 AM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T00:14:53.206Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T00:14:53.206Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 6s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/nitoz2gfzoo6q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org