You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/04/29 18:14:58 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2569
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2569/display/redirect>
------------------------------------------
[...truncated 286.62 KB...]
Apr 29, 2019 6:13:23 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T18:13:27.511Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:13:27.514Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 6:13:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 6:13:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T18:13:29.486Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:13:29.489Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 6:13:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 6:13:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T18:13:33.245Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T18:13:33.246Z skipping since configuration is not implemented
2019-04-29T18:13:33.246Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:13:33.248Z Generating 100000 events in batch mode
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T18:13:33.580Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T18:13:33.581Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T18:13:33.581Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60 at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
2019-04-29T18:13:33.583Z at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
Generating 100000 events in batch mode
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 6:13:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T18:14:44.281Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.281Z skipping since configuration is not implemented
2019-04-29T18:14:44.281Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T18:14:44.281Z skipping since configuration is not implemented
2019-04-29T18:14:44.282Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.282Z skipping since configuration is not implemented
2019-04-29T18:14:44.282Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.283Z skipping since configuration is not implemented
2019-04-29T18:14:44.283Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.283Z skipping since configuration is not implemented
2019-04-29T18:14:44.283Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:44.286Z Generating 100000 events in batch mode
Apr 29, 2019 6:14:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 6:14:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 6:14:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T18:14:55.637Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T18:14:55.638Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 58s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/ociwdths6iwce
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Flink #2574
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2574/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2573
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2573/display/redirect?page=changes>
Changes:
[relax] Ensure that all nested schemas are given ids, and fix bug where nullable
------------------------------------------
[...truncated 286.21 KB...]
Apr 29, 2019 9:17:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T21:17:46.602Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:17:46.604Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:46 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 9:17:46 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 9:17:46 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T21:17:48.415Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:17:48.417Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 9:17:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 9:17:48 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T21:17:51.817Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T21:17:51.817Z skipping since configuration is not implemented
2019-04-29T21:17:51.817Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:17:51.820Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:51 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 9:17:51 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T21:17:52.162Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T21:17:52.163Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T21:17:52.163Z at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2019-04-29T21:17:52.165Z Generating 100000 events in batch mode
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 9:17:52 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T21:19:03.797Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.798Z skipping since configuration is not implemented
2019-04-29T21:19:03.798Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T21:19:03.798Z skipping since configuration is not implemented
2019-04-29T21:19:03.798Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.799Z skipping since configuration is not implemented
2019-04-29T21:19:03.799Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.799Z skipping since configuration is not implemented
2019-04-29T21:19:03.799Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.799Z skipping since configuration is not implemented
2019-04-29T21:19:03.800Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:03.802Z Generating 100000 events in batch mode
Apr 29, 2019 9:19:03 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 9:19:03 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 9:19:03 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T21:19:14.714Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T21:19:14.715Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 45s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/h32zxxpvcqtvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2572
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2572/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-6526] Add ReadFiles and ParseFiles transforms for AvroIO
[chamikara] Updates Dataflow runner to support external ParDos.
------------------------------------------
[...truncated 286.90 KB...]
Apr 29, 2019 8:18:27 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T20:18:32.014Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:18:32.017Z Generating 100000 events in batch mode
Apr 29, 2019 8:18:32 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 8:18:32 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 8:18:32 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T20:18:33.915Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:18:33.918Z Generating 100000 events in batch mode
Apr 29, 2019 8:18:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 8:18:33 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 8:18:34 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T20:18:37.358Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T20:18:37.359Z skipping since configuration is not implemented
2019-04-29T20:18:37.359Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:18:37.361Z Generating 100000 events in batch mode
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T20:18:37.682Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T20:18:37.682Z skipping since configuration is not implemented
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
2019-04-29T20:18:37.682Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
2019-04-29T20:18:37.684Z Generating 100000 events in batch mode at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 8:18:37 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T20:19:55.892Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.893Z skipping since configuration is not implemented
2019-04-29T20:19:55.893Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T20:19:55.894Z skipping since configuration is not implemented
2019-04-29T20:19:55.894Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.894Z skipping since configuration is not implemented
2019-04-29T20:19:55.894Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.895Z skipping since configuration is not implemented
2019-04-29T20:19:55.895Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.895Z skipping since configuration is not implemented
2019-04-29T20:19:55.895Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:19:55.898Z Generating 100000 events in batch mode
Apr 29, 2019 8:19:55 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 8:19:55 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 8:19:55 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T20:20:07.049Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T20:20:07.050Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 3s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/tjyqr4q4473o4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2571
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2571/display/redirect?page=changes>
Changes:
[daniel.o.programmer] [BEAM-7087] Updating Go SDK errors in base beam directory
[daniel.o.programmer] [BEAM-7087] Moving "errors" package to its own subdirectory.
------------------------------------------
[...truncated 286.58 KB...]
Apr 29, 2019 7:20:25 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:20:29.649Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:20:29.651Z Generating 100000 events in batch mode
Apr 29, 2019 7:20:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 7:20:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 7:20:29 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:20:31.726Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:20:31.729Z Generating 100000 events in batch mode
Apr 29, 2019 7:20:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 7:20:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 7:20:31 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T19:20:35.489Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:20:35.490Z skipping since configuration is not implemented
2019-04-29T19:20:35.490Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:20:35.492Z Generating 100000 events in batch mode
Apr 29, 2019 7:20:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 7:20:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:20:35 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:20:35.865Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
Exception in thread "main" 2019-04-29T19:20:35.865Z skipping since configuration is not implemented
2019-04-29T19:20:35.865Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
2019-04-29T19:20:35.868Z Generating 100000 events in batch mode
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 7:20:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 7:20:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:20:36 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:21:45.553Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.554Z skipping since configuration is not implemented
2019-04-29T19:21:45.554Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:21:45.554Z skipping since configuration is not implemented
2019-04-29T19:21:45.554Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.554Z skipping since configuration is not implemented
2019-04-29T19:21:45.554Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.555Z skipping since configuration is not implemented
2019-04-29T19:21:45.555Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.556Z skipping since configuration is not implemented
2019-04-29T19:21:45.556Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:45.558Z Generating 100000 events in batch mode
Apr 29, 2019 7:21:45 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 7:21:45 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 7:21:45 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T19:21:56.812Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:21:56.813Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 56s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/ii4za2kafg622
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Flink #2570
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/2570/display/redirect?page=changes>
Changes:
[ajamato] Update dataflow container version to beam-master-20190426
------------------------------------------
[...truncated 286.00 KB...]
Apr 29, 2019 7:04:38 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[DolToEur($t2)], proj#0..1=[{exprs}], price=[$t5], dateTime=[$t3], extra=[$t4])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:04:42.497Z Running query:SELECTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:04:42.499Z Generating 100000 events in batch mode
Apr 29, 2019 7:04:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `PCOLLECTION`.`auction`, `PCOLLECTION`.`price`
FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
WHERE MOD(`PCOLLECTION`.`auction`, 123) = 0
Apr 29, 2019 7:04:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$2])
LogicalFilter(condition=[=(MOD($0, 123), 0)])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
Apr 29, 2019 7:04:42 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[123], expr#6=[MOD($t0, $t5)], expr#7=[0], expr#8=[=($t6, $t7)], auction=[$t0], price=[$t2], $condition=[$t8])
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
2019-04-29T19:04:44.286Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:04:44.289Z Generating 100000 events in batch mode
Apr 29, 2019 7:04:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `P`.`name`, `P`.`city`, `P`.`state`, `A`.`id`
FROM `beam`.`Auction` AS `A`
INNER JOIN `beam`.`Person` AS `P` ON `A`.`seller` = `P`.`id`
WHERE `A`.`category` = 10 AND (`P`.`state` = 'OR' OR `P`.`state` = 'ID' OR `P`.`state` = 'CA')
Apr 29, 2019 7:04:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(name=[$11], city=[$14], state=[$15], id=[$0])
LogicalFilter(condition=[AND(=($8, 10), OR(=($15, 'OR'), =($15, 'ID'), =($15, 'CA')))])
LogicalJoin(condition=[=($7, $10)], joinType=[inner])
BeamIOSourceRel(table=[[beam, Auction]])
BeamIOSourceRel(table=[[beam, Person]])
Apr 29, 2019 7:04:44 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..17=[{inputs}], name=[$t11], city=[$t14], state=[$t15], id=[$t0])
BeamJoinRel(condition=[=($7, $10)], joinType=[inner])
BeamCalcRel(expr#0..9=[{inputs}], expr#10=[10:BIGINT], expr#11=[=($t8, $t10)], proj#0..9=[{exprs}], $condition=[$t11])
BeamIOSourceRel(table=[[beam, Auction]])
BeamCalcRel(expr#0..7=[{inputs}], expr#8=['OR':VARCHAR], expr#9=[=($t5, $t8)], expr#10=['ID':VARCHAR], expr#11=[=($t5, $t10)], expr#12=['CA':VARCHAR], expr#13=[=($t5, $t12)], expr#14=[OR($t9, $t11, $t13)], proj#0..7=[{exprs}], $condition=[$t14])
BeamIOSourceRel(table=[[beam, Person]])
2019-04-29T19:04:47.599Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:04:47.600Z skipping since configuration is not implemented
2019-04-29T19:04:47.600Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:04:47.602Z Generating 100000 events in batch mode
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `AuctionBids`.`auction`, `AuctionBids`.`num`
FROM (SELECT `B1`.`auction`, COUNT(*) AS `num`, HOP_START(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY `B1`.`auction`, HOP(`B1`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `AuctionBids`
INNER JOIN (SELECT MAX(`CountBids`.`num`) AS `maxnum`, `CountBids`.`starttime`
FROM (SELECT COUNT(*) AS `num`, HOP_START(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B2`
GROUP BY `B2`.`auction`, HOP(`B2`.`dateTime`, INTERVAL '5' SECOND, INTERVAL '10' SECOND)) AS `CountBids`
GROUP BY `CountBids`.`starttime`) AS `MaxBids` ON `AuctionBids`.`starttime` = `MaxBids`.`starttime` AND `AuctionBids`.`num` >= `MaxBids`.`maxnum`
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], num=[$1])
LogicalJoin(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
LogicalProject(auction=[$0], num=[$2], starttime=[$1])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxnum=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxnum=[MAX($1)])
LogicalProject(starttime=[$1], num=[$2])
LogicalAggregate(group=[{0, 1}], num=[COUNT()])
LogicalProject(auction=[$0], $f1=[HOP($3, 5000:INTERVAL SECOND, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..4=[{inputs}], proj#0..1=[{exprs}])
BeamJoinRel(condition=[AND(=($2, $4), >=($1, $3))], joinType=[inner])
BeamCalcRel(expr#0..2=[{inputs}], auction=[$t0], num=[$t2], starttime=[$t1])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxnum=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxnum=[MAX($1)])
BeamCalcRel(expr#0..2=[{inputs}], starttime=[$t1], num=[$t2])
BeamAggregationRel(group=[{0, 1}], num=[COUNT()], window=[SlidingWindows($1, PT5S, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], $f1=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:04:47.929Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:04:47.930Z skipping since configuration is not implemented
Exception in thread "main" 2019-04-29T19:04:47.930Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; streamTimeout:60
java.lang.RuntimeException: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.UnsupportedOperationException: Non equi-join is not supported!
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinPairOfRexNodes(BeamJoinRel.java:569)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.extractJoinRexNodes(BeamJoinRel.java:554)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel.access$900(BeamJoinRel.java:101)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:257)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$ExtractJoinKeys.expand(BeamJoinRel.java:240)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionList.apply(PCollectionList.java:176)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:324)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel$StandardJoin.expand(BeamJoinRel.java:317)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:488)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:66)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.lambda$buildPCollectionList$0(BeamSqlRelUtils.java:47)
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.buildPCollectionList(BeamSqlRelUtils.java:48)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:64)
at org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils.toPCollection(BeamSqlRelUtils.java:36)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:111)
at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:79)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:106)
at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery5.expand(SqlQuery5.java:55)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89)
at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1161)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2019-04-29T19:04:47.932Z at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
Generating 100000 events in batch mode
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`
FROM (SELECT `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE_START(`B`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B`
GROUP BY `B`.`auction`, `B`.`price`, `B`.`bidder`, `B`.`dateTime`, `B`.`extra`, TUMBLE(`B`.`dateTime`, INTERVAL '10' SECOND)) AS `B`
INNER JOIN (SELECT MAX(`B1`.`price`) AS `maxprice`, TUMBLE_START(`B1`.`dateTime`, INTERVAL '10' SECOND) AS `starttime`
FROM `beam`.`Bid` AS `B1`
GROUP BY TUMBLE(`B1`.`dateTime`, INTERVAL '10' SECOND)) AS `B1` ON `B`.`starttime` = `B1`.`starttime` AND `B`.`price` = `B1`.`maxprice`
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4])
LogicalJoin(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
LogicalProject(auction=[$0], price=[$1], bidder=[$2], dateTime=[$3], extra=[$4], starttime=[$5])
LogicalAggregate(group=[{0, 1, 2, 3, 4, 5}])
LogicalProject(auction=[$0], price=[$2], bidder=[$1], dateTime=[$3], extra=[$4], $f5=[TUMBLE($3, 10000:INTERVAL SECOND)])
BeamIOSourceRel(table=[[beam, Bid]])
LogicalProject(maxprice=[$1], starttime=[$0])
LogicalAggregate(group=[{0}], maxprice=[MAX($1)])
LogicalProject($f0=[TUMBLE($3, 10000:INTERVAL SECOND)], price=[$2])
BeamIOSourceRel(table=[[beam, Bid]])
Apr 29, 2019 7:04:47 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..4=[{exprs}])
BeamJoinRel(condition=[AND(=($5, $7), =($1, $6))], joinType=[inner])
BeamCalcRel(expr#0..5=[{inputs}], proj#0..5=[{exprs}])
BeamAggregationRel(group=[{0, 1, 2, 3, 4, 5}], window=[FixedWindows($5, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], auction=[$t0], price=[$t2], bidder=[$t1], dateTime=[$t3], extra=[$t4], $f5=[$t3])
BeamIOSourceRel(table=[[beam, Bid]])
BeamCalcRel(expr#0..1=[{inputs}], maxprice=[$t1], starttime=[$t0])
BeamAggregationRel(group=[{0}], maxprice=[MAX($1)], window=[FixedWindows($0, PT10S, PT0S)])
BeamCalcRel(expr#0..4=[{inputs}], $f0=[$t3], price=[$t2])
BeamIOSourceRel(table=[[beam, Bid]])
2019-04-29T19:05:57.482Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.482Z skipping since configuration is not implemented
2019-04-29T19:05:57.482Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000; streamTimeout:60
2019-04-29T19:05:57.483Z skipping since configuration is not implemented
2019-04-29T19:05:57.483Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.483Z skipping since configuration is not implemented
2019-04-29T19:05:57.483Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.483Z skipping since configuration is not implemented
2019-04-29T19:05:57.483Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.484Z skipping since configuration is not implemented
2019-04-29T19:05:57.484Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:05:57.487Z Generating 100000 events in batch mode
Apr 29, 2019 7:05:57 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`, `side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`, `bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS `side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`, `bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`, `side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 29, 2019 7:05:57 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 29, 2019 7:05:57 PM org.apache.beam.sdk.extensions.sql.impl.BeamQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)], expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2019-04-29T19:06:08.318Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; streamTimeout:60
2019-04-29T19:06:08.319Z skipping since configuration is not implemented
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 43s
71 actionable tasks: 2 executed, 69 up-to-date
Publishing build scan...
https://gradle.com/s/yxnu7wpjwa4zu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org