You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Maximilian Alber <al...@gmail.com> on 2014/11/28 15:18:07 UTC
Illegal State in Bulk Iteration
Hi Flinksters!
I try to write a BulkIteration. Somehow I get a cryptic error message, at
least I have no clue what's wrong:
Code:
var width = env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) *
config.startWidth)) map {x => new Vector(0, x.values)}
var update = env.fromCollection[Vector](Seq(Vector.ones(config.dimensions)
* 0.01F)) map {x => new Vector(1, x.values)}
var lastGradient =
env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
new Vector(2, x.values)}
var stepSet = width union update union lastGradient
stepSet = stepSet.iterate(config.gradientDescentIterations){
stepSet =>
var width = stepSet filter {_.id == 0}
var update = stepSet filter {_.id == 1}
var lastGradient = stepSet filter {_.id == 2}
val gradient = getGradient(X, residual, center, width)
val term = gradient * lastGradient
lastGradient = gradient
update = update.map(new RichMapFunction[Vector, Vector]{
var term: Vector = null
val minWidthUpdate = 0.00000001F
val maxWidthUpdate = 10.0F
override def open(config: Configuration) = {
term = getRuntimeContext.getBroadcastVariable("term").toList.head
}
def map(x: Vector) = {x.condMul(term.isLess(0),
0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
}).withBroadcastSet(term, "term")
/*
width = width.map(new RichMapFunction[Vector, Vector]{
var update: Vector = null
var gradient: Vector = null
override def open(config: Configuration) = {
update =
getRuntimeContext.getBroadcastVariable("update").toList.head
gradient =
getRuntimeContext.getBroadcastVariable("gradient").toList.head
}
def map(x: Vector) = {(x + update * (gradient
sign)).clip(config.minWidth, config.maxWidth)}
}).withBroadcastSet(update, "update")withBroadcastSet(gradient,
"gradient")
*/
width union update union lastGradient
}
Error:
java.lang.IllegalStateException
at
org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
at
org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
at
org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
at
org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
at
org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at
org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at
org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at
org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
at
org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
at
org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
at
org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
at org.apache.flink.client.program.Client.run(Client.java:288)
at org.apache.flink.client.program.Client.run(Client.java:231)
at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
at
org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
Thanks!
Cheers,
Max
Re: Illegal State in Bulk Iteration
Posted by Maximilian Alber <al...@gmail.com>.
Hi!
Seems to be fixed! Thanks!
Yeah, I know (even though I never took a look).
The program is a (simple) Machine Learning algorithm invented by Mikio
Braun.
Cheers,
Max
On Wed, Dec 10, 2014 at 5:23 PM, Kostas Tzoumas <kt...@apache.org> wrote:
> Wow! Maximilian, out of curiosity, what does this program compute?
>
> On Wed, Dec 10, 2014 at 4:03 PM, Stephan Ewen <se...@apache.org> wrote:
>
>> Hi Maximilian!
>>
>> I have pushed a fix for bug you encountered in the current master. It way
>> a tricky corner case, you are stressing the compiler quite a bit ;-)
>>
>> Attached is a JSON dump of your program's plan. If you want to see what
>> it looks like, paste it to the plan visualizer. It is huge !
>>
>> Here are links to some screenshots:
>>
>> - https://dl.dropboxusercontent.com/u/109654984/screenshot1.png
>> - https://dl.dropboxusercontent.com/u/109654984/screenshot2.png
>> - https://dl.dropboxusercontent.com/u/109654984/screenshot3.png
>> - https://dl.dropboxusercontent.com/u/109654984/screenshot4.png
>> - https://dl.dropboxusercontent.com/u/109654984/screenshot5.png
>>
>> Greetings,
>> Stephan
>>
>> --------------
>>
>>
>> {
>> "nodes": [
>>
>> {
>> "id": 8,
>> "type": "source",
>> "pact": "Data Source",
>> "contents": "at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47)
>> (org.apache.flink.api.java.io.TextInputFormat)",
>> "parallelism": "8",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "4.29 K" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "4.29 K" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "4.29 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 7,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 8, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "4.29 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 6,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:48)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 7, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "2.15 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 14,
>> "type": "source",
>> "pact": "Data Source",
>> "contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:73)
>> (org.apache.flink.api.java.io.CollectionInputFormat)",
>> "parallelism": "1",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 16,
>> "type": "source",
>> "pact": "Data Source",
>> "contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:74)
>> (org.apache.flink.api.java.io.CollectionInputFormat)",
>> "parallelism": "1",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 19,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 7, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "2.15 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 18,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]",
>> "temp_mode": "PIPELINE_BREAKER"},
>> {"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 17,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 18, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 15,
>> "type": "pact",
>> "pact": "Union",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 16, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 17, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "step_function": [
>> {
>> "id": 23,
>> "type": "pact",
>> "pact": "Workset",
>> "contents": "Workset Place Holder",
>> "parallelism": "8",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 22,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:83)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 23, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 26,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:80)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 23, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 28,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:77)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 23, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 27,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 28, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 25,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 26, "side": "first", "ship_strategy": "Forward", "temp_mode":
>> "PIPELINE_BREAKER"},
>> {"id": 27, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.VectorDataSet$.neutralize(util.scala:389))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 24,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.add(util.scala:346)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 25, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 21,
>> "type": "pact",
>> "pact": "Union",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 22, "side": "first", "ship_strategy": "Forward"},
>> {"id": 24, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 20,
>> "type": "pact",
>> "pact": "No Op",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 21, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "No-Op",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 30,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:84)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 24, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 29,
>> "type": "pact",
>> "pact": "Solution-Set Delta",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 30, "ship_strategy": "Hash Partition on [0]", "temp_mode":
>> "PIPELINE_BREAKER"}
>> ],
>> "driver_strategy": "No-Op",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> }
>> ],
>> "workset": 23,
>> "solution_set": null,
>> "next_workset": 20,
>> "solution_delta": 29,
>> "id": 13,
>> "type": "workset_iteration",
>> "pact": "Workset Iteration",
>> "contents": "Unnamed Delta Iteration",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 14, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 15, "side": "second", "ship_strategy": "Forward"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 34,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 17, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 33,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 34, "ship_strategy": "Redistribute"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 38,
>> "type": "source",
>> "pact": "Data Source",
>> "contents": "at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50)
>> (org.apache.flink.api.java.io.TextInputFormat)",
>> "parallelism": "8",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "1.50 K" },
>> { "name": "Est. Cardinality", "value": "30.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "1.50 K" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 37,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 38, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "30.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 36,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost.calcCenter(BumpBoost.scala:71)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 37, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "15.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 35,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 36, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "15.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 32,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 33, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 35, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.VectorDataSet$.neutralize(util.scala:389))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 31,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 32, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 12,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost.calcCenter(BumpBoost.scala:90)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 13, "side": "first", "ship_strategy": "Forward"},
>> {"id": 31, "side": "second", "ship_strategy": "Broadcast"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 11,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:96)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 12, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 10,
>> "type": "pact",
>> "pact": "GroupReduce",
>> "contents": "SUM(0)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 11, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Group Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 9,
>> "type": "pact",
>> "pact": "GroupReduce",
>> "contents": "SUM(0)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 10, "ship_strategy": "Redistribute"}
>> ],
>> "driver_strategy": "Group Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 5,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost.calcCenter(BumpBoost.scala:98)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
>> "PIPELINE_BREAKER"},
>> {"id": 9, "side": "second", "ship_strategy": "Broadcast"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "50.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 4,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 5, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "50.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 3,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:62)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 4, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "50.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 45,
>> "type": "source",
>> "pact": "Data Source",
>> "contents": "at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181)
>> (org.apache.flink.api.java.io.CollectionInputFormat)",
>> "parallelism": "1",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 44,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 45, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 47,
>> "type": "source",
>> "pact": "Data Source",
>> "contents": "at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182)
>> (org.apache.flink.api.java.io.CollectionInputFormat)",
>> "parallelism": "1",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 46,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 47, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 49,
>> "type": "source",
>> "pact": "Data Source",
>> "contents": "at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183)
>> (org.apache.flink.api.java.io.CollectionInputFormat)",
>> "parallelism": "1",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 48,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 49, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 43,
>> "type": "pact",
>> "pact": "Union",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 44, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 46, "side": "second", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 48, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "step_function": [
>> {
>> "id": 53,
>> "type": "pact",
>> "pact": "Bulk Partial Solution",
>> "contents": "Partial Solution",
>> "parallelism": "8",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 52,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:188)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 53, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 55,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:189)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 53, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 67,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:128)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 52, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 66,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:131)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
>> "CACHING_PIPELINE_BREAKER"},
>> {"id": 4, "side": "second", "ship_strategy": "Broadcast"},
>> {"id": 67, "side": "second", "ship_strategy": "Broadcast"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 69,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:124)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 52, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 68,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
>> "CACHING_PIPELINE_BREAKER"},
>> {"id": 4, "side": "second", "ship_strategy": "Broadcast"},
>> {"id": 69, "side": "second", "ship_strategy": "Broadcast"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 65,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 66, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 64,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 65, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 80,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (CACHED) (build: Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 79,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 80, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 78,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 79, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 77,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 78, "ship_strategy": "Redistribute"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 84,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]",
>> "temp_mode": "PIPELINE_BREAKER"},
>> {"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 83,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 84, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 82,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 83, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 81,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 82, "ship_strategy": "Redistribute"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 76,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 77, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 81, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Reduce at
>> bumpboost.VectorDataSet$.sumV(util.scala:375))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 75,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 76, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 74,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 75, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 73,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 74, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 72,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 73, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 71,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 72, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (CACHED) (build: Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 70,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.subt(util.scala:347)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 71, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 63,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 64, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 70, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.VectorDataSet$.subt(util.scala:347))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 62,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 63, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 61,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 62, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 60,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 61, "ship_strategy": "Redistribute"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 85,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:368)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 74, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 59,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 60, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 85, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.VectorDataSet$.mult(util.scala:368))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 58,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 59, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 86,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 53, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "0.0" },
>> { "name": "Cumulative Disk I/O", "value": "0.0" },
>> { "name": "Cumulative CPU", "value": "0.0" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 57,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 58, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 86, "side": "second", "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Filter at
>> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 56,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 57, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 54,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:196)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 55, "side": "first", "ship_strategy": "Forward", "temp_mode":
>> "PIPELINE_BREAKER"},
>> {"id": 56, "side": "second", "ship_strategy": "Broadcast"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 51,
>> "type": "pact",
>> "pact": "Union",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 52, "side": "first", "ship_strategy": "Forward"},
>> {"id": 54, "side": "second", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 58, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 50,
>> "type": "pact",
>> "pact": "No Op",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 51, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "No-Op",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> }
>> ],
>> "partial_solution": 53,
>> "next_partial_solution": 50,
>> "id": 42,
>> "type": "bulk_iteration",
>> "pact": "Bulk Iteration",
>> "contents": "Bulk Iteration",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 43, "ship_strategy": "Forward"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 41,
>> "type": "pact",
>> "pact": "Filter",
>> "contents": "Filter at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 42, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "FlatMap",
>> "global_properties": [
>> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
>> { "name": "Partitioned on", "value": "[0]" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "0.0" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 40,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 41, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 39,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:63)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 40, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "0.0" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 95,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
>> "PIPELINE_BREAKER"},
>> {"id": 4, "side": "second", "ship_strategy": "Broadcast"},
>> {"id": 40, "side": "second", "ship_strategy": "Broadcast"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 94,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 93,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 94, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 92,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 93, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 91,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 92, "ship_strategy": "Redistribute"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 99,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]",
>> "temp_mode": "PIPELINE_BREAKER"},
>> {"id": 95, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Map at
>> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 98,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 99, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 97,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 98, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "101.00" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 96,
>> "type": "pact",
>> "pact": "Reduce",
>> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
>> "parallelism": "1",
>> "predecessors": [
>> {"id": 97, "ship_strategy": "Redistribute"}
>> ],
>> "driver_strategy": "Reduce All",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 90,
>> "type": "pact",
>> "pact": "Join",
>> "contents": "Join at
>> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 91, "side": "first", "ship_strategy": "Hash Partition on [0]"},
>> {"id": 96, "side": "second", "ship_strategy": "Hash Partition on [0]"}
>> ],
>> "driver_strategy": "Hybrid Hash (build: Reduce at
>> bumpboost.VectorDataSet$.sumV(util.scala:375))",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "(unknown)" },
>> { "name": "Disk I/O", "value": "(unknown)" },
>> { "name": "CPU", "value": "(unknown)" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 89,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 90, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 88,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 89, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 87,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:64)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 88, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 2,
>> "type": "pact",
>> "pact": "Union",
>> "contents": "",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 3, "side": "first", "ship_strategy": "Forward"},
>> {"id": 39, "side": "second", "ship_strategy": "Forward"},
>> {"id": 87, "side": "second", "ship_strategy": "Forward"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 1,
>> "type": "pact",
>> "pact": "Map",
>> "contents": "Map at
>> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:66)",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 2, "ship_strategy": "Forward"}
>> ],
>> "driver_strategy": "Map",
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> },
>> {
>> "id": 0,
>> "type": "sink",
>> "pact": "Data Sink",
>> "contents": "TextOutputFormat (/tmp/bumpboosttest) - UTF-8",
>> "parallelism": "8",
>> "predecessors": [
>> {"id": 1, "ship_strategy": "Forward"}
>> ],
>> "global_properties": [
>> { "name": "Partitioning", "value": "RANDOM" },
>> { "name": "Partitioning Order", "value": "(none)" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "local_properties": [
>> { "name": "Order", "value": "(none)" },
>> { "name": "Grouping", "value": "not grouped" },
>> { "name": "Uniqueness", "value": "not unique" }
>> ],
>> "estimates": [
>> { "name": "Est. Output Size", "value": "(unknown)" },
>> { "name": "Est. Cardinality", "value": "(unknown)" } ],
>> "costs": [
>> { "name": "Network", "value": "0.0" },
>> { "name": "Disk I/O", "value": "0.0" },
>> { "name": "CPU", "value": "0.0" },
>> { "name": "Cumulative Network", "value": "(unknown)" },
>> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
>> { "name": "Cumulative CPU", "value": "(unknown)" }
>> ],
>> "compiler_hints": [
>> { "name": "Output Size (bytes)", "value": "(none)" },
>> { "name": "Output Cardinality", "value": "(none)" },
>> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
>> { "name": "Filter Factor", "value": "(none)" } ]
>> }
>> ]
>> }
>>
>>
>>
>> On Tue, Dec 9, 2014 at 9:31 AM, Maximilian Alber <
>> alber.maximilian@gmail.com> wrote:
>>
>>> Sorry! Sure! Please use the settings I posted above, I just saw in other
>>> cases I get other strange error messages...
>>>
>>> On Mon, Dec 8, 2014 at 8:36 PM, Stephan Ewen <se...@apache.org> wrote:
>>>
>>>> Hey!
>>>>
>>>> Could you share the source code with us? It makes the debugging much
>>>> much simpler ;-)
>>>>
>>>> Stephan
>>>>
>>>>
>>>> On Thu, Dec 4, 2014 at 1:40 PM, Maximilian Alber <
>>>> alber.maximilian@gmail.com> wrote:
>>>>
>>>>> Could you reproduce the error now?
>>>>>
>>>>>
>>>>> On Mon, Dec 1, 2014 at 5:12 PM, Maximilian Alber <
>>>>> alber.maximilian@gmail.com> wrote:
>>>>>
>>>>>> Sure.
>>>>>> Those are the params (in_file and random_file need to be set,
>>>>>> out_file you can choose a name.):
>>>>>>
>>>>>> flink 'run', '-v',
>>>>>> '/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar',
>>>>>> '-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn',
>>>>>> 'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30',
>>>>>> 'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False',
>>>>>> 'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08',
>>>>>> 'max_width_update=10'
>>>>>>
>>>>>> On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <se...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi!
>>>>>>>
>>>>>>> I have been trying to re-implement the program you sent here (the
>>>>>>> code is incomplete), but I cannot trigger the exception. Can you send us
>>>>>>> the complete example?
>>>>>>>
>>>>>>> Stephan
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
>>>>>>> alber.maximilian@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Flinksters!
>>>>>>>>
>>>>>>>> I try to write a BulkIteration. Somehow I get a cryptic error
>>>>>>>> message, at least I have no clue what's wrong:
>>>>>>>>
>>>>>>>> Code:
>>>>>>>>
>>>>>>>> var width =
>>>>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) *
>>>>>>>> config.startWidth)) map {x => new Vector(0, x.values)}
>>>>>>>> var update =
>>>>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map
>>>>>>>> {x => new Vector(1, x.values)}
>>>>>>>> var lastGradient =
>>>>>>>> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
>>>>>>>> new Vector(2, x.values)}
>>>>>>>>
>>>>>>>> var stepSet = width union update union lastGradient
>>>>>>>> stepSet = stepSet.iterate(config.gradientDescentIterations){
>>>>>>>> stepSet =>
>>>>>>>> var width = stepSet filter {_.id == 0}
>>>>>>>> var update = stepSet filter {_.id == 1}
>>>>>>>> var lastGradient = stepSet filter {_.id == 2}
>>>>>>>>
>>>>>>>> val gradient = getGradient(X, residual, center, width)
>>>>>>>> val term = gradient * lastGradient
>>>>>>>> lastGradient = gradient
>>>>>>>>
>>>>>>>> update = update.map(new RichMapFunction[Vector, Vector]{
>>>>>>>> var term: Vector = null
>>>>>>>> val minWidthUpdate = 0.00000001F
>>>>>>>> val maxWidthUpdate = 10.0F
>>>>>>>> override def open(config: Configuration) = {
>>>>>>>> term =
>>>>>>>> getRuntimeContext.getBroadcastVariable("term").toList.head
>>>>>>>> }
>>>>>>>>
>>>>>>>> def map(x: Vector) = {x.condMul(term.isLess(0),
>>>>>>>> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
>>>>>>>> }).withBroadcastSet(term, "term")
>>>>>>>> /*
>>>>>>>> width = width.map(new RichMapFunction[Vector, Vector]{
>>>>>>>> var update: Vector = null
>>>>>>>> var gradient: Vector = null
>>>>>>>> override def open(config: Configuration) = {
>>>>>>>> update =
>>>>>>>> getRuntimeContext.getBroadcastVariable("update").toList.head
>>>>>>>> gradient =
>>>>>>>> getRuntimeContext.getBroadcastVariable("gradient").toList.head
>>>>>>>> }
>>>>>>>>
>>>>>>>> def map(x: Vector) = {(x + update * (gradient
>>>>>>>> sign)).clip(config.minWidth, config.maxWidth)}
>>>>>>>> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
>>>>>>>> "gradient")
>>>>>>>> */
>>>>>>>>
>>>>>>>> width union update union lastGradient
>>>>>>>> }
>>>>>>>>
>>>>>>>>
>>>>>>>> Error:
>>>>>>>>
>>>>>>>> java.lang.IllegalStateException
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
>>>>>>>> at
>>>>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
>>>>>>>> at
>>>>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
>>>>>>>> at
>>>>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
>>>>>>>> at org.apache.flink.client.program.Client.run(Client.java:288)
>>>>>>>> at org.apache.flink.client.program.Client.run(Client.java:231)
>>>>>>>> at
>>>>>>>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
>>>>>>>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
>>>>>>>> at
>>>>>>>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
>>>>>>>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>>>>>>>>
>>>>>>>> Thanks!
>>>>>>>> Cheers,
>>>>>>>> Max
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Illegal State in Bulk Iteration
Posted by Kostas Tzoumas <kt...@apache.org>.
Wow! Maximilian, out of curiosity, what does this program compute?
On Wed, Dec 10, 2014 at 4:03 PM, Stephan Ewen <se...@apache.org> wrote:
> Hi Maximilian!
>
> I have pushed a fix for bug you encountered in the current master. It way
> a tricky corner case, you are stressing the compiler quite a bit ;-)
>
> Attached is a JSON dump of your program's plan. If you want to see what it
> looks like, paste it to the plan visualizer. It is huge !
>
> Here are links to some screenshots:
>
> - https://dl.dropboxusercontent.com/u/109654984/screenshot1.png
> - https://dl.dropboxusercontent.com/u/109654984/screenshot2.png
> - https://dl.dropboxusercontent.com/u/109654984/screenshot3.png
> - https://dl.dropboxusercontent.com/u/109654984/screenshot4.png
> - https://dl.dropboxusercontent.com/u/109654984/screenshot5.png
>
> Greetings,
> Stephan
>
> --------------
>
>
> {
> "nodes": [
>
> {
> "id": 8,
> "type": "source",
> "pact": "Data Source",
> "contents": "at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47)
> (org.apache.flink.api.java.io.TextInputFormat)",
> "parallelism": "8",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "4.29 K" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "4.29 K" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "4.29 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 7,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47)",
> "parallelism": "8",
> "predecessors": [
> {"id": 8, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "4.29 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 6,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:48)",
> "parallelism": "8",
> "predecessors": [
> {"id": 7, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "2.15 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 14,
> "type": "source",
> "pact": "Data Source",
> "contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:73)
> (org.apache.flink.api.java.io.CollectionInputFormat)",
> "parallelism": "1",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 16,
> "type": "source",
> "pact": "Data Source",
> "contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:74)
> (org.apache.flink.api.java.io.CollectionInputFormat)",
> "parallelism": "1",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 19,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49)",
> "parallelism": "8",
> "predecessors": [
> {"id": 7, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "2.15 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 18,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]",
> "temp_mode": "PIPELINE_BREAKER"},
> {"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 17,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 18, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 15,
> "type": "pact",
> "pact": "Union",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 16, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 17, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "step_function": [
> {
> "id": 23,
> "type": "pact",
> "pact": "Workset",
> "contents": "Workset Place Holder",
> "parallelism": "8",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 22,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at
> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:83)",
> "parallelism": "8",
> "predecessors": [
> {"id": 23, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 26,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at
> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:80)",
> "parallelism": "8",
> "predecessors": [
> {"id": 23, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 28,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at
> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:77)",
> "parallelism": "8",
> "predecessors": [
> {"id": 23, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 27,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
> "parallelism": "8",
> "predecessors": [
> {"id": 28, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 25,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 26, "side": "first", "ship_strategy": "Forward", "temp_mode":
> "PIPELINE_BREAKER"},
> {"id": 27, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.VectorDataSet$.neutralize(util.scala:389))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 24,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.add(util.scala:346)",
> "parallelism": "8",
> "predecessors": [
> {"id": 25, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 21,
> "type": "pact",
> "pact": "Union",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 22, "side": "first", "ship_strategy": "Forward"},
> {"id": 24, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 20,
> "type": "pact",
> "pact": "No Op",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 21, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "No-Op",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 30,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:84)",
> "parallelism": "8",
> "predecessors": [
> {"id": 24, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 29,
> "type": "pact",
> "pact": "Solution-Set Delta",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 30, "ship_strategy": "Hash Partition on [0]", "temp_mode":
> "PIPELINE_BREAKER"}
> ],
> "driver_strategy": "No-Op",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> }
> ],
> "workset": 23,
> "solution_set": null,
> "next_workset": 20,
> "solution_delta": 29,
> "id": 13,
> "type": "workset_iteration",
> "pact": "Workset Iteration",
> "contents": "Unnamed Delta Iteration",
> "parallelism": "8",
> "predecessors": [
> {"id": 14, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 15, "side": "second", "ship_strategy": "Forward"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 34,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "8",
> "predecessors": [
> {"id": 17, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 33,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "1",
> "predecessors": [
> {"id": 34, "ship_strategy": "Redistribute"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 38,
> "type": "source",
> "pact": "Data Source",
> "contents": "at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50)
> (org.apache.flink.api.java.io.TextInputFormat)",
> "parallelism": "8",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "1.50 K" },
> { "name": "Est. Cardinality", "value": "30.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "1.50 K" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 37,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50)",
> "parallelism": "8",
> "predecessors": [
> {"id": 38, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "30.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 36,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:71)",
> "parallelism": "8",
> "predecessors": [
> {"id": 37, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "15.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 35,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
> "parallelism": "8",
> "predecessors": [
> {"id": 36, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "15.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "1.50 K" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 32,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 33, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 35, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.VectorDataSet$.neutralize(util.scala:389))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 31,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 32, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 12,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:90)",
> "parallelism": "8",
> "predecessors": [
> {"id": 13, "side": "first", "ship_strategy": "Forward"},
> {"id": 31, "side": "second", "ship_strategy": "Broadcast"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 11,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:96)",
> "parallelism": "8",
> "predecessors": [
> {"id": 12, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 10,
> "type": "pact",
> "pact": "GroupReduce",
> "contents": "SUM(0)",
> "parallelism": "8",
> "predecessors": [
> {"id": 11, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Group Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 9,
> "type": "pact",
> "pact": "GroupReduce",
> "contents": "SUM(0)",
> "parallelism": "1",
> "predecessors": [
> {"id": 10, "ship_strategy": "Redistribute"}
> ],
> "driver_strategy": "Group Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 5,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:98)",
> "parallelism": "8",
> "predecessors": [
> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
> "PIPELINE_BREAKER"},
> {"id": 9, "side": "second", "ship_strategy": "Broadcast"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "50.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 4,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
> "parallelism": "8",
> "predecessors": [
> {"id": 5, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "50.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 3,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:62)",
> "parallelism": "8",
> "predecessors": [
> {"id": 4, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "50.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 45,
> "type": "source",
> "pact": "Data Source",
> "contents": "at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181)
> (org.apache.flink.api.java.io.CollectionInputFormat)",
> "parallelism": "1",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 44,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181)",
> "parallelism": "1",
> "predecessors": [
> {"id": 45, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 47,
> "type": "source",
> "pact": "Data Source",
> "contents": "at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182)
> (org.apache.flink.api.java.io.CollectionInputFormat)",
> "parallelism": "1",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 46,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182)",
> "parallelism": "1",
> "predecessors": [
> {"id": 47, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 49,
> "type": "source",
> "pact": "Data Source",
> "contents": "at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183)
> (org.apache.flink.api.java.io.CollectionInputFormat)",
> "parallelism": "1",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 48,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183)",
> "parallelism": "1",
> "predecessors": [
> {"id": 49, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 43,
> "type": "pact",
> "pact": "Union",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 44, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 46, "side": "second", "ship_strategy": "Hash Partition on [0]"},
> {"id": 48, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "step_function": [
> {
> "id": 53,
> "type": "pact",
> "pact": "Bulk Partial Solution",
> "contents": "Partial Solution",
> "parallelism": "8",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 52,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at
> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:188)",
> "parallelism": "8",
> "predecessors": [
> {"id": 53, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 55,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at
> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:189)",
> "parallelism": "8",
> "predecessors": [
> {"id": 53, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 67,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:128)",
> "parallelism": "8",
> "predecessors": [
> {"id": 52, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 66,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:131)",
> "parallelism": "8",
> "predecessors": [
> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
> "CACHING_PIPELINE_BREAKER"},
> {"id": 4, "side": "second", "ship_strategy": "Broadcast"},
> {"id": 67, "side": "second", "ship_strategy": "Broadcast"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 69,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:124)",
> "parallelism": "8",
> "predecessors": [
> {"id": 52, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 68,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",
> "parallelism": "8",
> "predecessors": [
> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
> "CACHING_PIPELINE_BREAKER"},
> {"id": 4, "side": "second", "ship_strategy": "Broadcast"},
> {"id": 69, "side": "second", "ship_strategy": "Broadcast"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 65,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 66, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 64,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 65, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 80,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (CACHED) (build: Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 79,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 80, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 78,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "8",
> "predecessors": [
> {"id": 79, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 77,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "1",
> "predecessors": [
> {"id": 78, "ship_strategy": "Redistribute"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 84,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]",
> "temp_mode": "PIPELINE_BREAKER"},
> {"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 83,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 84, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 82,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "8",
> "predecessors": [
> {"id": 83, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 81,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "1",
> "predecessors": [
> {"id": 82, "ship_strategy": "Redistribute"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 76,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 77, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 81, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Reduce at
> bumpboost.VectorDataSet$.sumV(util.scala:375))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 75,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",
> "parallelism": "8",
> "predecessors": [
> {"id": 76, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 74,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
> "parallelism": "8",
> "predecessors": [
> {"id": 75, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 73,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 74, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 72,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 73, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 71,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 72, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (CACHED) (build: Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 70,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.subt(util.scala:347)",
> "parallelism": "8",
> "predecessors": [
> {"id": 71, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 63,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 64, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 70, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.VectorDataSet$.subt(util.scala:347))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 62,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 63, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 61,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "8",
> "predecessors": [
> {"id": 62, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 60,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "1",
> "predecessors": [
> {"id": 61, "ship_strategy": "Redistribute"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 85,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:368)",
> "parallelism": "8",
> "predecessors": [
> {"id": 74, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 59,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 60, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 85, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.VectorDataSet$.mult(util.scala:368))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 58,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 59, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 86,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at
> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190)",
> "parallelism": "8",
> "predecessors": [
> {"id": 53, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "0.0" },
> { "name": "Cumulative Disk I/O", "value": "0.0" },
> { "name": "Cumulative CPU", "value": "0.0" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 57,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 58, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 86, "side": "second", "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Hybrid Hash (build: Filter at
> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 56,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 57, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 54,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:196)",
> "parallelism": "8",
> "predecessors": [
> {"id": 55, "side": "first", "ship_strategy": "Forward", "temp_mode":
> "PIPELINE_BREAKER"},
> {"id": 56, "side": "second", "ship_strategy": "Broadcast"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 51,
> "type": "pact",
> "pact": "Union",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 52, "side": "first", "ship_strategy": "Forward"},
> {"id": 54, "side": "second", "ship_strategy": "Hash Partition on [0]"},
> {"id": 58, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 50,
> "type": "pact",
> "pact": "No Op",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 51, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "No-Op",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> }
> ],
> "partial_solution": 53,
> "next_partial_solution": 50,
> "id": 42,
> "type": "bulk_iteration",
> "pact": "Bulk Iteration",
> "contents": "Bulk Iteration",
> "parallelism": "8",
> "predecessors": [
> {"id": 43, "ship_strategy": "Forward"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 41,
> "type": "pact",
> "pact": "Filter",
> "contents": "Filter at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",
> "parallelism": "8",
> "predecessors": [
> {"id": 42, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "FlatMap",
> "global_properties": [
> { "name": "Partitioning", "value": "HASH_PARTITIONED" },
> { "name": "Partitioned on", "value": "[0]" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "0.0" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 40,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",
> "parallelism": "8",
> "predecessors": [
> {"id": 41, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 39,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:63)",
> "parallelism": "8",
> "predecessors": [
> {"id": 40, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "0.0" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 95,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",
> "parallelism": "8",
> "predecessors": [
> {"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
> "PIPELINE_BREAKER"},
> {"id": 4, "side": "second", "ship_strategy": "Broadcast"},
> {"id": 40, "side": "second", "ship_strategy": "Broadcast"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 94,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 93,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 94, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 92,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "8",
> "predecessors": [
> {"id": 93, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 91,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "1",
> "predecessors": [
> {"id": 92, "ship_strategy": "Redistribute"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 99,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]",
> "temp_mode": "PIPELINE_BREAKER"},
> {"id": 95, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Map at
> bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 98,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
> "parallelism": "8",
> "predecessors": [
> {"id": 99, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 97,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "8",
> "predecessors": [
> {"id": 98, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "101.00" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 96,
> "type": "pact",
> "pact": "Reduce",
> "contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
> "parallelism": "1",
> "predecessors": [
> {"id": 97, "ship_strategy": "Redistribute"}
> ],
> "driver_strategy": "Reduce All",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 90,
> "type": "pact",
> "pact": "Join",
> "contents": "Join at
> org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
> "parallelism": "8",
> "predecessors": [
> {"id": 91, "side": "first", "ship_strategy": "Hash Partition on [0]"},
> {"id": 96, "side": "second", "ship_strategy": "Hash Partition on [0]"}
> ],
> "driver_strategy": "Hybrid Hash (build: Reduce at
> bumpboost.VectorDataSet$.sumV(util.scala:375))",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "(unknown)" },
> { "name": "Disk I/O", "value": "(unknown)" },
> { "name": "CPU", "value": "(unknown)" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 89,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",
> "parallelism": "8",
> "predecessors": [
> {"id": 90, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 88,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
> "parallelism": "8",
> "predecessors": [
> {"id": 89, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 87,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:64)",
> "parallelism": "8",
> "predecessors": [
> {"id": 88, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 2,
> "type": "pact",
> "pact": "Union",
> "contents": "",
> "parallelism": "8",
> "predecessors": [
> {"id": 3, "side": "first", "ship_strategy": "Forward"},
> {"id": 39, "side": "second", "ship_strategy": "Forward"},
> {"id": 87, "side": "second", "ship_strategy": "Forward"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 1,
> "type": "pact",
> "pact": "Map",
> "contents": "Map at
> bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:66)",
> "parallelism": "8",
> "predecessors": [
> {"id": 2, "ship_strategy": "Forward"}
> ],
> "driver_strategy": "Map",
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> },
> {
> "id": 0,
> "type": "sink",
> "pact": "Data Sink",
> "contents": "TextOutputFormat (/tmp/bumpboosttest) - UTF-8",
> "parallelism": "8",
> "predecessors": [
> {"id": 1, "ship_strategy": "Forward"}
> ],
> "global_properties": [
> { "name": "Partitioning", "value": "RANDOM" },
> { "name": "Partitioning Order", "value": "(none)" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "local_properties": [
> { "name": "Order", "value": "(none)" },
> { "name": "Grouping", "value": "not grouped" },
> { "name": "Uniqueness", "value": "not unique" }
> ],
> "estimates": [
> { "name": "Est. Output Size", "value": "(unknown)" },
> { "name": "Est. Cardinality", "value": "(unknown)" } ],
> "costs": [
> { "name": "Network", "value": "0.0" },
> { "name": "Disk I/O", "value": "0.0" },
> { "name": "CPU", "value": "0.0" },
> { "name": "Cumulative Network", "value": "(unknown)" },
> { "name": "Cumulative Disk I/O", "value": "(unknown)" },
> { "name": "Cumulative CPU", "value": "(unknown)" }
> ],
> "compiler_hints": [
> { "name": "Output Size (bytes)", "value": "(none)" },
> { "name": "Output Cardinality", "value": "(none)" },
> { "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
> { "name": "Filter Factor", "value": "(none)" } ]
> }
> ]
> }
>
>
>
> On Tue, Dec 9, 2014 at 9:31 AM, Maximilian Alber <
> alber.maximilian@gmail.com> wrote:
>
>> Sorry! Sure! Please use the settings I posted above, I just saw in other
>> cases I get other strange error messages...
>>
>> On Mon, Dec 8, 2014 at 8:36 PM, Stephan Ewen <se...@apache.org> wrote:
>>
>>> Hey!
>>>
>>> Could you share the source code with us? It makes the debugging much
>>> much simpler ;-)
>>>
>>> Stephan
>>>
>>>
>>> On Thu, Dec 4, 2014 at 1:40 PM, Maximilian Alber <
>>> alber.maximilian@gmail.com> wrote:
>>>
>>>> Could you reproduce the error now?
>>>>
>>>>
>>>> On Mon, Dec 1, 2014 at 5:12 PM, Maximilian Alber <
>>>> alber.maximilian@gmail.com> wrote:
>>>>
>>>>> Sure.
>>>>> Those are the params (in_file and random_file need to be set, out_file
>>>>> you can choose a name.):
>>>>>
>>>>> flink 'run', '-v',
>>>>> '/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar',
>>>>> '-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn',
>>>>> 'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30',
>>>>> 'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False',
>>>>> 'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08',
>>>>> 'max_width_update=10'
>>>>>
>>>>> On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <se...@apache.org> wrote:
>>>>>
>>>>>> Hi!
>>>>>>
>>>>>> I have been trying to re-implement the program you sent here (the
>>>>>> code is incomplete), but I cannot trigger the exception. Can you send us
>>>>>> the complete example?
>>>>>>
>>>>>> Stephan
>>>>>>
>>>>>>
>>>>>> On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
>>>>>> alber.maximilian@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Flinksters!
>>>>>>>
>>>>>>> I try to write a BulkIteration. Somehow I get a cryptic error
>>>>>>> message, at least I have no clue what's wrong:
>>>>>>>
>>>>>>> Code:
>>>>>>>
>>>>>>> var width =
>>>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) *
>>>>>>> config.startWidth)) map {x => new Vector(0, x.values)}
>>>>>>> var update =
>>>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map
>>>>>>> {x => new Vector(1, x.values)}
>>>>>>> var lastGradient =
>>>>>>> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
>>>>>>> new Vector(2, x.values)}
>>>>>>>
>>>>>>> var stepSet = width union update union lastGradient
>>>>>>> stepSet = stepSet.iterate(config.gradientDescentIterations){
>>>>>>> stepSet =>
>>>>>>> var width = stepSet filter {_.id == 0}
>>>>>>> var update = stepSet filter {_.id == 1}
>>>>>>> var lastGradient = stepSet filter {_.id == 2}
>>>>>>>
>>>>>>> val gradient = getGradient(X, residual, center, width)
>>>>>>> val term = gradient * lastGradient
>>>>>>> lastGradient = gradient
>>>>>>>
>>>>>>> update = update.map(new RichMapFunction[Vector, Vector]{
>>>>>>> var term: Vector = null
>>>>>>> val minWidthUpdate = 0.00000001F
>>>>>>> val maxWidthUpdate = 10.0F
>>>>>>> override def open(config: Configuration) = {
>>>>>>> term =
>>>>>>> getRuntimeContext.getBroadcastVariable("term").toList.head
>>>>>>> }
>>>>>>>
>>>>>>> def map(x: Vector) = {x.condMul(term.isLess(0),
>>>>>>> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
>>>>>>> }).withBroadcastSet(term, "term")
>>>>>>> /*
>>>>>>> width = width.map(new RichMapFunction[Vector, Vector]{
>>>>>>> var update: Vector = null
>>>>>>> var gradient: Vector = null
>>>>>>> override def open(config: Configuration) = {
>>>>>>> update =
>>>>>>> getRuntimeContext.getBroadcastVariable("update").toList.head
>>>>>>> gradient =
>>>>>>> getRuntimeContext.getBroadcastVariable("gradient").toList.head
>>>>>>> }
>>>>>>>
>>>>>>> def map(x: Vector) = {(x + update * (gradient
>>>>>>> sign)).clip(config.minWidth, config.maxWidth)}
>>>>>>> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
>>>>>>> "gradient")
>>>>>>> */
>>>>>>>
>>>>>>> width union update union lastGradient
>>>>>>> }
>>>>>>>
>>>>>>>
>>>>>>> Error:
>>>>>>>
>>>>>>> java.lang.IllegalStateException
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
>>>>>>> at
>>>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
>>>>>>> at
>>>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
>>>>>>> at
>>>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
>>>>>>> at org.apache.flink.client.program.Client.run(Client.java:288)
>>>>>>> at org.apache.flink.client.program.Client.run(Client.java:231)
>>>>>>> at
>>>>>>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
>>>>>>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
>>>>>>> at
>>>>>>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
>>>>>>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>>>>>>>
>>>>>>> Thanks!
>>>>>>> Cheers,
>>>>>>> Max
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Illegal State in Bulk Iteration
Posted by Stephan Ewen <se...@apache.org>.
Hi Maximilian!
I have pushed a fix for bug you encountered in the current master. It way a
tricky corner case, you are stressing the compiler quite a bit ;-)
Attached is a JSON dump of your program's plan. If you want to see what it
looks like, paste it to the plan visualizer. It is huge !
Here are links to some screenshots:
- https://dl.dropboxusercontent.com/u/109654984/screenshot1.png
- https://dl.dropboxusercontent.com/u/109654984/screenshot2.png
- https://dl.dropboxusercontent.com/u/109654984/screenshot3.png
- https://dl.dropboxusercontent.com/u/109654984/screenshot4.png
- https://dl.dropboxusercontent.com/u/109654984/screenshot5.png
Greetings,
Stephan
--------------
{
"nodes": [
{
"id": 8,
"type": "source",
"pact": "Data Source",
"contents": "at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47)
(org.apache.flink.api.java.io.TextInputFormat)",
"parallelism": "8",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "4.29 K" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "4.29 K" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "4.29 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 7,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:47)",
"parallelism": "8",
"predecessors": [
{"id": 8, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "4.29 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 6,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:48)",
"parallelism": "8",
"predecessors": [
{"id": 7, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "2.15 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 14,
"type": "source",
"pact": "Data Source",
"contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:73)
(org.apache.flink.api.java.io.CollectionInputFormat)",
"parallelism": "1",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 16,
"type": "source",
"pact": "Data Source",
"contents": "at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:74)
(org.apache.flink.api.java.io.CollectionInputFormat)",
"parallelism": "1",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 19,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49)",
"parallelism": "8",
"predecessors": [
{"id": 7, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "2.15 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 18,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]",
"temp_mode": "PIPELINE_BREAKER"},
{"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 17,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 18, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 15,
"type": "pact",
"pact": "Union",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 16, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 17, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"step_function": [
{
"id": 23,
"type": "pact",
"pact": "Workset",
"contents": "Workset Place Holder",
"parallelism": "8",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 22,
"type": "pact",
"pact": "Filter",
"contents": "Filter at
bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:83)",
"parallelism": "8",
"predecessors": [
{"id": 23, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 26,
"type": "pact",
"pact": "Filter",
"contents": "Filter at
bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:80)",
"parallelism": "8",
"predecessors": [
{"id": 23, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 28,
"type": "pact",
"pact": "Filter",
"contents": "Filter at
bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:77)",
"parallelism": "8",
"predecessors": [
{"id": 23, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 27,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
"parallelism": "8",
"predecessors": [
{"id": 28, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 25,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 26, "side": "first", "ship_strategy": "Forward", "temp_mode":
"PIPELINE_BREAKER"},
{"id": 27, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.VectorDataSet$.neutralize(util.scala:389))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 24,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.add(util.scala:346)",
"parallelism": "8",
"predecessors": [
{"id": 25, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 21,
"type": "pact",
"pact": "Union",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 22, "side": "first", "ship_strategy": "Forward"},
{"id": 24, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 20,
"type": "pact",
"pact": "No Op",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 21, "ship_strategy": "Forward"}
],
"driver_strategy": "No-Op",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 30,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost$$anonfun$20.apply(BumpBoost.scala:84)",
"parallelism": "8",
"predecessors": [
{"id": 24, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 29,
"type": "pact",
"pact": "Solution-Set Delta",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 30, "ship_strategy": "Hash Partition on [0]", "temp_mode":
"PIPELINE_BREAKER"}
],
"driver_strategy": "No-Op",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
}
],
"workset": 23,
"solution_set": null,
"next_workset": 20,
"solution_delta": 29,
"id": 13,
"type": "workset_iteration",
"pact": "Workset Iteration",
"contents": "Unnamed Delta Iteration",
"parallelism": "8",
"predecessors": [
{"id": 14, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 15, "side": "second", "ship_strategy": "Forward"}
],
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 34,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "8",
"predecessors": [
{"id": 17, "ship_strategy": "Forward"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 33,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "1",
"predecessors": [
{"id": 34, "ship_strategy": "Redistribute"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 38,
"type": "source",
"pact": "Data Source",
"contents": "at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50)
(org.apache.flink.api.java.io.TextInputFormat)",
"parallelism": "8",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "1.50 K" },
{ "name": "Est. Cardinality", "value": "30.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "1.50 K" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "1.50 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 37,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:50)",
"parallelism": "8",
"predecessors": [
{"id": 38, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "30.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "1.50 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 36,
"type": "pact",
"pact": "Filter",
"contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:71)",
"parallelism": "8",
"predecessors": [
{"id": 37, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "15.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "1.50 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 35,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
"parallelism": "8",
"predecessors": [
{"id": 36, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "15.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "1.50 K" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 32,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 33, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 35, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.VectorDataSet$.neutralize(util.scala:389))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 31,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 32, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 12,
"type": "pact",
"pact": "Filter",
"contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:90)",
"parallelism": "8",
"predecessors": [
{"id": 13, "side": "first", "ship_strategy": "Forward"},
{"id": 31, "side": "second", "ship_strategy": "Broadcast"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 11,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:96)",
"parallelism": "8",
"predecessors": [
{"id": 12, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 10,
"type": "pact",
"pact": "GroupReduce",
"contents": "SUM(0)",
"parallelism": "8",
"predecessors": [
{"id": 11, "ship_strategy": "Forward"}
],
"driver_strategy": "Group Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 9,
"type": "pact",
"pact": "GroupReduce",
"contents": "SUM(0)",
"parallelism": "1",
"predecessors": [
{"id": 10, "ship_strategy": "Redistribute"}
],
"driver_strategy": "Group Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 5,
"type": "pact",
"pact": "Filter",
"contents": "Filter at bumpboost.BumpBoost.calcCenter(BumpBoost.scala:98)",
"parallelism": "8",
"predecessors": [
{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
"PIPELINE_BREAKER"},
{"id": 9, "side": "second", "ship_strategy": "Broadcast"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "50.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 4,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
"parallelism": "8",
"predecessors": [
{"id": 5, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "50.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 3,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:62)",
"parallelism": "8",
"predecessors": [
{"id": 4, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "50.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 45,
"type": "source",
"pact": "Data Source",
"contents": "at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181)
(org.apache.flink.api.java.io.CollectionInputFormat)",
"parallelism": "1",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 44,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:181)",
"parallelism": "1",
"predecessors": [
{"id": 45, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 47,
"type": "source",
"pact": "Data Source",
"contents": "at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182)
(org.apache.flink.api.java.io.CollectionInputFormat)",
"parallelism": "1",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 46,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:182)",
"parallelism": "1",
"predecessors": [
{"id": 47, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 49,
"type": "source",
"pact": "Data Source",
"contents": "at bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183)
(org.apache.flink.api.java.io.CollectionInputFormat)",
"parallelism": "1",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 48,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:183)",
"parallelism": "1",
"predecessors": [
{"id": 49, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 43,
"type": "pact",
"pact": "Union",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 44, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 46, "side": "second", "ship_strategy": "Hash Partition on [0]"},
{"id": 48, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"step_function": [
{
"id": 53,
"type": "pact",
"pact": "Bulk Partial Solution",
"contents": "Partial Solution",
"parallelism": "8",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 52,
"type": "pact",
"pact": "Filter",
"contents": "Filter at
bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:188)",
"parallelism": "8",
"predecessors": [
{"id": 53, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 55,
"type": "pact",
"pact": "Filter",
"contents": "Filter at
bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:189)",
"parallelism": "8",
"predecessors": [
{"id": 53, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 67,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:128)",
"parallelism": "8",
"predecessors": [
{"id": 52, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 66,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:131)",
"parallelism": "8",
"predecessors": [
{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
"CACHING_PIPELINE_BREAKER"},
{"id": 4, "side": "second", "ship_strategy": "Broadcast"},
{"id": 67, "side": "second", "ship_strategy": "Broadcast"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 69,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.BumpBoost.getGradient(BumpBoost.scala:124)",
"parallelism": "8",
"predecessors": [
{"id": 52, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 68,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",
"parallelism": "8",
"predecessors": [
{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
"CACHING_PIPELINE_BREAKER"},
{"id": 4, "side": "second", "ship_strategy": "Broadcast"},
{"id": 69, "side": "second", "ship_strategy": "Broadcast"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 65,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 66, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 64,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 65, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 80,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (CACHED) (build: Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 79,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 80, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 78,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "8",
"predecessors": [
{"id": 79, "ship_strategy": "Forward"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 77,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "1",
"predecessors": [
{"id": 78, "ship_strategy": "Redistribute"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 84,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]",
"temp_mode": "PIPELINE_BREAKER"},
{"id": 68, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 83,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 84, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 82,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "8",
"predecessors": [
{"id": 83, "ship_strategy": "Forward"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 81,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "1",
"predecessors": [
{"id": 82, "ship_strategy": "Redistribute"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 76,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 77, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 81, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Reduce at
bumpboost.VectorDataSet$.sumV(util.scala:375))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 75,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",
"parallelism": "8",
"predecessors": [
{"id": 76, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 74,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
"parallelism": "8",
"predecessors": [
{"id": 75, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 73,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 68, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 74, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 72,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 73, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 71,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 19, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 72, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (CACHED) (build: Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 70,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.subt(util.scala:347)",
"parallelism": "8",
"predecessors": [
{"id": 71, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 63,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 64, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 70, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.VectorDataSet$.subt(util.scala:347))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 62,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 63, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 61,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "8",
"predecessors": [
{"id": 62, "ship_strategy": "Forward"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 60,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "1",
"predecessors": [
{"id": 61, "ship_strategy": "Redistribute"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 85,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:368)",
"parallelism": "8",
"predecessors": [
{"id": 74, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 59,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 60, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 85, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.VectorDataSet$.mult(util.scala:368))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 58,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 59, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 86,
"type": "pact",
"pact": "Filter",
"contents": "Filter at
bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190)",
"parallelism": "8",
"predecessors": [
{"id": 53, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "0.0" },
{ "name": "Cumulative Disk I/O", "value": "0.0" },
{ "name": "Cumulative CPU", "value": "0.0" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 57,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 58, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 86, "side": "second", "ship_strategy": "Forward"}
],
"driver_strategy": "Hybrid Hash (build: Filter at
bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:190))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 56,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 57, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 54,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost$$anonfun$calcMBBWidthHeight$1.apply(BumpBoost.scala:196)",
"parallelism": "8",
"predecessors": [
{"id": 55, "side": "first", "ship_strategy": "Forward", "temp_mode":
"PIPELINE_BREAKER"},
{"id": 56, "side": "second", "ship_strategy": "Broadcast"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 51,
"type": "pact",
"pact": "Union",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 52, "side": "first", "ship_strategy": "Forward"},
{"id": 54, "side": "second", "ship_strategy": "Hash Partition on [0]"},
{"id": 58, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 50,
"type": "pact",
"pact": "No Op",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 51, "ship_strategy": "Forward"}
],
"driver_strategy": "No-Op",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
}
],
"partial_solution": 53,
"next_partial_solution": 50,
"id": 42,
"type": "bulk_iteration",
"pact": "Bulk Iteration",
"contents": "Bulk Iteration",
"parallelism": "8",
"predecessors": [
{"id": 43, "ship_strategy": "Forward"}
],
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 41,
"type": "pact",
"pact": "Filter",
"contents": "Filter at
bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",
"parallelism": "8",
"predecessors": [
{"id": 42, "ship_strategy": "Forward"}
],
"driver_strategy": "FlatMap",
"global_properties": [
{ "name": "Partitioning", "value": "HASH_PARTITIONED" },
{ "name": "Partitioned on", "value": "[0]" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "0.0" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 40,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.calcMBBWidthHeight(BumpBoost.scala:221)",
"parallelism": "8",
"predecessors": [
{"id": 41, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 39,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:63)",
"parallelism": "8",
"predecessors": [
{"id": 40, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "0.0" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 95,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111)",
"parallelism": "8",
"predecessors": [
{"id": 6, "side": "first", "ship_strategy": "Forward", "temp_mode":
"PIPELINE_BREAKER"},
{"id": 4, "side": "second", "ship_strategy": "Broadcast"},
{"id": 40, "side": "second", "ship_strategy": "Broadcast"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 94,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 19, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:49))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 93,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 94, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 92,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "8",
"predecessors": [
{"id": 93, "ship_strategy": "Forward"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 91,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "1",
"predecessors": [
{"id": 92, "ship_strategy": "Redistribute"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 99,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 95, "side": "first", "ship_strategy": "Hash Partition on [0]",
"temp_mode": "PIPELINE_BREAKER"},
{"id": 95, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Map at
bumpboost.BumpBoost.getKernelVector(BumpBoost.scala:111))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 98,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.mult(util.scala:348)",
"parallelism": "8",
"predecessors": [
{"id": 99, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 97,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "8",
"predecessors": [
{"id": 98, "ship_strategy": "Forward"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "101.00" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 96,
"type": "pact",
"pact": "Reduce",
"contents": "Reduce at bumpboost.VectorDataSet$.sumV(util.scala:375)",
"parallelism": "1",
"predecessors": [
{"id": 97, "ship_strategy": "Redistribute"}
],
"driver_strategy": "Reduce All",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 90,
"type": "pact",
"pact": "Join",
"contents": "Join at
org.apache.flink.api.scala.UnfinishedJoinOperation.finish(joinDataSet.scala:224)",
"parallelism": "8",
"predecessors": [
{"id": 91, "side": "first", "ship_strategy": "Hash Partition on [0]"},
{"id": 96, "side": "second", "ship_strategy": "Hash Partition on [0]"}
],
"driver_strategy": "Hybrid Hash (build: Reduce at
bumpboost.VectorDataSet$.sumV(util.scala:375))",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "(unknown)" },
{ "name": "Disk I/O", "value": "(unknown)" },
{ "name": "CPU", "value": "(unknown)" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 89,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.div(util.scala:349)",
"parallelism": "8",
"predecessors": [
{"id": 90, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 88,
"type": "pact",
"pact": "Map",
"contents": "Map at bumpboost.VectorDataSet$.neutralize(util.scala:389)",
"parallelism": "8",
"predecessors": [
{"id": 89, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 87,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:64)",
"parallelism": "8",
"predecessors": [
{"id": 88, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 2,
"type": "pact",
"pact": "Union",
"contents": "",
"parallelism": "8",
"predecessors": [
{"id": 3, "side": "first", "ship_strategy": "Forward"},
{"id": 39, "side": "second", "ship_strategy": "Forward"},
{"id": 87, "side": "second", "ship_strategy": "Forward"}
],
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 1,
"type": "pact",
"pact": "Map",
"contents": "Map at
bumpboost.BumpBoost.createPlanFirstIteration(BumpBoost.scala:66)",
"parallelism": "8",
"predecessors": [
{"id": 2, "ship_strategy": "Forward"}
],
"driver_strategy": "Map",
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
},
{
"id": 0,
"type": "sink",
"pact": "Data Sink",
"contents": "TextOutputFormat (/tmp/bumpboosttest) - UTF-8",
"parallelism": "8",
"predecessors": [
{"id": 1, "ship_strategy": "Forward"}
],
"global_properties": [
{ "name": "Partitioning", "value": "RANDOM" },
{ "name": "Partitioning Order", "value": "(none)" },
{ "name": "Uniqueness", "value": "not unique" }
],
"local_properties": [
{ "name": "Order", "value": "(none)" },
{ "name": "Grouping", "value": "not grouped" },
{ "name": "Uniqueness", "value": "not unique" }
],
"estimates": [
{ "name": "Est. Output Size", "value": "(unknown)" },
{ "name": "Est. Cardinality", "value": "(unknown)" } ],
"costs": [
{ "name": "Network", "value": "0.0" },
{ "name": "Disk I/O", "value": "0.0" },
{ "name": "CPU", "value": "0.0" },
{ "name": "Cumulative Network", "value": "(unknown)" },
{ "name": "Cumulative Disk I/O", "value": "(unknown)" },
{ "name": "Cumulative CPU", "value": "(unknown)" }
],
"compiler_hints": [
{ "name": "Output Size (bytes)", "value": "(none)" },
{ "name": "Output Cardinality", "value": "(none)" },
{ "name": "Avg. Output Record Size (bytes)", "value": "(none)" },
{ "name": "Filter Factor", "value": "(none)" } ]
}
]
}
On Tue, Dec 9, 2014 at 9:31 AM, Maximilian Alber <alber.maximilian@gmail.com
> wrote:
> Sorry! Sure! Please use the settings I posted above, I just saw in other
> cases I get other strange error messages...
>
> On Mon, Dec 8, 2014 at 8:36 PM, Stephan Ewen <se...@apache.org> wrote:
>
>> Hey!
>>
>> Could you share the source code with us? It makes the debugging much much
>> simpler ;-)
>>
>> Stephan
>>
>>
>> On Thu, Dec 4, 2014 at 1:40 PM, Maximilian Alber <
>> alber.maximilian@gmail.com> wrote:
>>
>>> Could you reproduce the error now?
>>>
>>>
>>> On Mon, Dec 1, 2014 at 5:12 PM, Maximilian Alber <
>>> alber.maximilian@gmail.com> wrote:
>>>
>>>> Sure.
>>>> Those are the params (in_file and random_file need to be set, out_file
>>>> you can choose a name.):
>>>>
>>>> flink 'run', '-v',
>>>> '/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar',
>>>> '-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn',
>>>> 'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30',
>>>> 'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False',
>>>> 'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08',
>>>> 'max_width_update=10'
>>>>
>>>> On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <se...@apache.org> wrote:
>>>>
>>>>> Hi!
>>>>>
>>>>> I have been trying to re-implement the program you sent here (the code
>>>>> is incomplete), but I cannot trigger the exception. Can you send us the
>>>>> complete example?
>>>>>
>>>>> Stephan
>>>>>
>>>>>
>>>>> On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
>>>>> alber.maximilian@gmail.com> wrote:
>>>>>
>>>>>> Hi Flinksters!
>>>>>>
>>>>>> I try to write a BulkIteration. Somehow I get a cryptic error
>>>>>> message, at least I have no clue what's wrong:
>>>>>>
>>>>>> Code:
>>>>>>
>>>>>> var width =
>>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) *
>>>>>> config.startWidth)) map {x => new Vector(0, x.values)}
>>>>>> var update =
>>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map
>>>>>> {x => new Vector(1, x.values)}
>>>>>> var lastGradient =
>>>>>> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
>>>>>> new Vector(2, x.values)}
>>>>>>
>>>>>> var stepSet = width union update union lastGradient
>>>>>> stepSet = stepSet.iterate(config.gradientDescentIterations){
>>>>>> stepSet =>
>>>>>> var width = stepSet filter {_.id == 0}
>>>>>> var update = stepSet filter {_.id == 1}
>>>>>> var lastGradient = stepSet filter {_.id == 2}
>>>>>>
>>>>>> val gradient = getGradient(X, residual, center, width)
>>>>>> val term = gradient * lastGradient
>>>>>> lastGradient = gradient
>>>>>>
>>>>>> update = update.map(new RichMapFunction[Vector, Vector]{
>>>>>> var term: Vector = null
>>>>>> val minWidthUpdate = 0.00000001F
>>>>>> val maxWidthUpdate = 10.0F
>>>>>> override def open(config: Configuration) = {
>>>>>> term =
>>>>>> getRuntimeContext.getBroadcastVariable("term").toList.head
>>>>>> }
>>>>>>
>>>>>> def map(x: Vector) = {x.condMul(term.isLess(0),
>>>>>> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
>>>>>> }).withBroadcastSet(term, "term")
>>>>>> /*
>>>>>> width = width.map(new RichMapFunction[Vector, Vector]{
>>>>>> var update: Vector = null
>>>>>> var gradient: Vector = null
>>>>>> override def open(config: Configuration) = {
>>>>>> update =
>>>>>> getRuntimeContext.getBroadcastVariable("update").toList.head
>>>>>> gradient =
>>>>>> getRuntimeContext.getBroadcastVariable("gradient").toList.head
>>>>>> }
>>>>>>
>>>>>> def map(x: Vector) = {(x + update * (gradient
>>>>>> sign)).clip(config.minWidth, config.maxWidth)}
>>>>>> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
>>>>>> "gradient")
>>>>>> */
>>>>>>
>>>>>> width union update union lastGradient
>>>>>> }
>>>>>>
>>>>>>
>>>>>> Error:
>>>>>>
>>>>>> java.lang.IllegalStateException
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>>> at
>>>>>> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
>>>>>> at
>>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
>>>>>> at
>>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
>>>>>> at
>>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
>>>>>> at
>>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
>>>>>> at org.apache.flink.client.program.Client.run(Client.java:288)
>>>>>> at org.apache.flink.client.program.Client.run(Client.java:231)
>>>>>> at
>>>>>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
>>>>>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
>>>>>> at
>>>>>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
>>>>>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>>>>>>
>>>>>> Thanks!
>>>>>> Cheers,
>>>>>> Max
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Illegal State in Bulk Iteration
Posted by Maximilian Alber <al...@gmail.com>.
Sorry! Sure! Please use the settings I posted above, I just saw in other
cases I get other strange error messages...
On Mon, Dec 8, 2014 at 8:36 PM, Stephan Ewen <se...@apache.org> wrote:
> Hey!
>
> Could you share the source code with us? It makes the debugging much much
> simpler ;-)
>
> Stephan
>
>
> On Thu, Dec 4, 2014 at 1:40 PM, Maximilian Alber <
> alber.maximilian@gmail.com> wrote:
>
>> Could you reproduce the error now?
>>
>>
>> On Mon, Dec 1, 2014 at 5:12 PM, Maximilian Alber <
>> alber.maximilian@gmail.com> wrote:
>>
>>> Sure.
>>> Those are the params (in_file and random_file need to be set, out_file
>>> you can choose a name.):
>>>
>>> flink 'run', '-v',
>>> '/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar',
>>> '-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn',
>>> 'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30',
>>> 'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False',
>>> 'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08',
>>> 'max_width_update=10'
>>>
>>> On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <se...@apache.org> wrote:
>>>
>>>> Hi!
>>>>
>>>> I have been trying to re-implement the program you sent here (the code
>>>> is incomplete), but I cannot trigger the exception. Can you send us the
>>>> complete example?
>>>>
>>>> Stephan
>>>>
>>>>
>>>> On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
>>>> alber.maximilian@gmail.com> wrote:
>>>>
>>>>> Hi Flinksters!
>>>>>
>>>>> I try to write a BulkIteration. Somehow I get a cryptic error message,
>>>>> at least I have no clue what's wrong:
>>>>>
>>>>> Code:
>>>>>
>>>>> var width =
>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) *
>>>>> config.startWidth)) map {x => new Vector(0, x.values)}
>>>>> var update =
>>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map
>>>>> {x => new Vector(1, x.values)}
>>>>> var lastGradient =
>>>>> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
>>>>> new Vector(2, x.values)}
>>>>>
>>>>> var stepSet = width union update union lastGradient
>>>>> stepSet = stepSet.iterate(config.gradientDescentIterations){
>>>>> stepSet =>
>>>>> var width = stepSet filter {_.id == 0}
>>>>> var update = stepSet filter {_.id == 1}
>>>>> var lastGradient = stepSet filter {_.id == 2}
>>>>>
>>>>> val gradient = getGradient(X, residual, center, width)
>>>>> val term = gradient * lastGradient
>>>>> lastGradient = gradient
>>>>>
>>>>> update = update.map(new RichMapFunction[Vector, Vector]{
>>>>> var term: Vector = null
>>>>> val minWidthUpdate = 0.00000001F
>>>>> val maxWidthUpdate = 10.0F
>>>>> override def open(config: Configuration) = {
>>>>> term =
>>>>> getRuntimeContext.getBroadcastVariable("term").toList.head
>>>>> }
>>>>>
>>>>> def map(x: Vector) = {x.condMul(term.isLess(0),
>>>>> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
>>>>> }).withBroadcastSet(term, "term")
>>>>> /*
>>>>> width = width.map(new RichMapFunction[Vector, Vector]{
>>>>> var update: Vector = null
>>>>> var gradient: Vector = null
>>>>> override def open(config: Configuration) = {
>>>>> update =
>>>>> getRuntimeContext.getBroadcastVariable("update").toList.head
>>>>> gradient =
>>>>> getRuntimeContext.getBroadcastVariable("gradient").toList.head
>>>>> }
>>>>>
>>>>> def map(x: Vector) = {(x + update * (gradient
>>>>> sign)).clip(config.minWidth, config.maxWidth)}
>>>>> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
>>>>> "gradient")
>>>>> */
>>>>>
>>>>> width union update union lastGradient
>>>>> }
>>>>>
>>>>>
>>>>> Error:
>>>>>
>>>>> java.lang.IllegalStateException
>>>>> at
>>>>> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
>>>>> at
>>>>> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
>>>>> at
>>>>> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
>>>>> at
>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
>>>>> at
>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>> at
>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>> at
>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>> at
>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
>>>>> at
>>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
>>>>> at
>>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>>> at
>>>>> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
>>>>> at
>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
>>>>> at
>>>>> org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
>>>>> at
>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
>>>>> at
>>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
>>>>> at org.apache.flink.client.program.Client.run(Client.java:288)
>>>>> at org.apache.flink.client.program.Client.run(Client.java:231)
>>>>> at
>>>>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
>>>>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
>>>>> at
>>>>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
>>>>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>>>>>
>>>>> Thanks!
>>>>> Cheers,
>>>>> Max
>>>>>
>>>>
>>>>
>>>
>>
>
Re: Illegal State in Bulk Iteration
Posted by Stephan Ewen <se...@apache.org>.
Hey!
Could you share the source code with us? It makes the debugging much much
simpler ;-)
Stephan
On Thu, Dec 4, 2014 at 1:40 PM, Maximilian Alber <alber.maximilian@gmail.com
> wrote:
> Could you reproduce the error now?
>
>
> On Mon, Dec 1, 2014 at 5:12 PM, Maximilian Alber <
> alber.maximilian@gmail.com> wrote:
>
>> Sure.
>> Those are the params (in_file and random_file need to be set, out_file
>> you can choose a name.):
>>
>> flink 'run', '-v',
>> '/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar',
>> '-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn',
>> 'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30',
>> 'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False',
>> 'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08',
>> 'max_width_update=10'
>>
>> On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <se...@apache.org> wrote:
>>
>>> Hi!
>>>
>>> I have been trying to re-implement the program you sent here (the code
>>> is incomplete), but I cannot trigger the exception. Can you send us the
>>> complete example?
>>>
>>> Stephan
>>>
>>>
>>> On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
>>> alber.maximilian@gmail.com> wrote:
>>>
>>>> Hi Flinksters!
>>>>
>>>> I try to write a BulkIteration. Somehow I get a cryptic error message,
>>>> at least I have no clue what's wrong:
>>>>
>>>> Code:
>>>>
>>>> var width =
>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) *
>>>> config.startWidth)) map {x => new Vector(0, x.values)}
>>>> var update =
>>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map
>>>> {x => new Vector(1, x.values)}
>>>> var lastGradient =
>>>> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
>>>> new Vector(2, x.values)}
>>>>
>>>> var stepSet = width union update union lastGradient
>>>> stepSet = stepSet.iterate(config.gradientDescentIterations){
>>>> stepSet =>
>>>> var width = stepSet filter {_.id == 0}
>>>> var update = stepSet filter {_.id == 1}
>>>> var lastGradient = stepSet filter {_.id == 2}
>>>>
>>>> val gradient = getGradient(X, residual, center, width)
>>>> val term = gradient * lastGradient
>>>> lastGradient = gradient
>>>>
>>>> update = update.map(new RichMapFunction[Vector, Vector]{
>>>> var term: Vector = null
>>>> val minWidthUpdate = 0.00000001F
>>>> val maxWidthUpdate = 10.0F
>>>> override def open(config: Configuration) = {
>>>> term = getRuntimeContext.getBroadcastVariable("term").toList.head
>>>> }
>>>>
>>>> def map(x: Vector) = {x.condMul(term.isLess(0),
>>>> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
>>>> }).withBroadcastSet(term, "term")
>>>> /*
>>>> width = width.map(new RichMapFunction[Vector, Vector]{
>>>> var update: Vector = null
>>>> var gradient: Vector = null
>>>> override def open(config: Configuration) = {
>>>> update =
>>>> getRuntimeContext.getBroadcastVariable("update").toList.head
>>>> gradient =
>>>> getRuntimeContext.getBroadcastVariable("gradient").toList.head
>>>> }
>>>>
>>>> def map(x: Vector) = {(x + update * (gradient
>>>> sign)).clip(config.minWidth, config.maxWidth)}
>>>> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
>>>> "gradient")
>>>> */
>>>>
>>>> width union update union lastGradient
>>>> }
>>>>
>>>>
>>>> Error:
>>>>
>>>> java.lang.IllegalStateException
>>>> at
>>>> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
>>>> at
>>>> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
>>>> at
>>>> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
>>>> at
>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
>>>> at
>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>> at
>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>> at
>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>> at
>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
>>>> at
>>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
>>>> at
>>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>>> at
>>>> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
>>>> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
>>>> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
>>>> at
>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
>>>> at
>>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
>>>> at org.apache.flink.client.program.Client.run(Client.java:288)
>>>> at org.apache.flink.client.program.Client.run(Client.java:231)
>>>> at
>>>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
>>>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
>>>> at
>>>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
>>>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>>>>
>>>> Thanks!
>>>> Cheers,
>>>> Max
>>>>
>>>
>>>
>>
>
Re: Illegal State in Bulk Iteration
Posted by Maximilian Alber <al...@gmail.com>.
Could you reproduce the error now?
On Mon, Dec 1, 2014 at 5:12 PM, Maximilian Alber <alber.maximilian@gmail.com
> wrote:
> Sure.
> Those are the params (in_file and random_file need to be set, out_file you
> can choose a name.):
>
> flink 'run', '-v',
> '/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar',
> '-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn',
> 'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30',
> 'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False',
> 'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08',
> 'max_width_update=10'
>
> On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <se...@apache.org> wrote:
>
>> Hi!
>>
>> I have been trying to re-implement the program you sent here (the code is
>> incomplete), but I cannot trigger the exception. Can you send us the
>> complete example?
>>
>> Stephan
>>
>>
>> On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
>> alber.maximilian@gmail.com> wrote:
>>
>>> Hi Flinksters!
>>>
>>> I try to write a BulkIteration. Somehow I get a cryptic error message,
>>> at least I have no clue what's wrong:
>>>
>>> Code:
>>>
>>> var width =
>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) *
>>> config.startWidth)) map {x => new Vector(0, x.values)}
>>> var update =
>>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map
>>> {x => new Vector(1, x.values)}
>>> var lastGradient =
>>> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
>>> new Vector(2, x.values)}
>>>
>>> var stepSet = width union update union lastGradient
>>> stepSet = stepSet.iterate(config.gradientDescentIterations){
>>> stepSet =>
>>> var width = stepSet filter {_.id == 0}
>>> var update = stepSet filter {_.id == 1}
>>> var lastGradient = stepSet filter {_.id == 2}
>>>
>>> val gradient = getGradient(X, residual, center, width)
>>> val term = gradient * lastGradient
>>> lastGradient = gradient
>>>
>>> update = update.map(new RichMapFunction[Vector, Vector]{
>>> var term: Vector = null
>>> val minWidthUpdate = 0.00000001F
>>> val maxWidthUpdate = 10.0F
>>> override def open(config: Configuration) = {
>>> term = getRuntimeContext.getBroadcastVariable("term").toList.head
>>> }
>>>
>>> def map(x: Vector) = {x.condMul(term.isLess(0),
>>> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
>>> }).withBroadcastSet(term, "term")
>>> /*
>>> width = width.map(new RichMapFunction[Vector, Vector]{
>>> var update: Vector = null
>>> var gradient: Vector = null
>>> override def open(config: Configuration) = {
>>> update =
>>> getRuntimeContext.getBroadcastVariable("update").toList.head
>>> gradient =
>>> getRuntimeContext.getBroadcastVariable("gradient").toList.head
>>> }
>>>
>>> def map(x: Vector) = {(x + update * (gradient
>>> sign)).clip(config.minWidth, config.maxWidth)}
>>> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
>>> "gradient")
>>> */
>>>
>>> width union update union lastGradient
>>> }
>>>
>>>
>>> Error:
>>>
>>> java.lang.IllegalStateException
>>> at
>>> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
>>> at
>>> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
>>> at
>>> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
>>> at
>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
>>> at
>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>> at
>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>> at
>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>> at
>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
>>> at
>>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
>>> at
>>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>>> at
>>> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
>>> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
>>> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
>>> at
>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
>>> at
>>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
>>> at org.apache.flink.client.program.Client.run(Client.java:288)
>>> at org.apache.flink.client.program.Client.run(Client.java:231)
>>> at
>>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
>>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
>>> at
>>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
>>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>>>
>>> Thanks!
>>> Cheers,
>>> Max
>>>
>>
>>
>
Re: Illegal State in Bulk Iteration
Posted by Maximilian Alber <al...@gmail.com>.
Sure.
Those are the params (in_file and random_file need to be set, out_file you
can choose a name.):
flink 'run', '-v',
'/media/alber_disk/alber/Arbeit/Uni/Kurse/MA/repo/python/implementations/../../scripts/../flink/bump_boost/target/bump_boost-0.1.jar',
'-c', 'bumpboost.Job', 'in_file=/tmp/tmpxj8LsC', 'out_file=/tmp/tmpuDSlIn',
'random_file=/tmp/tmpp_dFYE', 'dimensions=1', 'N=100', 'iterations=30',
'multi_bump_boost=1', 'gradient_descent_iterations=30', 'cache=False',
'start_width=1.0', 'min_width=-4', 'max_width=6', 'min_width_update=1e-08',
'max_width_update=10'
On Mon, Dec 1, 2014 at 4:47 PM, Stephan Ewen <se...@apache.org> wrote:
> Hi!
>
> I have been trying to re-implement the program you sent here (the code is
> incomplete), but I cannot trigger the exception. Can you send us the
> complete example?
>
> Stephan
>
>
> On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
> alber.maximilian@gmail.com> wrote:
>
>> Hi Flinksters!
>>
>> I try to write a BulkIteration. Somehow I get a cryptic error message, at
>> least I have no clue what's wrong:
>>
>> Code:
>>
>> var width = env.fromCollection[Vector](Seq(Vector.ones(config.dimensions)
>> * config.startWidth)) map {x => new Vector(0, x.values)}
>> var update =
>> env.fromCollection[Vector](Seq(Vector.ones(config.dimensions) * 0.01F)) map
>> {x => new Vector(1, x.values)}
>> var lastGradient =
>> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
>> new Vector(2, x.values)}
>>
>> var stepSet = width union update union lastGradient
>> stepSet = stepSet.iterate(config.gradientDescentIterations){
>> stepSet =>
>> var width = stepSet filter {_.id == 0}
>> var update = stepSet filter {_.id == 1}
>> var lastGradient = stepSet filter {_.id == 2}
>>
>> val gradient = getGradient(X, residual, center, width)
>> val term = gradient * lastGradient
>> lastGradient = gradient
>>
>> update = update.map(new RichMapFunction[Vector, Vector]{
>> var term: Vector = null
>> val minWidthUpdate = 0.00000001F
>> val maxWidthUpdate = 10.0F
>> override def open(config: Configuration) = {
>> term = getRuntimeContext.getBroadcastVariable("term").toList.head
>> }
>>
>> def map(x: Vector) = {x.condMul(term.isLess(0),
>> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
>> }).withBroadcastSet(term, "term")
>> /*
>> width = width.map(new RichMapFunction[Vector, Vector]{
>> var update: Vector = null
>> var gradient: Vector = null
>> override def open(config: Configuration) = {
>> update =
>> getRuntimeContext.getBroadcastVariable("update").toList.head
>> gradient =
>> getRuntimeContext.getBroadcastVariable("gradient").toList.head
>> }
>>
>> def map(x: Vector) = {(x + update * (gradient
>> sign)).clip(config.minWidth, config.maxWidth)}
>> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
>> "gradient")
>> */
>>
>> width union update union lastGradient
>> }
>>
>>
>> Error:
>>
>> java.lang.IllegalStateException
>> at
>> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
>> at
>> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
>> at
>> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
>> at
>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
>> at
>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>> at
>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>> at
>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>> at
>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
>> at
>> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
>> at
>> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
>> at
>> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
>> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
>> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
>> at
>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
>> at
>> org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
>> at org.apache.flink.client.program.Client.run(Client.java:288)
>> at org.apache.flink.client.program.Client.run(Client.java:231)
>> at
>> org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
>> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
>> at
>> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
>> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>>
>> Thanks!
>> Cheers,
>> Max
>>
>
>
Re: Illegal State in Bulk Iteration
Posted by Stephan Ewen <se...@apache.org>.
Hi!
I have been trying to re-implement the program you sent here (the code is
incomplete), but I cannot trigger the exception. Can you send us the
complete example?
Stephan
On Fri, Nov 28, 2014 at 3:18 PM, Maximilian Alber <
alber.maximilian@gmail.com> wrote:
> Hi Flinksters!
>
> I try to write a BulkIteration. Somehow I get a cryptic error message, at
> least I have no clue what's wrong:
>
> Code:
>
> var width = env.fromCollection[Vector](Seq(Vector.ones(config.dimensions)
> * config.startWidth)) map {x => new Vector(0, x.values)}
> var update = env.fromCollection[Vector](Seq(Vector.ones(config.dimensions)
> * 0.01F)) map {x => new Vector(1, x.values)}
> var lastGradient =
> env.fromCollection[Vector](Seq(Vector.zeros(config.dimensions))) map {x =>
> new Vector(2, x.values)}
>
> var stepSet = width union update union lastGradient
> stepSet = stepSet.iterate(config.gradientDescentIterations){
> stepSet =>
> var width = stepSet filter {_.id == 0}
> var update = stepSet filter {_.id == 1}
> var lastGradient = stepSet filter {_.id == 2}
>
> val gradient = getGradient(X, residual, center, width)
> val term = gradient * lastGradient
> lastGradient = gradient
>
> update = update.map(new RichMapFunction[Vector, Vector]{
> var term: Vector = null
> val minWidthUpdate = 0.00000001F
> val maxWidthUpdate = 10.0F
> override def open(config: Configuration) = {
> term = getRuntimeContext.getBroadcastVariable("term").toList.head
> }
>
> def map(x: Vector) = {x.condMul(term.isLess(0),
> 0.5F).condMul(term.isGreater(0), 1.2F).clip(minWidthUpdate, maxWidthUpdate)}
> }).withBroadcastSet(term, "term")
> /*
> width = width.map(new RichMapFunction[Vector, Vector]{
> var update: Vector = null
> var gradient: Vector = null
> override def open(config: Configuration) = {
> update =
> getRuntimeContext.getBroadcastVariable("update").toList.head
> gradient =
> getRuntimeContext.getBroadcastVariable("gradient").toList.head
> }
>
> def map(x: Vector) = {(x + update * (gradient
> sign)).clip(config.minWidth, config.maxWidth)}
> }).withBroadcastSet(update, "update")withBroadcastSet(gradient,
> "gradient")
> */
>
> width union update union lastGradient
> }
>
>
> Error:
>
> java.lang.IllegalStateException
> at
> org.apache.flink.compiler.dag.BulkPartialSolutionNode.setCandidateProperties(BulkPartialSolutionNode.java:50)
> at
> org.apache.flink.compiler.dag.BulkIterationNode.instantiateCandidate(BulkIterationNode.java:292)
> at
> org.apache.flink.compiler.dag.SingleInputNode.addLocalCandidates(SingleInputNode.java:367)
> at
> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:315)
> at
> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
> at
> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
> at
> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
> at
> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:105)
> at
> org.apache.flink.compiler.dag.BinaryUnionNode.getAlternativePlans(BinaryUnionNode.java:104)
> at
> org.apache.flink.compiler.dag.SingleInputNode.getAlternativePlans(SingleInputNode.java:258)
> at
> org.apache.flink.compiler.dag.DataSinkNode.getAlternativePlans(DataSinkNode.java:194)
> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:561)
> at org.apache.flink.compiler.PactCompiler.compile(PactCompiler.java:466)
> at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:197)
> at org.apache.flink.client.program.Client.getOptimizedPlan(Client.java:210)
> at org.apache.flink.client.program.Client.run(Client.java:288)
> at org.apache.flink.client.program.Client.run(Client.java:231)
> at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:347)
> at org.apache.flink.client.CliFrontend.run(CliFrontend.java:334)
> at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1001)
> at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1025)
>
> Thanks!
> Cheers,
> Max
>