You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2018/01/30 12:28:07 UTC

[SQL] Tests for ExtractFiltersAndInnerJoins.flattenJoin

Hi,

While exploring ReorderJoin optimization I wrote few unit test-like
examples that demo how ExtractFiltersAndInnerJoins.flattenJoin [1] works.

I've been wondering if the examples could become unit tests instead. There
are 6 different join-filter plan combinations using Catalyst DSL to create
the plans.

I'm wondering if I should file a task in JIRA for this or just send a pull
request? I'd appreciate some guidance.

[1]
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala#L167

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
Follow me at https://twitter.com/jaceklaskowski