You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Raajay <ra...@gmail.com> on 2015/06/25 18:33:35 UTC

Visualize Spark-SQL query plans

Hello,

I am trying to understand the code base of spark-SQL, especially the Query
Analyzer part. I understand that currently (as of Spark 1.4), the sql
module generates a set of Physical plans, but executes only the first in
the list (ref : core/src/main/scala/org/apache/spark/sql/SQLContext.scala,
lines ~930).


I wish to visualize all the query plans generated and possibly execute them
all as different jobs. How should I proceed in order to accomplish this?

Thanks
Raajay