You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2014/11/13 16:01:33 UTC

[jira] [Created] (HIVE-8858) Visualize generated Spark plan [Spark Branch]

Xuefu Zhang created HIVE-8858:
---------------------------------

             Summary: Visualize generated Spark plan [Spark Branch]
                 Key: HIVE-8858
                 URL: https://issues.apache.org/jira/browse/HIVE-8858
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Xuefu Zhang


The spark plan generated by SparkPlanGenerator contains info which isn't available in Hive's explain plan, such as RDD caching. Also, the graph is slight different from orignal SparkWork. Thus, it would be nice to visualize the plan as is done for SparkWork.

Preferrably, the visualization can happen as part of Hive explain extended. If not feasible, we at least can log this at info level.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)