[jira] [Created] (SPARK-2035) Make a stage's call stack available on the UI

["Daniel Darabos (JIRA)" <ji...@apache.org>]

Daniel Darabos created SPARK-2035:
-------------------------------------

             Summary: Make a stage's call stack available on the UI
                 Key: SPARK-2035
                 URL: https://issues.apache.org/jira/browse/SPARK-2035
             Project: Spark
          Issue Type: Improvement
          Components: Web UI
            Reporter: Daniel Darabos
            Priority: Minor


Currently the stage table displays the file name and line number that is the call site that triggered the given stage. This is enormously useful for understanding the execution. But once a project adds utility classes and other indirections, the call site can become less meaningful, because the interesting line is further up the stack.

An idea to fix this is to display the entire call stack that triggered the stage. It would be collapsed by default and could be revealed with a click.

I have started working on this. It is a good way to learn about how the RDD interface ties into the UI.



--
This message was sent by Atlassian JIRA
(v6.2#6252)