You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2019/12/17 19:36:00 UTC

[jira] [Created] (BEAM-8983) Spark uber jar job server: query exceptions from master

Kyle Weaver created BEAM-8983:
---------------------------------

             Summary: Spark uber jar job server: query exceptions from master
                 Key: BEAM-8983
                 URL: https://issues.apache.org/jira/browse/BEAM-8983
             Project: Beam
          Issue Type: Improvement
          Components: runner-spark
            Reporter: Kyle Weaver
            Assignee: Kyle Weaver


As far as I know, the Spark REST API does not return exceptions from the cluster after a jar is actually run. While these exceptions can be viewed in Spark's web UI, ideally they would also be visible in Beam's output.

To do this, we will need to find a REST endpoint that does return those exceptions, and then map the submissionId to its corresponding job id.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)