You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2016/08/17 00:27:20 UTC
[jira] [Updated] (SPARK-17096) Fix StreamingQueryListener to return
message and stacktrace of actual exception
[ https://issues.apache.org/jira/browse/SPARK-17096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tathagata Das updated SPARK-17096:
----------------------------------
Description:
Currently only the stacktrace of StreamingQueryException is returned through StreamingQueryListener, which is useless as it hides the actual exception's stacktrace.
For example, if there is a / by zero exception in a task, the QueryTerminated.stackTrace will have
{code}
org.apache.spark.sql.execution.streaming.StreamExecution.org$apache$spark$sql$execution$streaming$StreamExecution$$runBatches(StreamExecution.scala:211)
org.apache.spark.sql.execution.streaming.StreamExecution$$anon$1.run(StreamExecution.scala:124)
{code}
was:
Currently only the stacktrace of StreamingQueryException is returned through StreamingQueryListener, which is useless as it hides the actual exception's stacktrace.
For example, if there is a / by zero exception in a task, the QueryTerminated.stackTrace will have
{code}
org.apache.spark.sql.execution.streaming.StreamExecution.org$apache$spark$sql$execution$streaming$StreamExecution$$runBatches(StreamExecution.scala:211)
org.apache.spark.sql.execution.streaming.StreamExecution$$anon$1.run(StreamExecution.scala:124)
{code}
> Fix StreamingQueryListener to return message and stacktrace of actual exception
> -------------------------------------------------------------------------------
>
> Key: SPARK-17096
> URL: https://issues.apache.org/jira/browse/SPARK-17096
> Project: Spark
> Issue Type: Sub-task
> Components: SQL, Streaming
> Reporter: Tathagata Das
> Assignee: Tathagata Das
> Priority: Minor
>
> Currently only the stacktrace of StreamingQueryException is returned through StreamingQueryListener, which is useless as it hides the actual exception's stacktrace.
> For example, if there is a / by zero exception in a task, the QueryTerminated.stackTrace will have
> {code}
> org.apache.spark.sql.execution.streaming.StreamExecution.org$apache$spark$sql$execution$streaming$StreamExecution$$runBatches(StreamExecution.scala:211)
> org.apache.spark.sql.execution.streaming.StreamExecution$$anon$1.run(StreamExecution.scala:124)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org