You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2016/12/17 03:14:58 UTC

[jira] [Created] (SPARK-18909) The error message in `ExpressionEncoder.toRow` and `fromRow` is too verbose

Wenchen Fan created SPARK-18909:
-----------------------------------

             Summary: The error message in `ExpressionEncoder.toRow` and `fromRow` is too verbose
                 Key: SPARK-18909
                 URL: https://issues.apache.org/jira/browse/SPARK-18909
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Wenchen Fan
            Priority: Minor


In `ExpressionEncoder.toRow` and `fromRow`, we will catch the exception and put the treeString of serializer/deserializer expressions in the error message. However, encoder can be very complex and the serializer/deserializer expressions can be very large trees and blow up the log files(e.g. generate over 500mb logs for this single error message.)

We should simplify it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org