You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2014/10/09 23:58:33 UTC

[jira] [Resolved] (SPARK-3339) Support for skipping json lines that fail to parse

     [ https://issues.apache.org/jira/browse/SPARK-3339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust resolved SPARK-3339.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.2.0

Issue resolved by pull request 2680
[https://github.com/apache/spark/pull/2680]

> Support for skipping json lines that fail to parse
> --------------------------------------------------
>
>                 Key: SPARK-3339
>                 URL: https://issues.apache.org/jira/browse/SPARK-3339
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Michael Armbrust
>            Assignee: Yin Huai
>            Priority: Critical
>             Fix For: 1.2.0
>
>
> When dealing with large datasets there is alway some data that fails to parse.  Would be nice to handle this instead of throwing an exception requiring the user to filter it out manually.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org