You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/02/10 05:34:18 UTC

[jira] [Assigned] (SPARK-13261) Expose maxCharactersPerColumn as a user configurable option

     [ https://issues.apache.org/jira/browse/SPARK-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-13261:
------------------------------------

    Assignee:     (was: Apache Spark)

> Expose maxCharactersPerColumn as a user configurable option
> -----------------------------------------------------------
>
>                 Key: SPARK-13261
>                 URL: https://issues.apache.org/jira/browse/SPARK-13261
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>            Reporter: Hossein Falaki
>
> We are using Univocity parser in the CSV data source in Spark. The parser has a fairly small limit for maximum number of characters per column. Spark's CSV data source updates it but it is not exposed to user. There are still use cases where the limit is too small. I think we should just expose it as an option. I suggest "maxCharsPerColumn" for the option.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org