You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2017/02/28 22:55:45 UTC
[jira] [Commented] (SPARK-16103) Share a single Row for CSV data
source rather than creating every time
[ https://issues.apache.org/jira/browse/SPARK-16103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889038#comment-15889038 ]
Wenchen Fan commented on SPARK-16103:
-------------------------------------
Hi [~hyukjin.kwon] are you working on it?
> Share a single Row for CSV data source rather than creating every time
> ----------------------------------------------------------------------
>
> Key: SPARK-16103
> URL: https://issues.apache.org/jira/browse/SPARK-16103
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Hyukjin Kwon
>
> Currently, CSV data source is creating each Row.
> Single row can be shared just like the other data sources.
> It is a bit not related but it might be great if some improvements were made in term of performances. This was suggested in https://github.com/apache/spark/pull/12268.
> - https://github.com/apache/spark/pull/12268#discussion_r61265122
> - https://github.com/apache/spark/pull/12268#discussion_r61270381
> - https://github.com/apache/spark/pull/12268#discussion_r61271158
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org