You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2014/12/04 09:41:12 UTC

[jira] [Commented] (SPARK-4741) Do not destroy and re-create FileInputStream

    [ https://issues.apache.org/jira/browse/SPARK-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14234016#comment-14234016 ] 

Apache Spark commented on SPARK-4741:
-------------------------------------

User 'viirya' has created a pull request for this issue:
https://github.com/apache/spark/pull/3600

> Do not destroy and re-create FileInputStream
> --------------------------------------------
>
>                 Key: SPARK-4741
>                 URL: https://issues.apache.org/jira/browse/SPARK-4741
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Liang-Chi Hsieh
>            Priority: Minor
>
> The FileInputStream in DiskMapIterator is destroyed and recreate after each batch reading. However, since we can change the reading position on that stream, it is no need and inefficient to destroy and recreate it every time. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org