You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2015/07/21 10:14:04 UTC

[jira] [Resolved] (SPARK-8875) Shuffle code cleanup: remove BlockStoreShuffleFetcher class

     [ https://issues.apache.org/jira/browse/SPARK-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Rosen resolved SPARK-8875.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.0

Issue resolved by pull request 7268
[https://github.com/apache/spark/pull/7268]

> Shuffle code cleanup: remove BlockStoreShuffleFetcher class
> -----------------------------------------------------------
>
>                 Key: SPARK-8875
>                 URL: https://issues.apache.org/jira/browse/SPARK-8875
>             Project: Spark
>          Issue Type: Improvement
>          Components: Shuffle
>            Reporter: Kay Ousterhout
>            Assignee: Kay Ousterhout
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> The shuffle code has gotten increasingly difficult to read as it has evolved, and many classes have evolved significantly since they were originally created. The BlockStoreShuffleFetcher class now serves little purpose other than to make the code more difficult to read; we should move its functionality into the ShuffleBlockFetcherIterator class. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org