You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2020/09/15 09:38:00 UTC

[jira] [Commented] (SPARK-28210) Shuffle Storage API: Reads

    [ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196013#comment-17196013 ] 

Attila Zsolt Piros commented on SPARK-28210:
--------------------------------------------

 [~tianczha] [~devaraj] I would like to work on this issue if that's fine for you. I would like to progress along the ideas of the linked PR: to pass the metadata when the reducer task is constructed. 

> Shuffle Storage API: Reads
> --------------------------
>
>                 Key: SPARK-28210
>                 URL: https://issues.apache.org/jira/browse/SPARK-28210
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Shuffle, Spark Core
>    Affects Versions: 3.1.0
>            Reporter: Matt Cheah
>            Priority: Major
>
> As part of the effort to store shuffle data in arbitrary places, this issue tracks implementing an API for reading the shuffle data stored by the write API. Also ensure that the existing shuffle implementation is refactored to use the API.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org