You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 05:37:42 UTC

[jira] [Resolved] (SPARK-3115) Improve task broadcast latency for small tasks

     [ https://issues.apache.org/jira/browse/SPARK-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-3115.
---------------------------------
    Resolution: Incomplete

> Improve task broadcast latency for small tasks
> ----------------------------------------------
>
>                 Key: SPARK-3115
>                 URL: https://issues.apache.org/jira/browse/SPARK-3115
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 1.1.0
>            Reporter: Shivaram Venkataraman
>            Assignee: Reynold Xin
>            Priority: Major
>              Labels: bulk-closed
>
> Broadcasting the task information helps reduce the amount of data transferred for large tasks. However we've seen that this adds more latency for small tasks. It'll be great to profile and fix this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org