You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ignite.apache.org by "Vladimir Ozerov (JIRA)" <ji...@apache.org> on 2016/07/04 06:48:11 UTC

[jira] [Created] (IGNITE-3414) Hadoop: Optimize map-reduce job planning.

Vladimir Ozerov created IGNITE-3414:
---------------------------------------

             Summary: Hadoop: Optimize map-reduce job planning.
                 Key: IGNITE-3414
                 URL: https://issues.apache.org/jira/browse/IGNITE-3414
             Project: Ignite
          Issue Type: Task
          Components: hadoop
    Affects Versions: 1.6
            Reporter: Vladimir Ozerov
            Assignee: Vladimir Ozerov
            Priority: Critical
             Fix For: 1.7


Currently Hadoop module has inefficient map-reduce planning engine. In particular, it assigns tasks only to affinity nodes. It could lead to situation when very huge tasks is processed by a single cluster node, while other cluster nodes are idle. 

We should implement configurable map-reduce planner which will be able to utilize the whole cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)