[jira] [Reopened] (KYLIN-210) Split heavy MR job to more small jobs

["Luke Han (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KYLIN-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Luke Han reopened KYLIN-210:
----------------------------

> Split heavy MR job to more small jobs
> -------------------------------------
>
>                 Key: KYLIN-210
>                 URL: https://issues.apache.org/jira/browse/KYLIN-210
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine
>            Reporter: Luke Han
>            Assignee: liyang
>              Labels: github-import
>             Fix For: v0.7.2
>
>
> In Kylin's cube build process, the Map Reduce job will become more heavy in first half phase, then will reduce more and more in second phase, split huge job into more small one will bring more efficiency to avoid too big data be processed in one MR Job, such as 10+TB level data
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/KylinOLAP/Kylin/issues/295
> Created by: [lukehan|https://github.com/lukehan]
> Labels: enhancement, 
> Milestone: Backlog
> Created at: Fri Dec 26 14:35:33 CST 2014
> State: open



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)