You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2016/02/02 10:43:39 UTC

[jira] [Resolved] (KYLIN-1387) Streaming cubing doesn't generate cuboids files on HDFS, cause cube merge failure

     [ https://issues.apache.org/jira/browse/KYLIN-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shaofeng SHI resolved KYLIN-1387.
---------------------------------
    Resolution: Fixed

> Streaming cubing doesn't generate cuboids files on HDFS, cause cube merge failure
> ---------------------------------------------------------------------------------
>
>                 Key: KYLIN-1387
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1387
>             Project: Kylin
>          Issue Type: Bug
>          Components: streaming
>    Affects Versions: v2.0
>            Reporter: Shaofeng SHI
>            Assignee: Shaofeng SHI
>             Fix For: v2.1
>
>
> In an early version of Kylin streaming, the HBaseMROutput2.java will use HBase Scan API to do the merge. Later Yang refactored that into HBaseMROutput2Transition.java, while keep using the cuboids files on HDFS to do the merge. But the StreamingBatchBuilder didn't generate the cuboids, which causes the merge failed to run.
> Solution: as a workaround, the StreamingBatchBuilder should leave cuboids files when building micro segments.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)