You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2016/02/01 05:51:39 UTC

[jira] [Created] (KYLIN-1387) Streaming cubing doesn't generate cuboids files on HDFS, cause cube merge failure

Shaofeng SHI created KYLIN-1387:
-----------------------------------

             Summary: Streaming cubing doesn't generate cuboids files on HDFS, cause cube merge failure
                 Key: KYLIN-1387
                 URL: https://issues.apache.org/jira/browse/KYLIN-1387
             Project: Kylin
          Issue Type: Bug
          Components: streaming
    Affects Versions: v2.0
            Reporter: Shaofeng SHI
            Assignee: Shaofeng SHI
             Fix For: v2.1


In an early version of Kylin streaming, the HBaseMROutput2.java will use HBase Scan API to do the merge. Later Yang refactored that into HBaseMROutput2Transition.java, while keep using the cuboids files on HDFS to do the merge. But the StreamingBatchBuilder didn't generate the cuboids, which causes the merge failed to run.

Solution: as a workaround, the StreamingBatchBuilder should leave cuboids files when building micro segments.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)