You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2016/06/06 14:18:21 UTC

[jira] [Created] (KYLIN-1766) CubeTupleConverter.translateResult() is slow due to date conversion

liyang created KYLIN-1766:
-----------------------------

             Summary: CubeTupleConverter.translateResult() is slow due to date conversion
                 Key: KYLIN-1766
                 URL: https://issues.apache.org/jira/browse/KYLIN-1766
             Project: Kylin
          Issue Type: Improvement
            Reporter: liyang


As attached, profiling shows that current filling tuple is slow especially about dates. The norm form "yyyy-mm-dd" is parsed into a Date, then converted into # since epic day. This is slow because of Java's slow SimpleDateFormat.

An idea is to refine the norm form of date/time to be the time millis. This will save a lot of str <--> date conversions. However the change impacts dictionary, lookup snapshot, and maybe data ingestion. Also need to think about backward compatibility.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)