You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by "hujiahua (Jira)" <ji...@apache.org> on 2021/11/12 08:26:00 UTC

[jira] [Created] (KYLIN-5121) Make JobMetricsUtils.collectMetrics work again

hujiahua created KYLIN-5121:
-------------------------------

             Summary: Make JobMetricsUtils.collectMetrics work again
                 Key: KYLIN-5121
                 URL: https://issues.apache.org/jira/browse/KYLIN-5121
             Project: Kylin
          Issue Type: Improvement
            Reporter: hujiahua


At present, the rowCount needs to be eval after the cube built every time, and spark `QueryExecution` metric have `numOutputRows` metric for this purpose. But, after patch KYLIN-4662 (Migrate from third-party Spark to offical Apache Spark), the util function `JobMetricsUtils.collectMetrics` becomes out of working. Each rowCount needs to call `Dataset.count()`, which wastes resources and affects the cube build time.




--
This message was sent by Atlassian Jira
(v8.20.1#820001)