You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "pengfei.zhan (Jira)" <ji...@apache.org> on 2024/04/09 12:09:00 UTC

[jira] [Updated] (KYLIN-5787) Use t-digest as spark percentile_approx function

     [ https://issues.apache.org/jira/browse/KYLIN-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

pengfei.zhan updated KYLIN-5787:
--------------------------------
    Description: 
The underlying implementation of the percentile_approx function in KYLIN is the open-source t-digest.


The underlying implementation of the percentile_approx function in spark is spark's own PercentileDigest (based on QuantileSummaries).
Different implementations lead to different results.

> Use t-digest as spark percentile_approx function
> ------------------------------------------------
>
>                 Key: KYLIN-5787
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5787
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine, Query Engine
>    Affects Versions: 5.0-beta
>            Reporter: pengfei.zhan
>            Assignee: pengfei.zhan
>            Priority: Critical
>             Fix For: 5.0-beta
>
>
> The underlying implementation of the percentile_approx function in KYLIN is the open-source t-digest.
> The underlying implementation of the percentile_approx function in spark is spark's own PercentileDigest (based on QuantileSummaries).
> Different implementations lead to different results.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)