You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/10/14 21:54:00 UTC

[jira] [Updated] (BEAM-12393) Beam SQL support for HLL count

     [ https://issues.apache.org/jira/browse/BEAM-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kyle Weaver updated BEAM-12393:
-------------------------------
    Status: Open  (was: Triage Needed)

> Beam SQL support for HLL count
> ------------------------------
>
>                 Key: BEAM-12393
>                 URL: https://issues.apache.org/jira/browse/BEAM-12393
>             Project: Beam
>          Issue Type: New Feature
>          Components: dsl-sql, extensions-java-sketching
>            Reporter: Brachi Packter
>            Priority: P3
>
> There is support for HLL sketch in Ptransform:
>  
> {code:java}
> p.apply("Int", Create.of(ints)).apply("IntHLL", ApproximateCountDistinct.globally()
> .withPercision(PRECISION));{code}
>  
> or 
>  
> {code:java}
> PCollection<KV<Integer, Long>> result =
> p.apply("Long", Create.of(longs)).apply("LongHLL", ApproximateCountDistinct.perKey());
>  
> {code}
> But, no support for beam sql. 
> We can't initiate it to be used  in SqlTransform (even the combiner: HllCountMergePartialFn exists)
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)