You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "snleee (via GitHub)" <gi...@apache.org> on 2023/01/27 21:23:43 UTC
[GitHub] [pinot] snleee opened a new issue, #10197: Add transformation function to convert numeric to HLL/Sketch
snleee opened a new issue, #10197:
URL: https://github.com/apache/pinot/issues/10197
It would be handy if we have sth like the following:
```
select toHLL(user_id) as hll_user_id, toThetaSketch(user_id) as theta_user_id from T
hll_user_id | theta_user_id
<hll-object-of-user-id-valus> | <theta-sketch-object-user-id>
```
`toHLL, toThetaSketch` will need some inputs for sketch configurations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] davecromberge commented on issue #10197: Add transformation function to convert numeric to HLL/Sketch object
Posted by "davecromberge (via GitHub)" <gi...@apache.org>.
davecromberge commented on issue #10197:
URL: https://github.com/apache/pinot/issues/10197#issuecomment-1411060822
@mayankshriv have you got any links to PRs that have introduced similar features?
What we would like to do is create a sketch metric from string dimensions on ingestion and reduce the number of rows stored by orders of magnitude.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] davecromberge commented on issue #10197: Add transformation function to convert numeric to HLL/Sketch object
Posted by "davecromberge (via GitHub)" <gi...@apache.org>.
davecromberge commented on issue #10197:
URL: https://github.com/apache/pinot/issues/10197#issuecomment-1407117236
+1
Would this apply to both offline and real-time ingestion? With regard to theta sketches, they take an additional parameter that controls the number of retained entries, which ultimately affects both size and accuracy. This might be worth taking into consideration as an argument to the transform function.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] mayankshriv commented on issue #10197: Add transformation function to convert numeric to HLL/Sketch object
Posted by "mayankshriv (via GitHub)" <gi...@apache.org>.
mayankshriv commented on issue #10197:
URL: https://github.com/apache/pinot/issues/10197#issuecomment-1407110342
+1
I am hoping this would help us generate HLL / sketches during ingestion (from raw data) and roll up at the same it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org