You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/06/10 18:48:33 UTC
[GitHub] [incubator-pinot] MrNeocore opened a new issue #7043: Support query result post-aggregation / nested query
MrNeocore opened a new issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043
Following Slack discussion : https://apache-pinot.slack.com/archives/C011C9JHN7R/p1623346401028100
**Data**
date | 01 | 02 | 03
entity1 | 1 | 2 | 3
entity2 | 3 | 4 | 5
**Goal**
Aggregate data in "2 dimensions", first per entity (say, AVG), then per date (say, SUM)
This use case appears to be solvable using generic nested queries or an improvement to the existing post-aggregation feature.
**Nested query example** (not currently possible)
`SELECT SUM(agg_value) FROM (SELECT dateString, AVG(value) as agg_value FROM table GROUP BY dateString)`
@Jackie-Jiang @mayankshriv: Feel free to edit the title & content
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] siddharthteotia commented on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
siddharthteotia commented on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we will be exploring a combined design for subqueries and distributed joins since design / architecture wise there might be overlap and it is good to think of both design wise. cc @amrishlal @jackjlli
Once we have had some preliminary thought / initial design, we will share with community to iterate upon and collaborate further.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] siddharthteotia commented on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
siddharthteotia commented on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878664620
https://github.com/apache/incubator-pinot/issues/5664
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] atris commented on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
atris commented on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-877506030
@Jackie-Jiang If it makes sense, I would like to start working on this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] siddharthteotia edited a comment on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
siddharthteotia edited a comment on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we will be exploring a combined design for subqueries and distributed joins since design / architecture wise there might be overlap and it is good to think of both design wise. cc @amrishlal @jackjlli
Once we have had some preliminary thought / initial design, we will share with community in the next couple of months to iterate upon and collaborate further.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] atris commented on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
atris commented on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878786588
@siddharthteotia Thats great to hear. I am already working on this feature, since its crucial for our evaluation of Pinot. I would request your inputs and feedback on the proposed design and lets ensure alignment with your overall plans for Joins (I plan to publish today).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] siddharthteotia edited a comment on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
siddharthteotia edited a comment on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we are exploring a combined design for subqueries and distributed joins since design / architecture wise there might be overlap and it is good to think of both design wise. cc @amrishlal @jackjlli
Once we have had some preliminary thought / initial design, we will share with community in the next couple of months to iterate upon and collaborate further.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] siddharthteotia edited a comment on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
siddharthteotia edited a comment on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-878661085
At LinkedIn, we are exploring a combined design for subqueries and distributed joins since design / architecture wise there might be overlap and it is good to think of both design wise. cc @amrishlal @jackjlli
Once we have had some preliminary thought / initial design, we will share with community to iterate upon and collaborate further.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #7043: Support query result post-aggregation / nested query
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #7043:
URL: https://github.com/apache/incubator-pinot/issues/7043#issuecomment-873199102
In order to do general post-aggregation and nest query, we should build another set of operators on broker side that work on `ResultTable` (row major table). Currently all the operators on the server side works on the `DataSource` which is column major.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org