You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@druid.apache.org by Gian Merlino <gi...@imply.io> on 2018/04/03 18:48:36 UTC
Re: [druid-dev] Skipping Empty Buckets feature
Hi Suhas,
How would you expect the results to come back if groupBy did _not_ skip
empty time buckets, and one day was empty? Should all the dimensions be
null?
Btw, since we are migrating the dev mailing list to Apache, please cross
post this sort of thing with dev@druid.apache.org, or even only post to
that list.
Gian
On Tue, Apr 3, 2018 at 4:36 AM, Suhas <su...@gmail.com> wrote:
> This is straight from the docs,
>>
>>
>> <GroupBy Example>
>> Note that all the empty buckets are discarded.
>
>
> This could actually be a good thing. I think there should an option in
> *context *whether or not to skip empty buckets even in the group by
> queries. Personally, I found myself in situations where many queries I
> wanted to group by some dimensions and have a day's granularity, should've
> included all buckets in the result. I don't see why this is a bad idea?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Druid Development" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to druid-development+unsubscribe@googlegroups.com.
> To post to this group, send email to druid-development@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/druid-development/12b81b6f-38f4-4725-9482-
> 3acd1993ce85%40googlegroups.com
> <https://groups.google.com/d/msgid/druid-development/12b81b6f-38f4-4725-9482-3acd1993ce85%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>
Re: [druid-dev] Skipping Empty Buckets feature
Posted by Suhas Sumukh V <su...@gmail.com>.
Good thing you asked, Gian. I don't expect it to traverse all buckets and
find all groups, and set those group values to zero or null in every
bucket. I know such a thing would destroy Druid's performance. I just want
it to return null for the dimension and 0 for metrics, for that day.
{u'event': {u'metric1': 0,
u'metric2': 0,
u'dim': null},
u'timestamp': u'2018-04-05T00:00:00.000Z',
u'version': u'v1'}
--
Suhas
On Wed, Apr 4, 2018 at 12:18 AM, Gian Merlino <gi...@imply.io> wrote:
> Hi Suhas,
>
> How would you expect the results to come back if groupBy did _not_ skip
> empty time buckets, and one day was empty? Should all the dimensions be
> null?
>
> Btw, since we are migrating the dev mailing list to Apache, please cross
> post this sort of thing with dev@druid.apache.org, or even only post to
> that list.
>
> Gian
>
> On Tue, Apr 3, 2018 at 4:36 AM, Suhas <su...@gmail.com> wrote:
>
>> This is straight from the docs,
>>>
>>>
>>> <GroupBy Example>
>>> Note that all the empty buckets are discarded.
>>
>>
>> This could actually be a good thing. I think there should an option in
>> *context *whether or not to skip empty buckets even in the group by
>> queries. Personally, I found myself in situations where many queries I
>> wanted to group by some dimensions and have a day's granularity, should've
>> included all buckets in the result. I don't see why this is a bad idea?
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Druid Development" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to druid-development+unsubscribe@googlegroups.com.
>> To post to this group, send email to druid-development@googlegroups.com.
>> To view this discussion on the web visit https://groups.google.com/d/ms
>> gid/druid-development/12b81b6f-38f4-4725-9482-3acd1993ce85%
>> 40googlegroups.com
>> <https://groups.google.com/d/msgid/druid-development/12b81b6f-38f4-4725-9482-3acd1993ce85%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "Druid Development" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/druid-development/VNMg8HKYVio/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> druid-development+unsubscribe@googlegroups.com.
> To post to this group, send email to druid-development@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/druid-development/CACZNdYC5dWwNtyNvRh-NCe_
> yrxWQEQbb%3DiKvkEoi8F8iffJ7uw%40mail.gmail.com
> <https://groups.google.com/d/msgid/druid-development/CACZNdYC5dWwNtyNvRh-NCe_yrxWQEQbb%3DiKvkEoi8F8iffJ7uw%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>