You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 高扬02 <ga...@bianfeng.com> on 2019/07/30 09:59:13 UTC

答复: kylin中求交集

Hi ShaoFeng,
I have a similar question.


1.       only one variable dimension, common sql like this:


[cid:image001.png@01D546FD.B73BAFB0]

and I can query :
[cid:image005.jpg@01D54700.7E38A030]

the result is right.


2.       if two or more variable dimension, common sql like this:
[cid:image003.png@01D546FE.728A4740]

One more dimensional condition , and how do I write kylin sql?
Please give me some advice , thank you very much.

Best regards!

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org]
发送时间: 2019年7月30日 9:04
收件人: user <us...@kylin.apache.org>
主题: Re: kylin中求交集

Hi Ning,

I'm interested in this scenario. Do you have any progress on this? Thanks.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ShaoFeng Shi <sh...@apache.org>> 于2019年5月28日周二 下午6:26写道:
Hello Wang Ning,

This is interesting. Could you please give an example or scenario to do intersect on multiple dimensions at the same time? The function is extensible, welcome to give more input to us.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ning.wang@ymm56.com<ma...@ymm56.com> <ni...@ymm56.com>> 于2019年5月28日周二 下午11:04写道:
kylin中有intersect_count函数可以计算交集,但是只能有一个维度是变化的,但是我现在算交集是有多个维度不同,该如何解决。

________________________________
ning.wang@ymm56.com<ma...@ymm56.com>

答复: kylin中求交集

Posted by 高扬02 <ga...@bianfeng.com>.
Hello,
I have read the article shared by manbang group, which extended the “intersect_count” for funnel analysis.
Does anyone know the implementation details? Is it through secondary source development or special handling of kylin usage?
Please give me some advice . Thank you very much.

Best regards,
YangGao

PS:
Funnel analysis of ManBang Group
[cid:image004.png@01D54852.54777250]

发件人: 高扬02 [mailto:gaoyang02@bianfeng.com]
发送时间: 2019年7月31日 14:09
收件人: user@kylin.apache.org
主题: 答复: kylin中求交集

OK, I'll read it for reference . Thank you very much.

Best regards,
YangGao

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org]
发送时间: 2019年7月31日 12:26
收件人: user <us...@kylin.apache.org>>
主题: Re: kylin中求交集

"intersect_count" can be used in the funnel analysis. Just like comparing the bitmap of two days, you can do that across another dimension.

Recently there is a use case from ManBang group, you can get more from https://kyligence.io/zh/resources/kylin_at_manbang_group/

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




高扬02 <ga...@bianfeng.com>> 于2019年7月30日周二 下午7:33写道:
Hi ShaoFeng,

In this case, I want to query not just retention in the general sense, but the intersection of two sets, such as the calculation of the funnel model , and so on.
Is “intersect_count” inappropriate for this requirement?
Please render your help . Thank you very much.

Best regards.

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org<ma...@apache.org>]
发送时间: 2019年7月31日 7:11
收件人: user <us...@kylin.apache.org>>
主题: Re: kylin中求交集

Hi yang,

What do you want to analysis? From the sql, it looks like adding a condition on "login_type", not seeing how to vary that.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




高扬02 <ga...@bianfeng.com>> 于2019年7月30日周二 上午2:59写道:
Hi ShaoFeng,
I have a similar question.


1.       only one variable dimension, common sql like this:


[cid:image001.png@01D547A8.78C1C3E0]

and I can query :
[cid:image002.jpg@01D547A8.78C1C3E0]

the result is right.


2.       if two or more variable dimension, common sql like this:
[cid:image003.png@01D547A8.78C1C3E0]

One more dimensional condition , and how do I write kylin sql?
Please give me some advice , thank you very much.

Best regards!

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org<ma...@apache.org>]
发送时间: 2019年7月30日 9:04
收件人: user <us...@kylin.apache.org>>
主题: Re: kylin中求交集

Hi Ning,

I'm interested in this scenario. Do you have any progress on this? Thanks.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ShaoFeng Shi <sh...@apache.org>> 于2019年5月28日周二 下午6:26写道:
Hello Wang Ning,

This is interesting. Could you please give an example or scenario to do intersect on multiple dimensions at the same time? The function is extensible, welcome to give more input to us.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ning.wang@ymm56.com<ma...@ymm56.com> <ni...@ymm56.com>> 于2019年5月28日周二 下午11:04写道:
kylin中有intersect_count函数可以计算交集,但是只能有一个维度是变化的,但是我现在算交集是有多个维度不同,该如何解决。

________________________________
ning.wang@ymm56.com<ma...@ymm56.com>

答复: kylin中求交集

Posted by 高扬02 <ga...@bianfeng.com>.
OK, I'll read it for reference . Thank you very much.

Best regards,
YangGao

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org]
发送时间: 2019年7月31日 12:26
收件人: user <us...@kylin.apache.org>
主题: Re: kylin中求交集

"intersect_count" can be used in the funnel analysis. Just like comparing the bitmap of two days, you can do that across another dimension.

Recently there is a use case from ManBang group, you can get more from https://kyligence.io/zh/resources/kylin_at_manbang_group/

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




高扬02 <ga...@bianfeng.com>> 于2019年7月30日周二 下午7:33写道:
Hi ShaoFeng,

In this case, I want to query not just retention in the general sense, but the intersection of two sets, such as the calculation of the funnel model , and so on.
Is “intersect_count” inappropriate for this requirement?
Please render your help . Thank you very much.

Best regards.

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org<ma...@apache.org>]
发送时间: 2019年7月31日 7:11
收件人: user <us...@kylin.apache.org>>
主题: Re: kylin中求交集

Hi yang,

What do you want to analysis? From the sql, it looks like adding a condition on "login_type", not seeing how to vary that.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




高扬02 <ga...@bianfeng.com>> 于2019年7月30日周二 上午2:59写道:
Hi ShaoFeng,
I have a similar question.


1.       only one variable dimension, common sql like this:


[cid:image001.png@01D547A8.78C1C3E0]

and I can query :
[cid:image002.jpg@01D547A8.78C1C3E0]

the result is right.


2.       if two or more variable dimension, common sql like this:
[cid:image003.png@01D547A8.78C1C3E0]

One more dimensional condition , and how do I write kylin sql?
Please give me some advice , thank you very much.

Best regards!

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org<ma...@apache.org>]
发送时间: 2019年7月30日 9:04
收件人: user <us...@kylin.apache.org>>
主题: Re: kylin中求交集

Hi Ning,

I'm interested in this scenario. Do you have any progress on this? Thanks.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ShaoFeng Shi <sh...@apache.org>> 于2019年5月28日周二 下午6:26写道:
Hello Wang Ning,

This is interesting. Could you please give an example or scenario to do intersect on multiple dimensions at the same time? The function is extensible, welcome to give more input to us.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ning.wang@ymm56.com<ma...@ymm56.com> <ni...@ymm56.com>> 于2019年5月28日周二 下午11:04写道:
kylin中有intersect_count函数可以计算交集,但是只能有一个维度是变化的,但是我现在算交集是有多个维度不同,该如何解决。

________________________________
ning.wang@ymm56.com<ma...@ymm56.com>

Re: kylin中求交集

Posted by ShaoFeng Shi <sh...@apache.org>.
"intersect_count" can be used in the funnel analysis. Just like comparing
the bitmap of two days, you can do that across another dimension.

Recently there is a use case from ManBang group, you can get more from
https://kyligence.io/zh/resources/kylin_at_manbang_group/

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org




高扬02 <ga...@bianfeng.com> 于2019年7月30日周二 下午7:33写道:

> Hi ShaoFeng,
>
>
>
> In this case, I want to query not just retention in the general sense,
> but the intersection of two sets, such as the calculation of the funnel
> model , and so on.
>
> Is “intersect_count” inappropriate for this requirement?
>
> Please render your help . Thank you very much.
>
>
>
> Best regards.
>
>
>
> *发件人:* ShaoFeng Shi [mailto:shaofengshi@apache.org]
> *发送时间:* 2019年7月31日 7:11
> *收件人:* user <us...@kylin.apache.org>
> *主题:* Re: kylin中求交集
>
>
>
> Hi yang,
>
>
>
> What do you want to analysis? From the sql, it looks like adding a
> condition on "login_type", not seeing how to vary that.
>
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
> Apache Kylin PMC
>
> Email: shaofengshi@apache.org
>
>
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>
> Join Kylin user mail group: user-subscribe@kylin.apache.org
>
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
>
>
>
>
>
> 高扬02 <ga...@bianfeng.com> 于2019年7月30日周二 上午2:59写道:
>
> Hi ShaoFeng,
>
> I have a similar question.
>
>
>
> 1.       only one variable dimension, common sql like this:
>
>
>
>
>
> and I can query :
>
>
>
> the result is right.
>
>
>
> 2.       if two or more variable dimension, common sql like this:
>
>
>
> One more dimensional condition , and how do I write kylin sql?
>
> Please give me some advice , thank you very much.
>
>
>
> Best regards!
>
>
>
> *发件人:* ShaoFeng Shi [mailto:shaofengshi@apache.org]
> *发送时间:* 2019年7月30日 9:04
> *收件人:* user <us...@kylin.apache.org>
> *主题:* Re: kylin中求交集
>
>
>
> Hi Ning,
>
>
>
> I'm interested in this scenario. Do you have any progress on this? Thanks.
>
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
> Apache Kylin PMC
>
> Email: shaofengshi@apache.org
>
>
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>
> Join Kylin user mail group: user-subscribe@kylin.apache.org
>
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
>
>
>
>
>
> ShaoFeng Shi <sh...@apache.org> 于2019年5月28日周二 下午6:26写道:
>
> Hello Wang Ning,
>
>
>
> This is interesting. Could you please give an example or scenario to do
> intersect on multiple dimensions at the same time? The function is
> extensible, welcome to give more input to us.
>
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
> Apache Kylin PMC
>
> Email: shaofengshi@apache.org
>
>
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>
> Join Kylin user mail group: user-subscribe@kylin.apache.org
>
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
>
>
>
>
>
> ning.wang@ymm56.com <ni...@ymm56.com> 于2019年5月28日周二 下午11:04写道:
>
> kylin中有intersect_count函数可以计算交集,但是只能有一个维度是变化的,但是我现在算交集是有多个维度不同,该如何解决。
>
>
> ------------------------------
>
> ning.wang@ymm56.com
>
>

答复: kylin中求交集

Posted by 高扬02 <ga...@bianfeng.com>.
Hi ShaoFeng,

In this case, I want to query not just retention in the general sense, but the intersection of two sets, such as the calculation of the funnel model , and so on.
Is “intersect_count” inappropriate for this requirement?
Please render your help . Thank you very much.

Best regards.

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org]
发送时间: 2019年7月31日 7:11
收件人: user <us...@kylin.apache.org>
主题: Re: kylin中求交集

Hi yang,

What do you want to analysis? From the sql, it looks like adding a condition on "login_type", not seeing how to vary that.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




高扬02 <ga...@bianfeng.com>> 于2019年7月30日周二 上午2:59写道:
Hi ShaoFeng,
I have a similar question.


1.       only one variable dimension, common sql like this:


[cid:image001.png@01D54788.42D64280]

and I can query :
[cid:image002.jpg@01D54788.42D64280]

the result is right.


2.       if two or more variable dimension, common sql like this:
[cid:image003.png@01D54788.42D64280]

One more dimensional condition , and how do I write kylin sql?
Please give me some advice , thank you very much.

Best regards!

发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org<ma...@apache.org>]
发送时间: 2019年7月30日 9:04
收件人: user <us...@kylin.apache.org>>
主题: Re: kylin中求交集

Hi Ning,

I'm interested in this scenario. Do you have any progress on this? Thanks.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ShaoFeng Shi <sh...@apache.org>> 于2019年5月28日周二 下午6:26写道:
Hello Wang Ning,

This is interesting. Could you please give an example or scenario to do intersect on multiple dimensions at the same time? The function is extensible, welcome to give more input to us.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>




ning.wang@ymm56.com<ma...@ymm56.com> <ni...@ymm56.com>> 于2019年5月28日周二 下午11:04写道:
kylin中有intersect_count函数可以计算交集,但是只能有一个维度是变化的,但是我现在算交集是有多个维度不同,该如何解决。

________________________________
ning.wang@ymm56.com<ma...@ymm56.com>

Re: kylin中求交集

Posted by ShaoFeng Shi <sh...@apache.org>.
Hi yang,

What do you want to analysis? From the sql, it looks like adding a
condition on "login_type", not seeing how to vary that.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org




高扬02 <ga...@bianfeng.com> 于2019年7月30日周二 上午2:59写道:

> Hi ShaoFeng,
>
> I have a similar question.
>
>
>
> 1.       only one variable dimension, common sql like this:
>
>
>
>
>
> and I can query :
>
>
>
> the result is right.
>
>
>
> 2.       if two or more variable dimension, common sql like this:
>
>
>
> One more dimensional condition , and how do I write kylin sql?
>
> Please give me some advice , thank you very much.
>
>
>
> Best regards!
>
>
>
> *发件人:* ShaoFeng Shi [mailto:shaofengshi@apache.org]
> *发送时间:* 2019年7月30日 9:04
> *收件人:* user <us...@kylin.apache.org>
> *主题:* Re: kylin中求交集
>
>
>
> Hi Ning,
>
>
>
> I'm interested in this scenario. Do you have any progress on this? Thanks.
>
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
> Apache Kylin PMC
>
> Email: shaofengshi@apache.org
>
>
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>
> Join Kylin user mail group: user-subscribe@kylin.apache.org
>
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
>
>
>
>
>
> ShaoFeng Shi <sh...@apache.org> 于2019年5月28日周二 下午6:26写道:
>
> Hello Wang Ning,
>
>
>
> This is interesting. Could you please give an example or scenario to do
> intersect on multiple dimensions at the same time? The function is
> extensible, welcome to give more input to us.
>
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
> Apache Kylin PMC
>
> Email: shaofengshi@apache.org
>
>
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>
> Join Kylin user mail group: user-subscribe@kylin.apache.org
>
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
>
>
>
>
>
> ning.wang@ymm56.com <ni...@ymm56.com> 于2019年5月28日周二 下午11:04写道:
>
> kylin中有intersect_count函数可以计算交集,但是只能有一个维度是变化的,但是我现在算交集是有多个维度不同,该如何解决。
>
>
> ------------------------------
>
> ning.wang@ymm56.com
>
>