You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 蒋旭 <ji...@qq.com> on 2015/08/05 17:42:22 UTC
回复：Kylin Real time
I think that Kylin can support second-level data latency if the inverted index is ready.
The biggest problem is that inverted index is not in the high priority tasks. :)
Thanks
JiangXu
------------------ 原始邮件 ------------------
发件人: Luke Han <lu...@gmail.com>
发送时间: 2015年08月05日 23:02
收件人: dev@kylin.incubator.apache.org <de...@kylin.incubator.apache.org>
主题: Re: Kylin Real time
Kylin is OLAP not OLTP, even with streaming feature, it still support Near
real-time, do not expected sub-second data latency (query latency still
will be sub-second latency).
For example, if your customer want to see user's action information on your
website "right now" (like you said milliseconds), I do not recommend to
leverage Kylin this monument, but if your user are ok to see the data
several minutes even seconds before, that could be benefited by Kylin
streaming.
It's really depends on how fast your user want to see the result from the
source data.
Realtime monitoring and alert is not Kylin's target to serve:)
Thanks.
Best Regards!
---------------------
Luke Han
On Wed, Aug 5, 2015 at 2:43 PM, Siddharth Ubale <siddharth.ubale@syncoms.com
> wrote:
> Hi Luke,
>
> Thanks for the update!
>
> Our case is a real time streaming OLAP. We want to query the the data in
> OLAP system and it should respond with low latency(probably 1-2 seconds)
> and the state of the OLAP table is real time and not pre-calculated. In
> short, OLAP will function like OLTP..
> It is probably wishful to think that the system should provide data in
> milliseconds , however, if that can be provided it will suffice our needs.
>
>
> Thanks,
> Siddharth Ubale
>
> -----Original Message-----
> From: Luke Han [mailto:luke.hq@gmail.com]
> Sent: Monday, August 03, 2015 7:22 PM
> To: dev@kylin.incubator.apache.org
> Subject: Re: Kylin Real time
>
> Hi Siddharth,
> Kylin's next majority release (0.8.x) will support Streaming OLAP
> which will coming in Q4 since it still under development now, as Hongbin
> mentioned above.
> Could you please drop me a mail about your case? I would like to
> better understand your scenario to well manage coming features?
>
> Thanks.
>
>
>
>
> Best Regards!
> ---------------------
>
> Luke Han
>
> On Wed, Jul 29, 2015 at 2:08 PM, hongbin ma <ma...@apache.org> wrote:
>
> > For current 0.7 releases, you cannot.
> >
> > Real time data processing and querying will be added in 0.8 release.
> > It is still under development and testing. We have achieved good
> > progress on it, please wait for announcements.
> >
> > On Wed, Jul 29, 2015 at 2:02 PM, Siddharth Ubale <
> > siddharth.ubale@syncoms.com> wrote:
> >
> > > Hi ,
> > >
> > > I would like to ask whether Kylin can be used as a real time
> > > querying system?
> > > The process of building a cube , makes it look like a batch process
> > > after which the queries are with low latency.. however can We get a
> > > real time idea of what the OLAP system's state is at the query
> > > instance?
> > >
> > > Thanks,
> > > Siddharth
> > >
> >
> >
> >
> > --
> > Regards,
> >
> > *Bin Mahone | 马洪宾*
> > Apache Kylin: http://kylin.io
> > Github: https://github.com/binmahone
> >
>
Re: Kylin Real time
Posted by Li Yang <li...@apache.org>.
Exactly. Second-level data latency is on road map, but we prioritize more
on faster cubing, TopN, and more flexible aggregation groups.
On Wed, Aug 5, 2015 at 11:42 PM, 蒋旭 <ji...@qq.com> wrote:
> I think that Kylin can support second-level data latency if the inverted
> index is ready.
>
>
> The biggest problem is that inverted index is not in the high priority
> tasks. :)
>
>
> Thanks
> JiangXu
>
>
> ------------------ 原始邮件 ------------------
> 发件人: Luke Han <lu...@gmail.com>
> 发送时间: 2015年08月05日 23:02
> 收件人: dev@kylin.incubator.apache.org <de...@kylin.incubator.apache.org>
> 主题: Re: Kylin Real time
>
>
>
> Kylin is OLAP not OLTP, even with streaming feature, it still support Near
> real-time, do not expected sub-second data latency (query latency still
> will be sub-second latency).
> For example, if your customer want to see user's action information on your
> website "right now" (like you said milliseconds), I do not recommend to
> leverage Kylin this monument, but if your user are ok to see the data
> several minutes even seconds before, that could be benefited by Kylin
> streaming.
>
> It's really depends on how fast your user want to see the result from the
> source data.
>
> Realtime monitoring and alert is not Kylin's target to serve:)
>
> Thanks.
>
>
> Best Regards!
> ---------------------
>
> Luke Han
>
> On Wed, Aug 5, 2015 at 2:43 PM, Siddharth Ubale <
> siddharth.ubale@syncoms.com
> > wrote:
>
> > Hi Luke,
> >
> > Thanks for the update!
> >
> > Our case is a real time streaming OLAP. We want to query the the data in
> > OLAP system and it should respond with low latency(probably 1-2 seconds)
> > and the state of the OLAP table is real time and not pre-calculated. In
> > short, OLAP will function like OLTP..
> > It is probably wishful to think that the system should provide data in
> > milliseconds , however, if that can be provided it will suffice our
> needs.
> >
> >
> > Thanks,
> > Siddharth Ubale
> >
> > -----Original Message-----
> > From: Luke Han [mailto:luke.hq@gmail.com]
> > Sent: Monday, August 03, 2015 7:22 PM
> > To: dev@kylin.incubator.apache.org
> > Subject: Re: Kylin Real time
> >
> > Hi Siddharth,
> > Kylin's next majority release (0.8.x) will support Streaming OLAP
> > which will coming in Q4 since it still under development now, as Hongbin
> > mentioned above.
> > Could you please drop me a mail about your case? I would like to
> > better understand your scenario to well manage coming features?
> >
> > Thanks.
> >
> >
> >
> >
> > Best Regards!
> > ---------------------
> >
> > Luke Han
> >
> > On Wed, Jul 29, 2015 at 2:08 PM, hongbin ma <ma...@apache.org>
> wrote:
> >
> > > For current 0.7 releases, you cannot.
> > >
> > > Real time data processing and querying will be added in 0.8 release.
> > > It is still under development and testing. We have achieved good
> > > progress on it, please wait for announcements.
> > >
> > > On Wed, Jul 29, 2015 at 2:02 PM, Siddharth Ubale <
> > > siddharth.ubale@syncoms.com> wrote:
> > >
> > > > Hi ,
> > > >
> > > > I would like to ask whether Kylin can be used as a real time
> > > > querying system?
> > > > The process of building a cube , makes it look like a batch process
> > > > after which the queries are with low latency.. however can We get a
> > > > real time idea of what the OLAP system's state is at the query
> > > > instance?
> > > >
> > > > Thanks,
> > > > Siddharth
> > > >
> > >
> > >
> > >
> > > --
> > > Regards,
> > >
> > > *Bin Mahone | 马洪宾*
> > > Apache Kylin: http://kylin.io
> > > Github: https://github.com/binmahone
> > >
> >
>