You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "446463844@qq.com" <44...@qq.com> on 2016/11/07 06:40:57 UTC
Can Kylin load data from Hbase?
Hi:
Can Kylin load data from HBase?
And floating table which is anomaly in Hbase?
446463844@qq.com
Re: Re: Can Kylin load data from Hbase?
Posted by ShaoFeng Shi <sh...@apache.org>.
" I want to smooth it and export it in hive through kylin, can kylin do
this ?"
--> I don't Kylin can not load data from HBase to Hive; Instead, it load
data from Hive and then persisted the cube into HBase;
To Alberto, for NRT Kylin still use the Cube on HBase; the previous
"inverted index" has some limitation, related code has been cleaned up from
Kylin;
2016-11-07 16:29 GMT+08:00 Alberto Ramón <a....@gmail.com>:
> Short Answer: No
>
> Kylins, read from datasource (Hive or Kafka) and Writes on HBase (there is
> no plan to add more storage plugings)
>
> As Kylin Engine: uses MR, some plans to add Spark (in future), and Java +
> Inverted index (In development for "NRT Streaming")
>
> Proposed Solution for you: Map HBase table on Hive, (the integration
> between HBase and HIve its good), then you will See HBase table from Hive
> ;)
>
> 2016-11-07 9:12 GMT+01:00 Mario Copperfield <xw...@gmail.com>:
>
> > I think kylin can not transfer data from hbase to hive
> >
> > On Mon, Nov 7, 2016 at 4:07 PM, 446463844@qq.com <44...@qq.com>
> wrote:
> >
> > > Thanks!
> > > sorry for that,I am pool in my English.
> > > second question :
> > > I have a table in HBase and it's not orderliness in columns. I want to
> > > smooth it and export it in hive through kylin, can kylin do this ?
> > >
> > >
> > >
> > > 446463844@qq.com
> > >
> > > From: Alberto Ramón
> > > Date: 2016-11-07 15:57
> > > To: dev
> > > Subject: Re: Can Kylin load data from Hbase?
> > > Hello;;
> > >
> > > See this: http://kylin.apache.org/development/plugin_arch.html
> > > As Data Source, there is only two types: Hive and Kafka (in progress)
> > >
> > > (I don't understand your second Q)
> > >
> > > 2016-11-07 7:40 GMT+01:00 446463844@qq.com <44...@qq.com>:
> > >
> > > > Hi:
> > > > Can Kylin load data from HBase?
> > > > And floating table which is anomaly in Hbase?
> > > >
> > > >
> > > >
> > > > 446463844@qq.com
> > > >
> > >
> >
> >
> >
> > --
> > Best regards,
> > Amuro Copperfield
> >
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Re: Can Kylin load data from Hbase?
Posted by Alberto Ramón <a....@gmail.com>.
Short Answer: No
Kylins, read from datasource (Hive or Kafka) and Writes on HBase (there is
no plan to add more storage plugings)
As Kylin Engine: uses MR, some plans to add Spark (in future), and Java +
Inverted index (In development for "NRT Streaming")
Proposed Solution for you: Map HBase table on Hive, (the integration
between HBase and HIve its good), then you will See HBase table from Hive
;)
2016-11-07 9:12 GMT+01:00 Mario Copperfield <xw...@gmail.com>:
> I think kylin can not transfer data from hbase to hive
>
> On Mon, Nov 7, 2016 at 4:07 PM, 446463844@qq.com <44...@qq.com> wrote:
>
> > Thanks!
> > sorry for that,I am pool in my English.
> > second question :
> > I have a table in HBase and it's not orderliness in columns. I want to
> > smooth it and export it in hive through kylin, can kylin do this ?
> >
> >
> >
> > 446463844@qq.com
> >
> > From: Alberto Ramón
> > Date: 2016-11-07 15:57
> > To: dev
> > Subject: Re: Can Kylin load data from Hbase?
> > Hello;;
> >
> > See this: http://kylin.apache.org/development/plugin_arch.html
> > As Data Source, there is only two types: Hive and Kafka (in progress)
> >
> > (I don't understand your second Q)
> >
> > 2016-11-07 7:40 GMT+01:00 446463844@qq.com <44...@qq.com>:
> >
> > > Hi:
> > > Can Kylin load data from HBase?
> > > And floating table which is anomaly in Hbase?
> > >
> > >
> > >
> > > 446463844@qq.com
> > >
> >
>
>
>
> --
> Best regards,
> Amuro Copperfield
>
Re: Re: Can Kylin load data from Hbase?
Posted by Mario Copperfield <xw...@gmail.com>.
I think kylin can not transfer data from hbase to hive
On Mon, Nov 7, 2016 at 4:07 PM, 446463844@qq.com <44...@qq.com> wrote:
> Thanks!
> sorry for that,I am pool in my English.
> second question :
> I have a table in HBase and it's not orderliness in columns. I want to
> smooth it and export it in hive through kylin, can kylin do this ?
>
>
>
> 446463844@qq.com
>
> From: Alberto Ramón
> Date: 2016-11-07 15:57
> To: dev
> Subject: Re: Can Kylin load data from Hbase?
> Hello;;
>
> See this: http://kylin.apache.org/development/plugin_arch.html
> As Data Source, there is only two types: Hive and Kafka (in progress)
>
> (I don't understand your second Q)
>
> 2016-11-07 7:40 GMT+01:00 446463844@qq.com <44...@qq.com>:
>
> > Hi:
> > Can Kylin load data from HBase?
> > And floating table which is anomaly in Hbase?
> >
> >
> >
> > 446463844@qq.com
> >
>
--
Best regards,
Amuro Copperfield
Re: Re: Can Kylin load data from Hbase?
Posted by "446463844@qq.com" <44...@qq.com>.
Thanks!
sorry for that,I am pool in my English.
second question :
I have a table in HBase and it's not orderliness in columns. I want to smooth it and export it in hive through kylin, can kylin do this ?
446463844@qq.com
From: Alberto Ramón
Date: 2016-11-07 15:57
To: dev
Subject: Re: Can Kylin load data from Hbase?
Hello;;
See this: http://kylin.apache.org/development/plugin_arch.html
As Data Source, there is only two types: Hive and Kafka (in progress)
(I don't understand your second Q)
2016-11-07 7:40 GMT+01:00 446463844@qq.com <44...@qq.com>:
> Hi:
> Can Kylin load data from HBase?
> And floating table which is anomaly in Hbase?
>
>
>
> 446463844@qq.com
>
Re: Can Kylin load data from Hbase?
Posted by Alberto Ramón <a....@gmail.com>.
Hello;;
See this: http://kylin.apache.org/development/plugin_arch.html
As Data Source, there is only two types: Hive and Kafka (in progress)
(I don't understand your second Q)
2016-11-07 7:40 GMT+01:00 446463844@qq.com <44...@qq.com>:
> Hi:
> Can Kylin load data from HBase?
> And floating table which is anomaly in Hbase?
>
>
>
> 446463844@qq.com
>