Fwd: Kylin build cube error "Table not found xxx"

[Luke Han <lu...@gmail.com>]

Forward to mailing list for further support.

Thanks.

在 2015年2月9日星期一 UTC+8下午6:54:03，Luke Han写道：
>
> This is known issue:https://issues.apache.org/jira/browse/KYLIN-436
>
> Please use default database in this release, the fix will coming with 
> v0.7.1 release
>
> And, please send question to mailing list for further support.
>
> Thanks.
>
> 在 2015年2月9日星期一 UTC+8下午6:38:10，wang...@gmail.com写道：
>>
>> I checkout the version v0.6.5.
>> Build the demo cube success!
>> I load the hive table meta into kylin which the table is in the "kylin" 
>> hive database.
>> The meta load is success.
>>
>> <https://lh3.googleusercontent.com/-jSWwtDvrL1g/VNiLyNKafPI/AAAAAAAAAAM/If7d3eaZ2tU/s1600/2015-02-09%2B18%3A27%3A47%2B%E7%9A%84%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE.png>
>> In the admin tab page click the "Reload Metadata" button.
>> In the cube add page .select fact table "TEST"
>>
>> <https://lh6.googleusercontent.com/-C5Rzvz-pPw4/VNiMWn3_RII/AAAAAAAAAAU/hIPRTdc-KUc/s1600/2015-02-09%2B18%3A29%3A54%2B%E7%9A%84%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE.png>
>> and finish the next configurations.
>> When build the cube, the error found : "Table not found TEST"
>>
>>
>> I try use "KYLIN.TEST" as the fact table name:
>>
>> <https://lh3.googleusercontent.com/-tDJyb6jxxU8/VNiNVYDZBSI/AAAAAAAAAAo/XOgTS5_XVnw/s1600/2015-02-09%2B18%3A31%3A52%2B%E7%9A%84%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE.png>
>> the "Column Name" field is disabled!
>>
>> <https://lh5.googleusercontent.com/-PPPCP8glOqg/VNiNa6tpFhI/AAAAAAAAAAw/fyFlJh7waqA/s1600/2015-02-09%2B18%3A32%3A09%2B%E7%9A%84%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE.png>
>> How can I use the table in the hive database not "default"?
>>
>>
>>
>>
>>
>>

Re: proposal for real time support in kylin

[Li Yang <li...@apache.org>]

I created a JIRA for this https://issues.apache.org/jira/browse/KYLIN-599

Further discussion goes there. :-)

On Tue, Feb 10, 2015 at 10:15 AM, vipul jhawar <vi...@gmail.com>
wrote:

> Hi Xu
>
> Could we just have Kafka and use its consumers alone instead of storm as
> well in the setup. If you could provide some more details on how a kafka +
> storm would be a better fit as it also introduces more complexity in the
> system instead of the simple log Q which we can get with kafka alone.
>
> Thanks
>
> On Mon, Feb 9, 2015 at 8:55 PM, 蒋旭 <ji...@qq.com> wrote:
>
> > Hi Guys,
> >
> > I write a simple proposal of real time support in kylin as below. Please
> > help to review!
> >
> >
> > 1. Kafka + storm will build inverted index in memory.  These index will
> be
> > inserted into hbase by batch (e.g. every 5 minutes).
> >
> >
> > 2. The inverted index in hbase will keep the short term data (e.g. 7
> > days). These index will be converted into data cube by batch (e.g. every
> 7
> > day).
> >
> >
> > 3. The data cube in hbase will keep the long term data.
> >
> >
> > 4. Query engine will decide to use inverted index or data cube in hbase
> by
> > time range. In future, the query engine can also use the in-memory
> inverted
> > index in storm that can reduce the data latency from minutes to seconds.
> >
> >
> > Thanks
> > Jiang Xu
>

Re: proposal for real time support in kylin

[vipul jhawar <vi...@gmail.com>]

Hi Xu

Could we just have Kafka and use its consumers alone instead of storm as
well in the setup. If you could provide some more details on how a kafka +
storm would be a better fit as it also introduces more complexity in the
system instead of the simple log Q which we can get with kafka alone.

Thanks

On Mon, Feb 9, 2015 at 8:55 PM, 蒋旭 <ji...@qq.com> wrote:

> Hi Guys,
>
> I write a simple proposal of real time support in kylin as below. Please
> help to review!
>
>
> 1. Kafka + storm will build inverted index in memory.  These index will be
> inserted into hbase by batch (e.g. every 5 minutes).
>
>
> 2. The inverted index in hbase will keep the short term data (e.g. 7
> days). These index will be converted into data cube by batch (e.g. every 7
> day).
>
>
> 3. The data cube in hbase will keep the long term data.
>
>
> 4. Query engine will decide to use inverted index or data cube in hbase by
> time range. In future, the query engine can also use the in-memory inverted
> index in storm that can reduce the data latency from minutes to seconds.
>
>
> Thanks
> Jiang Xu

Re: proposal for real time support in kylin

[Luke Han <lu...@gmail.com>]

Thanks Xu, you are back again:-)


Best Regards!
---------------------

Luke Han

2015-02-09 23:25 GMT+08:00 蒋旭 <ji...@qq.com>:

> Hi Guys,
>
> I write a simple proposal of real time support in kylin as below. Please
> help to review!
>
>
> 1. Kafka + storm will build inverted index in memory.  These index will be
> inserted into hbase by batch (e.g. every 5 minutes).
>
>
> 2. The inverted index in hbase will keep the short term data (e.g. 7
> days). These index will be converted into data cube by batch (e.g. every 7
> day).
>
>
> 3. The data cube in hbase will keep the long term data.
>
>
> 4. Query engine will decide to use inverted index or data cube in hbase by
> time range. In future, the query engine can also use the in-memory inverted
> index in storm that can reduce the data latency from minutes to seconds.
>
>
> Thanks
> Jiang Xu

proposal for real time support in kylin

[蒋旭 <ji...@qq.com>]

Hi Guys,

I write a simple proposal of real time support in kylin as below. Please help to review!


1. Kafka + storm will build inverted index in memory.  These index will be inserted into hbase by batch (e.g. every 5 minutes). 


2. The inverted index in hbase will keep the short term data (e.g. 7 days). These index will be converted into data cube by batch (e.g. every 7 day).


3. The data cube in hbase will keep the long term data. 


4. Query engine will decide to use inverted index or data cube in hbase by time range. In future, the query engine can also use the in-memory inverted index in storm that can reduce the data latency from minutes to seconds.


Thanks
Jiang Xu