You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Something Something <ma...@gmail.com> on 2016/09/05 23:57:56 UTC
Documentation on how data is stored
Hello,
Is there any documentation available on how Kylin stores data on HBase? For
example, I am trying to understand how data is stored on HBase when I run
bin/sample.sh to create the "learn_kylin" project.
I looked at the HBase table for the Cube. It has 2 column families but I
don't understand what goes where in this table after Cube is built.
I setup 'remote debugging' to debug the code, but the QueryService code
seems to be off between the binary release (
http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-HBase1.x-bin.tar.gz)
and the source code (
http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-src.tar.gz
)
I will keep debugging but if any documentation about "how data is stored"
(UML diagram or something) is available, please share.
Thanks.
Re: Documentation on how data is stored
Posted by Alberto Ramón <a....@gmail.com>.
I dont have more info about this
But,Kylin - 1453 <https://issues.apache.org/jira/browse/KYLIN-1453> v1.5.2
Shardin: must be a great feature (and affect to to Key Compose)
- before: used hash of key
- now: uses hash of column
In true, I have too many doubts :)
2016-09-06 9:44 GMT+02:00 Something Something <ma...@gmail.com>:
> Hmm... that's a good start... but is there more info available somewhere?
> Can you direct me to that PPT? Thanks.
>
> On Tue, Sep 6, 2016 at 12:16 AM, Alberto Ramón <a....@gmail.com>
> wrote:
>
>> I have this picture: (I found this info in a PPT)
>>
>> [image: Imágenes integradas 1]
>>
>> Remember that you can encode dim, by dictionarty or fix length
>>
>>
>> 2016-09-06 1:57 GMT+02:00 Something Something <ma...@gmail.com>:
>>
>>> Hello,
>>>
>>> Is there any documentation available on how Kylin stores data on HBase?
>>> For example, I am trying to understand how data is stored on HBase when I
>>> run bin/sample.sh to create the "learn_kylin" project.
>>>
>>> I looked at the HBase table for the Cube. It has 2 column families but I
>>> don't understand what goes where in this table after Cube is built.
>>>
>>> I setup 'remote debugging' to debug the code, but the QueryService code
>>> seems to be off between the binary release (
>>> http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-1.5
>>> .3/apache-kylin-1.5.3-HBase1.x-bin.tar.gz) and the source code (
>>> http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-1.5
>>> .3/apache-kylin-1.5.3-src.tar.gz)
>>>
>>> I will keep debugging but if any documentation about "how data is
>>> stored" (UML diagram or something) is available, please share.
>>>
>>> Thanks.
>>>
>>
>>
>
Re: Documentation on how data is stored
Posted by Something Something <ma...@gmail.com>.
Hmm... that's a good start... but is there more info available somewhere?
Can you direct me to that PPT? Thanks.
On Tue, Sep 6, 2016 at 12:16 AM, Alberto Ramón <a....@gmail.com>
wrote:
> I have this picture: (I found this info in a PPT)
>
> [image: Imágenes integradas 1]
>
> Remember that you can encode dim, by dictionarty or fix length
>
>
> 2016-09-06 1:57 GMT+02:00 Something Something <ma...@gmail.com>:
>
>> Hello,
>>
>> Is there any documentation available on how Kylin stores data on HBase?
>> For example, I am trying to understand how data is stored on HBase when I
>> run bin/sample.sh to create the "learn_kylin" project.
>>
>> I looked at the HBase table for the Cube. It has 2 column families but I
>> don't understand what goes where in this table after Cube is built.
>>
>> I setup 'remote debugging' to debug the code, but the QueryService code
>> seems to be off between the binary release (http://www.apache.org/dyn/clo
>> ser.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-HBase1.x-bin.tar.gz)
>> and the source code (http://www.apache.org/dyn/clo
>> ser.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-src.tar.gz)
>>
>> I will keep debugging but if any documentation about "how data is stored"
>> (UML diagram or something) is available, please share.
>>
>> Thanks.
>>
>
>
Re: Documentation on how data is stored
Posted by Alberto Ramón <a....@gmail.com>.
I have this picture: (I found this info in a PPT)
[image: Imágenes integradas 1]
Remember that you can encode dim, by dictionarty or fix length
2016-09-06 1:57 GMT+02:00 Something Something <ma...@gmail.com>:
> Hello,
>
> Is there any documentation available on how Kylin stores data on HBase?
> For example, I am trying to understand how data is stored on HBase when I
> run bin/sample.sh to create the "learn_kylin" project.
>
> I looked at the HBase table for the Cube. It has 2 column families but I
> don't understand what goes where in this table after Cube is built.
>
> I setup 'remote debugging' to debug the code, but the QueryService code
> seems to be off between the binary release (http://www.apache.org/dyn/
> closer.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-HBase1.x-bin.tar.gz)
> and the source code (http://www.apache.org/dyn/
> closer.cgi/kylin/apache-kylin-1.5.3/apache-kylin-1.5.3-src.tar.gz)
>
> I will keep debugging but if any documentation about "how data is stored"
> (UML diagram or something) is available, please share.
>
> Thanks.
>