You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by rahulsingh <ra...@i-link.co.in> on 2017/02/13 13:26:37 UTC
about cube building?
what are ideal way to build cube? Like what are the parameters we should keep
in mind before building cube?
how much data(in days) can be stored in cube? What is the best incremental
period for cube?
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by rahulsingh <ra...@i-link.co.in>.
Around 700 MB we are adding per day.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181p7190.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by rahulsingh <ra...@i-link.co.in>.
Thank you
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181p7208.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by Alberto Ramón <a....@gmail.com>.
about NodeJS, there is another open thread "Kylin with Node JS"
http://apache-kylin.74782.x6.nabble.com/Kylin-with-Node-JS-td7180.html
2017-02-14 14:43 GMT+01:00 rahulsingh <ra...@i-link.co.in>:
> need some clarification.
>
> 1. Is there any kylin package for nodejs?
> 2. Can we use nodejs as backend with kylin?
>
> Thank you
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/about-cube-building-tp7181p7204.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Re: about cube building?
Posted by rahulsingh <ra...@i-link.co.in>.
need some clarification.
1. Is there any kylin package for nodejs?
2. Can we use nodejs as backend with kylin?
Thank you
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181p7204.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by rahulsingh <ra...@i-link.co.in>.
thank you for your response..
but still i am little bit confused about cube merging time.
Thank You
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181p7203.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by Alberto Ramón <a....@gmail.com>.
The size isn't a problem thanks to HBase. See this
<http://www.slideshare.net/Hadoop_Summit/apache-kyln-balance-between-space-and-time#8>
cubes of TB works fine, and one project can hold several cubes ;)
About the merge slowness I can't see any problem
2017-02-14 10:07 GMT+01:00 rahulsingh <ra...@i-link.co.in>:
> And how much data(in size) we can keep in cube?
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/about-cube-building-tp7181p7195.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Re: about cube building?
Posted by rahulsingh <ra...@i-link.co.in>.
And how much data(in size) we can keep in cube?
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181p7195.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by Alberto Ramón <a....@gmail.com>.
I cant see any error
How many GB are per day?
2017-02-13 18:16 GMT+01:00 rahulsingh <ra...@i-link.co.in>:
> Yes, it is a full date in the format of YYYY-MM-DD
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/about-cube-building-tp7181p7187.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Re: about cube building?
Posted by rahulsingh <ra...@i-link.co.in>.
Yes, it is a full date in the format of YYYY-MM-DD
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181p7187.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by Alberto Ramón <a....@gmail.com>.
Merge segments in Kylin, means rebuild HBase region
Is your partition Column a DaySlot ?
2017-02-13 15:30 GMT+01:00 rahulsingh <ra...@i-link.co.in>:
> Thank you for the solution.
>
> But I have already gone through this documentation.
> Now my scenario is that i am building cube of 30 days data is first build
> then again other 30 days data in second build, then i m merging the cube,
> while merging it is taking around 150 mins to merge, the i have added 1 day
> data to the same cube and again merge the both i.e(60 days and 1 day), and
> it is taking around 160 mins to merge.
>
> Here my question is why cube is taking this much of time while merging of 1
> day data?
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/about-cube-building-tp7181p7185.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Re: about cube building?
Posted by rahulsingh <ra...@i-link.co.in>.
Thank you for the solution.
But I have already gone through this documentation.
Now my scenario is that i am building cube of 30 days data is first build
then again other 30 days data in second build, then i m merging the cube,
while merging it is taking around 150 mins to merge, the i have added 1 day
data to the same cube and again merge the both i.e(60 days and 1 day), and
it is taking around 160 mins to merge.
Here my question is why cube is taking this much of time while merging of 1
day data?
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/about-cube-building-tp7181p7185.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: about cube building?
Posted by Alberto Ramón <a....@gmail.com>.
Hello,
About the first steps, you can see, "Quick Start with Sample cube"
<http://kylin.apache.org/docs16/tutorial/kylin_sample.html>
About, "incremental period for cube", see "Create Cube
<http://kylin.apache.org/docs16/tutorial/create_cube.html>" and Retention
Range (step 4 of this manual). More detailed description on KYLIN-906
<https://issues.apache.org/jira/browse/KYLIN-906>
2017-02-13 14:26 GMT+01:00 rahulsingh <ra...@i-link.co.in>:
> what are ideal way to build cube? Like what are the parameters we should
> keep
> in mind before building cube?
> how much data(in days) can be stored in cube? What is the best incremental
> period for cube?
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/about-cube-building-tp7181.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>