Hbase schema for time based analytics

[Prem Yadav <ip...@gmail.com>]

Hi,
we have a use case where we need to get the data for a day/week/month.

We need additional filters for the data so it will be like "select where
data between <initial_date> and <final_date> where filter=<some
column=value>

This is telemetry type data and is heavily written. About 2+TB per day.

How should we go about the schema?

Also, can someone point me to a good schema design tutorial?

Thanks

Re: Hbase schema for time based analytics

[Heng Chen <he...@gmail.com>]

OpenTSDB + 1    :)

2016-03-23 11:49 GMT+08:00 Wojciech Indyk <wo...@gmail.com>:

> Hi Prem!
> Look at OpenTSDB http://opentsdb.net/
> --
> Kind regards/ Pozdrawiam,
> Wojciech Indyk
> http://datacentric.pl
>
>
> 2016-03-07 11:26 GMT+01:00 Prem Yadav <ip...@gmail.com>:
> > Hi,
> > we have a use case where we need to get the data for a day/week/month.
> >
> > We need additional filters for the data so it will be like "select where
> > data between <initial_date> and <final_date> where filter=<some
> > column=value>
> >
> > This is telemetry type data and is heavily written. About 2+TB per day.
> >
> > How should we go about the schema?
> >
> > Also, can someone point me to a good schema design tutorial?
> >
> > Thanks
>

Re: Hbase schema for time based analytics

[Wojciech Indyk <wo...@gmail.com>]

Hi Prem!
Look at OpenTSDB http://opentsdb.net/
--
Kind regards/ Pozdrawiam,
Wojciech Indyk
http://datacentric.pl


2016-03-07 11:26 GMT+01:00 Prem Yadav <ip...@gmail.com>:
> Hi,
> we have a use case where we need to get the data for a day/week/month.
>
> We need additional filters for the data so it will be like "select where
> data between <initial_date> and <final_date> where filter=<some
> column=value>
>
> This is telemetry type data and is heavily written. About 2+TB per day.
>
> How should we go about the schema?
>
> Also, can someone point me to a good schema design tutorial?
>
> Thanks