You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by marko <ma...@nissatech.com> on 2017/12/21 11:27:17 UTC
Reading data from OpenTSDB or KairosDB
Hello everyone,
I would like to know whether there is a way to read time-series data
from OpenTSDB (built on top of HBase) or KairosDB (built on top of
Cassandra) to a Spark DataFrame (or RDD's) ?
Best regards,
Marko
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Reading data from OpenTSDB or KairosDB
Posted by marko <ma...@nissatech.com>.
Hello,
Thanks for your answer.
And what do you think about approach of querying data using
OpenTSDB/KairosDB piece by piece, creating a dataframe for each piece,
and then making a union out of them?
This would enable us to store and query data as timeseries and process
it using Spark?
Best regards,
Marko
On 12/21/2017 12:48 PM, Jörn Franke wrote:
> There are datasource for Cassandra and hbase, however I am not sure how useful they are, because then you need to do also implement the logic of opentsdb or kairosdb.
>
> Better to implement your own data sources.
> Then, there are several projects enabling timeseries queries in Spark, but I am not sure how much they are used. Additionally time series analysis may imply a lot of different functionality (eg matching time stamps), which those they may not have.
>
>> On 21. Dec 2017, at 12:27, marko <ma...@nissatech.com> wrote:
>>
>> Hello everyone,
>>
>> I would like to know whether there is a way to read time-series data from OpenTSDB (built on top of HBase) or KairosDB (built on top of Cassandra) to a Spark DataFrame (or RDD's) ?
>>
>> Best regards,
>> Marko
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Reading data from OpenTSDB or KairosDB
Posted by Jörn Franke <jo...@gmail.com>.
There are datasource for Cassandra and hbase, however I am not sure how useful they are, because then you need to do also implement the logic of opentsdb or kairosdb.
Better to implement your own data sources.
Then, there are several projects enabling timeseries queries in Spark, but I am not sure how much they are used. Additionally time series analysis may imply a lot of different functionality (eg matching time stamps), which those they may not have.
> On 21. Dec 2017, at 12:27, marko <ma...@nissatech.com> wrote:
>
> Hello everyone,
>
> I would like to know whether there is a way to read time-series data from OpenTSDB (built on top of HBase) or KairosDB (built on top of Cassandra) to a Spark DataFrame (or RDD's) ?
>
> Best regards,
> Marko
>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org