You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/07/12 05:01:32 UTC
Re: Fast database with writes per second and horizontal scaling
Anyone in Spark as well
My colleague has been using Cassandra. However, he says it is too slow and not user friendly/MongodDB as a doc databases is pretty neat but not fast enough
May main concern is fast writes per second and good scaling.
Hive on Spark or Tez?
How about Hbase. or anything else
Any expert advice warmly acknowledged..
thanking yo
On Monday, 11 July 2016, 17:24, Ashok Kumar <as...@yahoo.com> wrote:
Hi Gurus,
Advice appreciated from Hive gurus.
My colleague has been using Cassandra. However, he says it is too slow and not user friendly/MongodDB as a doc databases is pretty neat but not fast enough
May main concern is fast writes per second and good scaling.
Hive on Spark or Tez?
How about Hbase. or anything else
Any expert advice warmly acknowledged..
thanking you
Re: Fast database with writes per second and horizontal scaling
Posted by Marco Colombo <in...@gmail.com>.
Yes, this is not a question for spark user list.
Btw, in db world, performances depend also on which data you have and
schema you want to use.
First put a target, then evaluate technology.
Cassandra can be really fast di you put data via sstableloader or copy rather
then insert line by line.
Every db has a preferred path for data ingestion.
Il martedì 12 luglio 2016, Yash Sharma <ya...@gmail.com> ha scritto:
> Spark is more of an execution engine rather than a database. Hive is a
> data warehouse but I still like treating it as an execution engine.
>
> For databases, You could compare HBase and Cassandra as they both have
> very wide usage and proven performance. We have used Cassandra in the past
> and were very happy with the results. You should move this discussion on
> Cassandra's/HBase's mailing list for better advice.
>
> Cheers
>
> On Tue, Jul 12, 2016 at 3:23 PM, ayan guha <guha.ayan@gmail.com
> <javascript:_e(%7B%7D,'cvml','guha.ayan@gmail.com');>> wrote:
>
>> HI
>>
>> HBase is pretty neat itself. But speed is not the criteria to choose
>> Hbase over Cassandra (or vicey versa).. Slowness can very well because of
>> design issues, and unfortunately it will not help changing technology in
>> that case :)
>>
>> I would suggest you to quantify "slow"-ness in conjunction
>> with infrastructure you have and I am sure good people here will help.
>>
>> Best
>> Ayan
>>
>> On Tue, Jul 12, 2016 at 3:01 PM, Ashok Kumar <
>> ashok34668@yahoo.com.invalid
>> <javascript:_e(%7B%7D,'cvml','ashok34668@yahoo.com.invalid');>> wrote:
>>
>>> Anyone in Spark as well
>>>
>>> My colleague has been using Cassandra. However, he says it is too slow
>>> and not user friendly/
>>> MongodDB as a doc databases is pretty neat but not fast enough
>>>
>>> May main concern is fast writes per second and good scaling.
>>>
>>>
>>> Hive on Spark or Tez?
>>>
>>> How about Hbase. or anything else
>>>
>>> Any expert advice warmly acknowledged..
>>>
>>> thanking yo
>>>
>>>
>>> On Monday, 11 July 2016, 17:24, Ashok Kumar <ashok34668@yahoo.com
>>> <javascript:_e(%7B%7D,'cvml','ashok34668@yahoo.com');>> wrote:
>>>
>>>
>>> Hi Gurus,
>>>
>>> Advice appreciated from Hive gurus.
>>>
>>> My colleague has been using Cassandra. However, he says it is too slow
>>> and not user friendly/
>>> MongodDB as a doc databases is pretty neat but not fast enough
>>>
>>> May main concern is fast writes per second and good scaling.
>>>
>>>
>>> Hive on Spark or Tez?
>>>
>>> How about Hbase. or anything else
>>>
>>> Any expert advice warmly acknowledged..
>>>
>>> thanking you
>>>
>>>
>>>
>>
>>
>> --
>> Best Regards,
>> Ayan Guha
>>
>
>
--
Ing. Marco Colombo
Re: Fast database with writes per second and horizontal scaling
Posted by Yash Sharma <ya...@gmail.com>.
Spark is more of an execution engine rather than a database. Hive is a data
warehouse but I still like treating it as an execution engine.
For databases, You could compare HBase and Cassandra as they both have very
wide usage and proven performance. We have used Cassandra in the past and
were very happy with the results. You should move this discussion on
Cassandra's/HBase's mailing list for better advice.
Cheers
On Tue, Jul 12, 2016 at 3:23 PM, ayan guha <gu...@gmail.com> wrote:
> HI
>
> HBase is pretty neat itself. But speed is not the criteria to choose Hbase
> over Cassandra (or vicey versa).. Slowness can very well because of design
> issues, and unfortunately it will not help changing technology in that case
> :)
>
> I would suggest you to quantify "slow"-ness in conjunction
> with infrastructure you have and I am sure good people here will help.
>
> Best
> Ayan
>
> On Tue, Jul 12, 2016 at 3:01 PM, Ashok Kumar <ashok34668@yahoo.com.invalid
> > wrote:
>
>> Anyone in Spark as well
>>
>> My colleague has been using Cassandra. However, he says it is too slow
>> and not user friendly/
>> MongodDB as a doc databases is pretty neat but not fast enough
>>
>> May main concern is fast writes per second and good scaling.
>>
>>
>> Hive on Spark or Tez?
>>
>> How about Hbase. or anything else
>>
>> Any expert advice warmly acknowledged..
>>
>> thanking yo
>>
>>
>> On Monday, 11 July 2016, 17:24, Ashok Kumar <as...@yahoo.com> wrote:
>>
>>
>> Hi Gurus,
>>
>> Advice appreciated from Hive gurus.
>>
>> My colleague has been using Cassandra. However, he says it is too slow
>> and not user friendly/
>> MongodDB as a doc databases is pretty neat but not fast enough
>>
>> May main concern is fast writes per second and good scaling.
>>
>>
>> Hive on Spark or Tez?
>>
>> How about Hbase. or anything else
>>
>> Any expert advice warmly acknowledged..
>>
>> thanking you
>>
>>
>>
>
>
> --
> Best Regards,
> Ayan Guha
>
Fwd: Fast database with writes per second and horizontal scaling
Posted by ayan guha <gu...@gmail.com>.
HI
HBase is pretty neat itself. But speed is not the criteria to choose Hbase
over Cassandra (or vicey versa).. Slowness can very well because of design
issues, and unfortunately it will not help changing technology in that case
:)
I would suggest you to quantify "slow"-ness in conjunction
with infrastructure you have and I am sure good people here will help.
Best
Ayan
On Tue, Jul 12, 2016 at 3:01 PM, Ashok Kumar <as...@yahoo.com.invalid>
wrote:
> Anyone in Spark as well
>
> My colleague has been using Cassandra. However, he says it is too slow
> and not user friendly/
> MongodDB as a doc databases is pretty neat but not fast enough
>
> May main concern is fast writes per second and good scaling.
>
>
> Hive on Spark or Tez?
>
> How about Hbase. or anything else
>
> Any expert advice warmly acknowledged..
>
> thanking yo
>
>
> On Monday, 11 July 2016, 17:24, Ashok Kumar <as...@yahoo.com> wrote:
>
>
> Hi Gurus,
>
> Advice appreciated from Hive gurus.
>
> My colleague has been using Cassandra. However, he says it is too slow
> and not user friendly/
> MongodDB as a doc databases is pretty neat but not fast enough
>
> May main concern is fast writes per second and good scaling.
>
>
> Hive on Spark or Tez?
>
> How about Hbase. or anything else
>
> Any expert advice warmly acknowledged..
>
> thanking you
>
>
>
--
Best Regards,
Ayan Guha