You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hbase.apache.org by Jean-Marc Spaggiari <je...@spaggiari.org> on 2012/11/14 19:51:43 UTC

Does MapReduce need HBase to be running?

Hi,

I'm wondering, when I run a MapReduce job over the cluster, do I need
to have HBase running? Or I can close it? That will allow me to give
an additionnal 2GB to hadoop instead of giving it to HBase if it's not
used.

Thanks,

JM

Re: Does MapReduce need HBase to be running?

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.

Thanks Suraj.

Finally I had to keep my HBase on because I'm outputing in an HTable.

But I understand that if I only read from the parameters I'm getting,
I don't need HBase to be running. That's good to know.

JM

2012/11/21, Suraj Varma <sv...@gmail.com>:
> Right - if your map is not accessing HBase at all ... it can be down.
> --Suraj
>
> On Wed, Nov 14, 2012 at 11:03 AM, Jean-Marc Spaggiari
> <je...@spaggiari.org> wrote:
>> Hum. I'm calling HTables, and doing puts and gets. So it will not be
>> working for my scenario.
>>
>> But if I "simply" need to map the data and output on a file, that
>> should be working fine with HBase down, right?
>>
>> 2012/11/14, Ted Yu <yu...@gmail.com>:
>>> If your MapReduce job doesn't access HBase, HBase can be stopped.
>>>
>>> On Wed, Nov 14, 2012 at 10:51 AM, Jean-Marc Spaggiari <
>>> jean-marc@spaggiari.org> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm wondering, when I run a MapReduce job over the cluster, do I need
>>>> to have HBase running? Or I can close it? That will allow me to give
>>>> an additionnal 2GB to hadoop instead of giving it to HBase if it's not
>>>> used.
>>>>
>>>> Thanks,
>>>>
>>>> JM
>>>>
>>>
>

Re: Does MapReduce need HBase to be running?

Posted by Suraj Varma <sv...@gmail.com>.

Right - if your map is not accessing HBase at all ... it can be down.
--Suraj

On Wed, Nov 14, 2012 at 11:03 AM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:
> Hum. I'm calling HTables, and doing puts and gets. So it will not be
> working for my scenario.
>
> But if I "simply" need to map the data and output on a file, that
> should be working fine with HBase down, right?
>
> 2012/11/14, Ted Yu <yu...@gmail.com>:
>> If your MapReduce job doesn't access HBase, HBase can be stopped.
>>
>> On Wed, Nov 14, 2012 at 10:51 AM, Jean-Marc Spaggiari <
>> jean-marc@spaggiari.org> wrote:
>>
>>> Hi,
>>>
>>> I'm wondering, when I run a MapReduce job over the cluster, do I need
>>> to have HBase running? Or I can close it? That will allow me to give
>>> an additionnal 2GB to hadoop instead of giving it to HBase if it's not
>>> used.
>>>
>>> Thanks,
>>>
>>> JM
>>>
>>

Re: Does MapReduce need HBase to be running?

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.

Hum. I'm calling HTables, and doing puts and gets. So it will not be
working for my scenario.

But if I "simply" need to map the data and output on a file, that
should be working fine with HBase down, right?

2012/11/14, Ted Yu <yu...@gmail.com>:
> If your MapReduce job doesn't access HBase, HBase can be stopped.
>
> On Wed, Nov 14, 2012 at 10:51 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> Hi,
>>
>> I'm wondering, when I run a MapReduce job over the cluster, do I need
>> to have HBase running? Or I can close it? That will allow me to give
>> an additionnal 2GB to hadoop instead of giving it to HBase if it's not
>> used.
>>
>> Thanks,
>>
>> JM
>>
>

Re: Does MapReduce need HBase to be running?

Posted by Ted Yu <yu...@gmail.com>.

If your MapReduce job doesn't access HBase, HBase can be stopped.

On Wed, Nov 14, 2012 at 10:51 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Hi,
>
> I'm wondering, when I run a MapReduce job over the cluster, do I need
> to have HBase running? Or I can close it? That will allow me to give
> an additionnal 2GB to hadoop instead of giving it to HBase if it's not
> used.
>
> Thanks,
>
> JM
>