You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Ravi <ra...@gmail.com> on 2009/12/18 04:34:50 UTC
Re: Can I use hadoop inside hbase?
I installed hbase as described here:
http://hadoop.apache.org/hbase/docs/current/cygwin.html
I am only using it for development purposes only, hence no concerns
about performance etc. I can bet millions of people would love an easier
windows install for development/experimentation purposes.
So back to my original question, how can I use hadoop inside hbase?
Andrew Purtell wrote:
> I should also add that HBase running in standalone mode without Hadoop is only useful for limited testing and I don't recommend it.
>
> - Andy
>
> On Sun Nov 29th, 2009 5:39 PM PST Andrew Purtell wrote:
>
>> If you want to run Hadoop commands, then you must install Hadoop of course. Please see http://wiki.apache.org/hadoop/GettingStartedWithHadoop
>>
>> HBase does not have a Windows distribution per se, so I am a little confused about just what you have installed. I presume you downloaded the HBase release tarball.
>>
>> - Andy
>>
>>
>> On Sun Nov 29th, 2009 3:57 PM PST Ravi wrote:
>>
>>>
>>> I am using the windows distribution, it must have come with hadoop built in as I did not install hadoop separately. The distribution however does not have any hadoop commands or shell scripts.
>>>
>>> So looks like this is a hbase windows distribution issue?
>>>
>>>
>>> Andrew Purtell wrote:
>>>> To run HBase you must have installed Hadoop underneath. The Hadoop top level command line script 'bin/hadoop' is available in your Hadoop installation. Just put the Hadoop bin/ dir on the path along with the HBase bin/ dir.
>>>> You can also run some Hadoop applications using the HBase command script, but that is missing the shortcuts, e.g. instead of
>>>>
>>>> hadoop fs -copyFromLocal ...
>>>>
>>>> it is
>>>> hbase org.apache.hadoop.fs.FsShell -copyFromLocal ...
>>>>
>>>> This will work for DFS but for other filesystems which need supporting jars in lib/, your mileage will vary. Just put the Hadoop bin/ dir on the path along with the HBase bin/ dir and use the appropriate one for the circumstances.
>>>> - Andy
>>>>
>>>>
>>>>
>>>> ________________________________
>>>> From: Ravi <ra...@gmail.com>
>>>> To: hbase-user@hadoop.apache.org
>>>> Sent: Sun, November 29, 2009 8:28:58 AM
>>>> Subject: Re: Can I use hadoop inside hbase?
>>>>
>>>> Thanks for the quick clarification Jeff.
>>>>
>>>> In hbase distribution, I am unable to find hadoop command to load files into DFS. How do I add hadoop commands to hbase distribution?
>>>>
>>>>
>>>> Jeff Zhang wrote:
>>>>> Of course, you can. I run my pig script on the cluster and run hbase on the
>>>>> same cluster, it works fine.
>>>>>
>>>>> Jeff Zhang
>>>>>
>>>>>
>>>>> On Sat, Nov 28, 2009 at 9:45 PM, Ravi <ra...@gmail.com> wrote:
>>>>>
>>>>>> If I setup a hbase cluster, say with 10 nodes, can I also use the same
>>>>>> cluster for my distributed program using the hadoop running underneath
>>>>>> hbase?
>>>>>>
>>>>>> Essentially the thought is to use underlying hadoop for two purposes, data
>>>>>> as well as logic.
>>>>>>
>>>>>> Any thoughts?
>>>>>>
>>>>>>
>>>>
>>>>
>>
>>
>>
>
>
>
>
>
Re: Can I use hadoop inside hbase?
Posted by Andrew Purtell <ap...@apache.org>.
Ravi,
> So back to my original question, how can I use hadoop inside hbase?
Hadoop and HBase are separate software. I could try to explain this
to you in detail but perhaps the answer would just be confusing. It is
as simple as this: If you want to use Hadoop, then you must install
Hadoop.
Please see http://wiki.apache.org/hadoop/GettingStartedWithHadoop
- Andy
----- Original Message ----
> From: Ravi <ra...@gmail.com>
> To: hbase-user@hadoop.apache.org
> Sent: Thu, December 17, 2009 7:34:50 PM
> Subject: Re: Can I use hadoop inside hbase?
>
>
> I installed hbase as described here:
> http://hadoop.apache.org/hbase/docs/current/cygwin.html
>
> I am only using it for development purposes only, hence no concerns
> about performance etc. I can bet millions of people would love an easier
> windows install for development/experimentation purposes.
>
> So back to my original question, how can I use hadoop inside hbase?
>
>
>
> Andrew Purtell wrote:
> > I should also add that HBase running in standalone mode without Hadoop is only
> useful for limited testing and I don't recommend it.
> >
> > - Andy
> >
> > On Sun Nov 29th, 2009 5:39 PM PST Andrew Purtell wrote:
> >
> >> If you want to run Hadoop commands, then you must install Hadoop of course.
> Please see http://wiki.apache.org/hadoop/GettingStartedWithHadoop
> >>
> >> HBase does not have a Windows distribution per se, so I am a little confused
> about just what you have installed. I presume you downloaded the HBase release
> tarball.
> >>
> >> - Andy
> >>
> >>
> >> On Sun Nov 29th, 2009 3:57 PM PST Ravi wrote:
> >>
> >>>
> >>> I am using the windows distribution, it must have come with hadoop built in
> as I did not install hadoop separately. The distribution however does not have
> any hadoop commands or shell scripts.
> >>>
> >>> So looks like this is a hbase windows distribution issue?
> >>>
> >>>
> >>> Andrew Purtell wrote:
> >>>> To run HBase you must have installed Hadoop underneath. The Hadoop top
> level command line script 'bin/hadoop' is available in your Hadoop installation.
> Just put the Hadoop bin/ dir on the path along with the HBase bin/ dir.
> >>>> You can also run some Hadoop applications using the HBase command script,
> but that is missing the shortcuts, e.g. instead of
> >>>>
> >>>> hadoop fs -copyFromLocal ...
> >>>>
> >>>> it is
> >>>> hbase org.apache.hadoop.fs.FsShell -copyFromLocal ...
> >>>>
> >>>> This will work for DFS but for other filesystems which need supporting jars
> in lib/, your mileage will vary. Just put the Hadoop bin/ dir on the path along
> with the HBase bin/ dir and use the appropriate one for the circumstances.
> >>>> - Andy
> >>>>
> >>>>
> >>>>
> >>>> ________________________________
> >>>> From: Ravi
> >>>> To: hbase-user@hadoop.apache.org
> >>>> Sent: Sun, November 29, 2009 8:28:58 AM
> >>>> Subject: Re: Can I use hadoop inside hbase?
> >>>>
> >>>> Thanks for the quick clarification Jeff.
> >>>>
> >>>> In hbase distribution, I am unable to find hadoop command to load files
> into DFS. How do I add hadoop commands to hbase distribution?
> >>>>
> >>>>
> >>>> Jeff Zhang wrote:
> >>>>> Of course, you can. I run my pig script on the cluster and run hbase on
> the
> >>>>> same cluster, it works fine.
> >>>>>
> >>>>> Jeff Zhang
> >>>>>
> >>>>>
> >>>>> On Sat, Nov 28, 2009 at 9:45 PM, Ravi wrote:
> >>>>>
> >>>>>> If I setup a hbase cluster, say with 10 nodes, can I also use the same
> >>>>>> cluster for my distributed program using the hadoop running underneath
> >>>>>> hbase?
> >>>>>>
> >>>>>> Essentially the thought is to use underlying hadoop for two purposes,
> data
> >>>>>> as well as logic.
> >>>>>>
> >>>>>> Any thoughts?
> >>>>>>
> >>>>>>
> >>>>
> >>>>
> >>
> >>
> >>
> >
> >
> >
> >
> >