hbase mapreduce running though command line

[Vamshi Krishna <va...@gmail.com>]

Hi,
i want to run mapreduce program to insert data to tables in hbase. my
cluster has  3 machines. If i want to run that program through command
line, where can i do so..? should i do
${Hadoop_Home}/bin/hadoop jar MyJavaProg.jar java_mainclass_file source
destn
here MyJavaProg.jar is the jar of my java project , in which i wrote java
main class named java_mainclass_file , where i wrote map reduce class
consisting of map method only(i dont require reduce). i passed arguments to
that main method, as arguments through Fileformat.addinput(..),
Fileformat.setoutput(..) methods.  source and destn are locations inside
DFS.
when i tried to create jar of my whole java project from eclipse, i got
alert that, 'conf directory of HBase was not exported to jar', So how to
run my program through command line to insert data into hbase table..?? can
anybody help??

-- 
*Regards*
*
Vamshi Krishna
*

Re: hbase mapreduce running though command line

[Vamshi Krishna <va...@gmail.com>]

i tried to run the program from eclipse, but during that , i could not see
any job running on the jobtracker/tasktracker web UI pages. i observed that
on the eclipse localJobRunner is executing , so that job is not submitted
to the whole cluster, but its executing on that name node machine alone.
So i thought of generating jar of my whole project from eclipse, in which
conf folder of the hbase was added as external class folder to its build
path. When i am trying to jar my project folder with the help of
eclipse(File->export->java->jar FILE->....), one alert is coming like 'the
jar has been generated except conf folder in the build path'. So, without
conf folder in the jar, i tried to execute from command line , as i
mentioned in the last mail.

how can i run my mapreduce program on the hadoop cluster from the
eclipse..? Any configuration settings should i make ..? please help..

On Fri, Dec 9, 2011 at 11:13 PM, Jean-Daniel Cryans <jd...@apache.org>wrote:

> You don't need the conf dir in the jar, in fact you really don't want
> it there. I don't know where that alert is coming from, would be nice
> if you gave more details.
>
> J-D
>
> On Fri, Dec 9, 2011 at 6:45 AM, Vamshi Krishna <va...@gmail.com>
> wrote:
> > Hi,
> > i want to run mapreduce program to insert data to tables in hbase. my
> > cluster has  3 machines. If i want to run that program through command
> > line, where can i do so..? should i do
> > ${Hadoop_Home}/bin/hadoop jar MyJavaProg.jar java_mainclass_file source
> > destn
> > here MyJavaProg.jar is the jar of my java project , in which i wrote java
> > main class named java_mainclass_file , where i wrote map reduce class
> > consisting of map method only(i dont require reduce). i passed arguments
> to
> > that main method, as arguments through Fileformat.addinput(..),
> > Fileformat.setoutput(..) methods.  source and destn are locations inside
> > DFS.
> > when i tried to create jar of my whole java project from eclipse, i got
> > alert that, 'conf directory of HBase was not exported to jar', So how to
> > run my program through command line to insert data into hbase table..??
> can
> > anybody help??
> >
> > --
> > *Regards*
> > *
> > Vamshi Krishna
> > *
>



-- 
*Regards*
*
Vamshi Krishna
*

Re: hbase mapreduce running though command line

[Jean-Daniel Cryans <jd...@apache.org>]

You don't need the conf dir in the jar, in fact you really don't want
it there. I don't know where that alert is coming from, would be nice
if you gave more details.

J-D

On Fri, Dec 9, 2011 at 6:45 AM, Vamshi Krishna <va...@gmail.com> wrote:
> Hi,
> i want to run mapreduce program to insert data to tables in hbase. my
> cluster has  3 machines. If i want to run that program through command
> line, where can i do so..? should i do
> ${Hadoop_Home}/bin/hadoop jar MyJavaProg.jar java_mainclass_file source
> destn
> here MyJavaProg.jar is the jar of my java project , in which i wrote java
> main class named java_mainclass_file , where i wrote map reduce class
> consisting of map method only(i dont require reduce). i passed arguments to
> that main method, as arguments through Fileformat.addinput(..),
> Fileformat.setoutput(..) methods.  source and destn are locations inside
> DFS.
> when i tried to create jar of my whole java project from eclipse, i got
> alert that, 'conf directory of HBase was not exported to jar', So how to
> run my program through command line to insert data into hbase table..?? can
> anybody help??
>
> --
> *Regards*
> *
> Vamshi Krishna
> *