You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Ranjini Rathinam <ra...@gmail.com> on 2014/01/21 09:21:40 UTC
HIVE+MAPREDUCE
Hi,
Need to load the data into hive table using mapreduce, using java.
Please suggest the code related to hive +mapreduce.
Thanks in advance
Ranjini R
Re: HIVE+MAPREDUCE
Posted by unmesha sreeveni <un...@gmail.com>.
Programming in Hive Text Book contains what u want . Chapter 4
Hope that will help u.
On Tue, Jan 21, 2014 at 1:51 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: HIVE+MAPREDUCE
Posted by Jeff Zhang <je...@gopivotal.com>.
you just need to run mapreduce job to generate the data you want and then
upload the data into hive table ( create table first if it is not exists )
these 2 steps are totally separated.
On Tue, Jan 21, 2014 at 4:21 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>
Re: HIVE+MAPREDUCE
Posted by Ranjini Rathinam <ra...@gmail.com>.
Hi,
Like , for there is code for hbase in mapreduce ,(able to put data in
table,configuration for hbase ) we write code in Mapreduce,
Like wise i need for hive in mapreduce. In Hive CLI i am able to load but
need to do through mapreduce code.
Please provide any sample code .
Thanks in advance.
On Tue, Jan 21, 2014 at 5:59 PM, Nirmal Kumar <ni...@impetus.co.in>wrote:
> You can load data into existing tables from the Hive CLI using the
> commands:
>
> 1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE
> INTO TABLE orders;
> If the data is in the local file system
> 2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
> If the data is in the HDFS
>
> Thanks,
> -Nirmal
>
> -----Original Message-----
> From: Chris Mawata [mailto:chris.mawata@gmail.com]
> Sent: Tuesday, January 21, 2014 4:48 PM
> To: user@hadoop.apache.org
> Subject: Re: HIVE+MAPREDUCE
>
> If you put the sentence
> "Need to load the data into hive table using mapreduce, using java"
> into your google search box you will get tons of information.
>
> On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> > Need to load the data into hive table using mapreduce, using java
>
>
> ________________________________
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential,
> proprietary, privileged or otherwise protected by law. The message is
> intended solely for the named addressee. If received in error, please
> destroy and notify the sender. Any use of this email is prohibited when
> received in error. Impetus does not represent, warrant and/or guarantee,
> that the integrity of this communication has been maintained nor that the
> communication is free of errors, virus, interception or interference.
>
Re: HIVE+MAPREDUCE
Posted by Ranjini Rathinam <ra...@gmail.com>.
Hi,
Like , for there is code for hbase in mapreduce ,(able to put data in
table,configuration for hbase ) we write code in Mapreduce,
Like wise i need for hive in mapreduce. In Hive CLI i am able to load but
need to do through mapreduce code.
Please provide any sample code .
Thanks in advance.
On Tue, Jan 21, 2014 at 5:59 PM, Nirmal Kumar <ni...@impetus.co.in>wrote:
> You can load data into existing tables from the Hive CLI using the
> commands:
>
> 1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE
> INTO TABLE orders;
> If the data is in the local file system
> 2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
> If the data is in the HDFS
>
> Thanks,
> -Nirmal
>
> -----Original Message-----
> From: Chris Mawata [mailto:chris.mawata@gmail.com]
> Sent: Tuesday, January 21, 2014 4:48 PM
> To: user@hadoop.apache.org
> Subject: Re: HIVE+MAPREDUCE
>
> If you put the sentence
> "Need to load the data into hive table using mapreduce, using java"
> into your google search box you will get tons of information.
>
> On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> > Need to load the data into hive table using mapreduce, using java
>
>
> ________________________________
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential,
> proprietary, privileged or otherwise protected by law. The message is
> intended solely for the named addressee. If received in error, please
> destroy and notify the sender. Any use of this email is prohibited when
> received in error. Impetus does not represent, warrant and/or guarantee,
> that the integrity of this communication has been maintained nor that the
> communication is free of errors, virus, interception or interference.
>
Re: HIVE+MAPREDUCE
Posted by Ranjini Rathinam <ra...@gmail.com>.
Hi,
Like , for there is code for hbase in mapreduce ,(able to put data in
table,configuration for hbase ) we write code in Mapreduce,
Like wise i need for hive in mapreduce. In Hive CLI i am able to load but
need to do through mapreduce code.
Please provide any sample code .
Thanks in advance.
On Tue, Jan 21, 2014 at 5:59 PM, Nirmal Kumar <ni...@impetus.co.in>wrote:
> You can load data into existing tables from the Hive CLI using the
> commands:
>
> 1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE
> INTO TABLE orders;
> If the data is in the local file system
> 2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
> If the data is in the HDFS
>
> Thanks,
> -Nirmal
>
> -----Original Message-----
> From: Chris Mawata [mailto:chris.mawata@gmail.com]
> Sent: Tuesday, January 21, 2014 4:48 PM
> To: user@hadoop.apache.org
> Subject: Re: HIVE+MAPREDUCE
>
> If you put the sentence
> "Need to load the data into hive table using mapreduce, using java"
> into your google search box you will get tons of information.
>
> On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> > Need to load the data into hive table using mapreduce, using java
>
>
> ________________________________
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential,
> proprietary, privileged or otherwise protected by law. The message is
> intended solely for the named addressee. If received in error, please
> destroy and notify the sender. Any use of this email is prohibited when
> received in error. Impetus does not represent, warrant and/or guarantee,
> that the integrity of this communication has been maintained nor that the
> communication is free of errors, virus, interception or interference.
>
Re: HIVE+MAPREDUCE
Posted by Ranjini Rathinam <ra...@gmail.com>.
Hi,
Like , for there is code for hbase in mapreduce ,(able to put data in
table,configuration for hbase ) we write code in Mapreduce,
Like wise i need for hive in mapreduce. In Hive CLI i am able to load but
need to do through mapreduce code.
Please provide any sample code .
Thanks in advance.
On Tue, Jan 21, 2014 at 5:59 PM, Nirmal Kumar <ni...@impetus.co.in>wrote:
> You can load data into existing tables from the Hive CLI using the
> commands:
>
> 1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE
> INTO TABLE orders;
> If the data is in the local file system
> 2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
> If the data is in the HDFS
>
> Thanks,
> -Nirmal
>
> -----Original Message-----
> From: Chris Mawata [mailto:chris.mawata@gmail.com]
> Sent: Tuesday, January 21, 2014 4:48 PM
> To: user@hadoop.apache.org
> Subject: Re: HIVE+MAPREDUCE
>
> If you put the sentence
> "Need to load the data into hive table using mapreduce, using java"
> into your google search box you will get tons of information.
>
> On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> > Need to load the data into hive table using mapreduce, using java
>
>
> ________________________________
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential,
> proprietary, privileged or otherwise protected by law. The message is
> intended solely for the named addressee. If received in error, please
> destroy and notify the sender. Any use of this email is prohibited when
> received in error. Impetus does not represent, warrant and/or guarantee,
> that the integrity of this communication has been maintained nor that the
> communication is free of errors, virus, interception or interference.
>
RE: HIVE+MAPREDUCE
Posted by Nirmal Kumar <ni...@impetus.co.in>.
You can load data into existing tables from the Hive CLI using the commands:
1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE INTO TABLE orders;
If the data is in the local file system
2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
If the data is in the HDFS
Thanks,
-Nirmal
-----Original Message-----
From: Chris Mawata [mailto:chris.mawata@gmail.com]
Sent: Tuesday, January 21, 2014 4:48 PM
To: user@hadoop.apache.org
Subject: Re: HIVE+MAPREDUCE
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
________________________________
NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
RE: HIVE+MAPREDUCE
Posted by Nirmal Kumar <ni...@impetus.co.in>.
You can load data into existing tables from the Hive CLI using the commands:
1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE INTO TABLE orders;
If the data is in the local file system
2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
If the data is in the HDFS
Thanks,
-Nirmal
-----Original Message-----
From: Chris Mawata [mailto:chris.mawata@gmail.com]
Sent: Tuesday, January 21, 2014 4:48 PM
To: user@hadoop.apache.org
Subject: Re: HIVE+MAPREDUCE
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
________________________________
NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
RE: HIVE+MAPREDUCE
Posted by Nirmal Kumar <ni...@impetus.co.in>.
You can load data into existing tables from the Hive CLI using the commands:
1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE INTO TABLE orders;
If the data is in the local file system
2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
If the data is in the HDFS
Thanks,
-Nirmal
-----Original Message-----
From: Chris Mawata [mailto:chris.mawata@gmail.com]
Sent: Tuesday, January 21, 2014 4:48 PM
To: user@hadoop.apache.org
Subject: Re: HIVE+MAPREDUCE
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
________________________________
NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
RE: HIVE+MAPREDUCE
Posted by Nirmal Kumar <ni...@impetus.co.in>.
You can load data into existing tables from the Hive CLI using the commands:
1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE INTO TABLE orders;
If the data is in the local file system
2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
If the data is in the HDFS
Thanks,
-Nirmal
-----Original Message-----
From: Chris Mawata [mailto:chris.mawata@gmail.com]
Sent: Tuesday, January 21, 2014 4:48 PM
To: user@hadoop.apache.org
Subject: Re: HIVE+MAPREDUCE
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
________________________________
NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
Re: HIVE+MAPREDUCE
Posted by Chris Mawata <ch...@gmail.com>.
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
Re: HIVE+MAPREDUCE
Posted by unmesha sreeveni <un...@gmail.com>.
Programming in Hive Text Book contains what u want . Chapter 4
Hope that will help u.
On Tue, Jan 21, 2014 at 1:51 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: HIVE+MAPREDUCE
Posted by Thejas Nair <th...@hortonworks.com>.
You can use hcatalog to write into hive tables from mapreduce.
See https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput .
Another example is in https://gist.github.com/thejasmn/7607406
On Tue, Jan 21, 2014 at 12:21 AM, Ranjini Rathinam
<ra...@gmail.com> wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: HIVE+MAPREDUCE
Posted by Chris Mawata <ch...@gmail.com>.
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
Re: HIVE+MAPREDUCE
Posted by Chris Mawata <ch...@gmail.com>.
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
Re: HIVE+MAPREDUCE
Posted by unmesha sreeveni <un...@gmail.com>.
Programming in Hive Text Book contains what u want . Chapter 4
Hope that will help u.
On Tue, Jan 21, 2014 at 1:51 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: HIVE+MAPREDUCE
Posted by Jeff Zhang <je...@gopivotal.com>.
you just need to run mapreduce job to generate the data you want and then
upload the data into hive table ( create table first if it is not exists )
these 2 steps are totally separated.
On Tue, Jan 21, 2014 at 4:21 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>
Re: HIVE+MAPREDUCE
Posted by unmesha sreeveni <un...@gmail.com>.
Programming in Hive Text Book contains what u want . Chapter 4
Hope that will help u.
On Tue, Jan 21, 2014 at 1:51 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
Junior Developer
http://www.unmeshasreeveni.blogspot.in/
Re: HIVE+MAPREDUCE
Posted by Chris Mawata <ch...@gmail.com>.
If you put the sentence
"Need to load the data into hive table using mapreduce, using java"
into your google search box you will get tons of information.
On 1/21/2014 3:21 AM, Ranjini Rathinam wrote:
> Need to load the data into hive table using mapreduce, using java
Re: HIVE+MAPREDUCE
Posted by Jeff Zhang <je...@gopivotal.com>.
you just need to run mapreduce job to generate the data you want and then
upload the data into hive table ( create table first if it is not exists )
these 2 steps are totally separated.
On Tue, Jan 21, 2014 at 4:21 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>
Re: HIVE+MAPREDUCE
Posted by Jeff Zhang <je...@gopivotal.com>.
you just need to run mapreduce job to generate the data you want and then
upload the data into hive table ( create table first if it is not exists )
these 2 steps are totally separated.
On Tue, Jan 21, 2014 at 4:21 PM, Ranjini Rathinam <ra...@gmail.com>wrote:
> Hi,
>
> Need to load the data into hive table using mapreduce, using java.
>
> Please suggest the code related to hive +mapreduce.
>
>
>
> Thanks in advance
>
> Ranjini R
>
>
>