You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Aditya Singh30 <Ad...@infosys.com> on 2011/11/08 12:47:08 UTC
Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
Hi,
I have setup a two node hadoop cluster, and tested it by running examples provided with Hadoop. Examples are working fine. then I tried to run hive on the cluster. I was able to create tables and load data into tables. And also the query : "select * from tablename" is working fine. But when I try to run a query with where option :
hive> select * from tablename where column_name='Value';
I get the following error
Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
The jobdetails.jsp shows the following:
java.lang.RuntimeException: java.util.NoSuchElementException
at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.
java:168)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:235)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.initColumnsNeeded(HiveInputForm
at.java:311)..............
............
I am using hive's derby only and not MySQL or any other DB for metastore. And most of the settings are having their default values in Hadoop, except for the minimum changes needed to run the cluster. There is no hive-site.xml as I haven't changed any of the hive's properties.
Please tell me what is wrong and what do I need to do.
Regards,
Aditya Singh
Infosys, India.
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***
Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Posted by Mark Grover <mg...@oanda.com>.
Hi Aditya,
Could you provide the statement that you used to create the table? Also, some insight into what your data looks like would be helpful as well.
What version of Hive and Hadoop are you using, on what environment?
Have you tried running one of the examples (like wordcount) that come with Hadoop (without any usage of Hive) to see if they succeed?
"select * from table" doesn't spawn a map-reduce job but using a where clause does. It will be good to see if Hadoop is set up properly.
Here is another thread that might have discussed a similar issue. Check it out:
http://mail-archives.apache.org/mod_mbox/hive-user/201103.mbox/%3C000901cbe937$80ec3d30$82c4b790$@net%3E
Mark
----- Original Message -----
From: "Aditya Singh30" <Ad...@infosys.com>
To: user@hive.apache.org
Cc: "Vikas Srivastava" <vi...@one97.net>
Sent: Wednesday, 9 November, 2011 12:11:29 AM
Subject: RE: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Hi,
I checked the column names and the values. They are same as they are in the table.
Do we need to install hive or add some hive libraries in hadoop’s classpath on the datanode-machines also. If yes then please guide me.
Thanks & Regards,
Aditya
From: Aditya Singh30
Sent: Wednesday, November 09, 2011 10:25 AM
To: 'user@hive.apache.org'
Cc: 'Vikas Srivastava'
Subject: RE: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Hi,
I am curious that if the ‘value’, for which we are looking for in a column, doesn’t exist, doesn’t hive tells ‘no data found matching the criteria’ or something like that, rather than returning an error.
From: Vikas Srivastava [mailto:vikas.srivastava@one97.net]
Sent: Tuesday, November 08, 2011 6:29 PM
To: user@hive.apache.org
Subject: Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
hey Aditya!!
col values is case sensitive so u have to put exact value .
select * from table where col_name= 'EXACT_VALUE'
regards
Vikas Srivastava
On Tue, Nov 8, 2011 at 5:17 PM, Aditya Singh30 < Aditya_Singh30@infosys.com > wrote:
Hi,
I have setup a two node hadoop cluster, and tested it by running examples provided with Hadoop. Examples are working fine. then I tried to run hive on the cluster. I was able to create tables and load data into tables. And also the query : “select * from tablename” is working fine. But when I try to run a query with where option :
hive> select * from tablename where column_name=’Value’;
I get the following error
Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
The jobdetails.jsp shows the following:
java.lang.RuntimeException: java.util.NoSuchElementException
at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.
java:168)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:235)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.initColumnsNeeded(HiveInputForm
at.java:311)…………..
…………
I am using hive’s derby only and not MySQL or any other DB for metastore. And most of the settings are having their default values in Hadoop, except for the minimum changes needed to run the cluster. There is no hive-site.xml as I haven’t changed any of the hive’s properties.
Please tell me what is wrong and what do I need to do.
Regards,
Aditya Singh
Infosys, India.
**************** CAUTION - Disclaimer ***************** This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely for the use of the addressee(s). If you are not the intended recipient, please notify the sender by e-mail and delete the original message. Further, you are not to copy, disclose, or distribute this e-mail or its contents to any other person and any such actions are unlawful. This e-mail may contain viruses. Infosys has taken every reasonable precaution to minimize this risk, but is not liable for any damage you may sustain as a result of any virus in this e-mail. You should carry out your own virus checks before opening the e-mail or attachment. Infosys reserves the right to monitor and review the content of all messages sent to or from this e-mail address. Messages sent to or from this e-mail address may be stored on the Infosys e-mail system. ***INFOSYS******** End of Disclaimer ********INFOSYS***
--
With Regards
Vikas Srivastava
DWH & Analytics Team
Mob:+91 9560885900
One97 | Let's get talking !
RE: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
Posted by Aditya Singh30 <Ad...@infosys.com>.
Hi,
I checked the column names and the values. They are same as they are in the table.
Do we need to install hive or add some hive libraries in hadoop's classpath on the datanode-machines also. If yes then please guide me.
Thanks & Regards,
Aditya
From: Aditya Singh30
Sent: Wednesday, November 09, 2011 10:25 AM
To: 'user@hive.apache.org'
Cc: 'Vikas Srivastava'
Subject: RE: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Hi,
I am curious that if the 'value', for which we are looking for in a column, doesn't exist, doesn't hive tells 'no data found matching the criteria' or something like that, rather than returning an error.
From: Vikas Srivastava [mailto:vikas.srivastava@one97.net]
Sent: Tuesday, November 08, 2011 6:29 PM
To: user@hive.apache.org
Subject: Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
hey Aditya!!
col values is case sensitive so u have to put exact value .
select * from table where col_name='EXACT_VALUE'
regards
Vikas Srivastava
On Tue, Nov 8, 2011 at 5:17 PM, Aditya Singh30 <Ad...@infosys.com>> wrote:
Hi,
I have setup a two node hadoop cluster, and tested it by running examples provided with Hadoop. Examples are working fine. then I tried to run hive on the cluster. I was able to create tables and load data into tables. And also the query : "select * from tablename" is working fine. But when I try to run a query with where option :
hive> select * from tablename where column_name='Value';
I get the following error
Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
The jobdetails.jsp shows the following:
java.lang.RuntimeException: java.util.NoSuchElementException
at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.
java:168)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:235)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.initColumnsNeeded(HiveInputForm
at.java:311)..............
............
I am using hive's derby only and not MySQL or any other DB for metastore. And most of the settings are having their default values in Hadoop, except for the minimum changes needed to run the cluster. There is no hive-site.xml as I haven't changed any of the hive's properties.
Please tell me what is wrong and what do I need to do.
Regards,
Aditya Singh
Infosys, India.
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***
--
With Regards
Vikas Srivastava
DWH & Analytics Team
Mob:+91 9560885900
One97 | Let's get talking !
RE: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
Posted by Aditya Singh30 <Ad...@infosys.com>.
Hi,
I am curious that if the 'value', for which we are looking for in a column, doesn't exist, doesn't hive tells 'no data found matching the criteria' or something like that, rather than returning an error.
From: Vikas Srivastava [mailto:vikas.srivastava@one97.net]
Sent: Tuesday, November 08, 2011 6:29 PM
To: user@hive.apache.org
Subject: Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
hey Aditya!!
col values is case sensitive so u have to put exact value .
select * from table where col_name='EXACT_VALUE'
regards
Vikas Srivastava
On Tue, Nov 8, 2011 at 5:17 PM, Aditya Singh30 <Ad...@infosys.com>> wrote:
Hi,
I have setup a two node hadoop cluster, and tested it by running examples provided with Hadoop. Examples are working fine. then I tried to run hive on the cluster. I was able to create tables and load data into tables. And also the query : "select * from tablename" is working fine. But when I try to run a query with where option :
hive> select * from tablename where column_name='Value';
I get the following error
Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
The jobdetails.jsp shows the following:
java.lang.RuntimeException: java.util.NoSuchElementException
at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.
java:168)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:235)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.initColumnsNeeded(HiveInputForm
at.java:311)..............
............
I am using hive's derby only and not MySQL or any other DB for metastore. And most of the settings are having their default values in Hadoop, except for the minimum changes needed to run the cluster. There is no hive-site.xml as I haven't changed any of the hive's properties.
Please tell me what is wrong and what do I need to do.
Regards,
Aditya Singh
Infosys, India.
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***
--
With Regards
Vikas Srivastava
DWH & Analytics Team
Mob:+91 9560885900
One97 | Let's get talking !
Re: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.ExecDriver
Posted by Vikas Srivastava <vi...@one97.net>.
hey Aditya!!
col values is case sensitive so u have to put exact value .
select * from table where col_name=*'EXACT_VALUE'*
regards
Vikas Srivastava
On Tue, Nov 8, 2011 at 5:17 PM, Aditya Singh30
<Ad...@infosys.com>wrote:
> Hi,****
>
> I have setup a two node hadoop cluster, and tested it by
> running examples provided with Hadoop. Examples are working fine. then I
> tried to run hive on the cluster. I was able to create tables and load data
> into tables. And also the query : “select * from tablename” is working
> fine. But when I try to run a query with where option :****
>
> hive> select * from tablename where column_name=’Value’;**
> **
>
> I get the following error ****
>
> ** **
>
> Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.ExecDriver****
>
> ** **
>
> The jobdetails.jsp shows the following:****
>
> ** **
>
> java.lang.RuntimeException: java.util.NoSuchElementException
>
> at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.
> java:168)
>
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:235)
>
> at
>
> org.apache.hadoop.hive.ql.io.HiveInputFormat.initColumnsNeeded(HiveInputForm
> at.java:311)…………..****
>
> …………****
>
> ** **
>
> I am using hive’s derby only and not MySQL or any other DB for metastore.
> And most of the settings are having their default values in Hadoop, except
> for the minimum changes needed to run the cluster. There is no
> hive-site.xml as I haven’t changed any of the hive’s properties.****
>
> Please tell me what is wrong and what do I need to do.****
>
> ** **
>
> Regards,****
>
> Aditya Singh ****
>
> Infosys, India.****
>
> ** **
>
> **************** CAUTION - Disclaimer *****************
> This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
> for the use of the addressee(s). If you are not the intended recipient, please
> notify the sender by e-mail and delete the original message. Further, you are not
> to copy, disclose, or distribute this e-mail or its contents to any other person and
> any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
> every reasonable precaution to minimize this risk, but is not liable for any damage
> you may sustain as a result of any virus in this e-mail. You should carry out your
> own virus checks before opening the e-mail or attachment. Infosys reserves the
> right to monitor and review the content of all messages sent to or from this e-mail
> address. Messages sent to or from this e-mail address may be stored on the
> Infosys e-mail system.
> ***INFOSYS******** End of Disclaimer ********INFOSYS***
>
>
--
With Regards
Vikas Srivastava
DWH & Analytics Team
Mob:+91 9560885900
One97 | Let's get talking !