You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Ajit Kumar Shreevastava <Aj...@hcl.com> on 2012/10/01 12:59:27 UTC
hive query fails
Dear all,
I am running following query and I m not getting any output. But select * from pokes is working fine.
[hadoop@NHCLT-PC44-2 bin]$ hive
Logging initialized using configuration in file:/home/hadoop/Hive/conf/hive-log4j.properties
Hive history file=/home/hadoop/tmp/hadoop/hive_job_log_hadoop_201210011620_669979453.txt
hive> select count(1) from pokes;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapred.reduce.tasks=<number>
Starting Job = job_201210011527_0004, Tracking URL = http://NHCLT-PC44-2:50030/jobdetails.jsp?jobid=job_201210011527_0004
Kill Command = /home/hadoop/hadoop-1.0.3/bin/hadoop job -kill job_201210011527_0004
Thanks and Regards
Ajit Kumar Shreevastava
ADCOE (App Development Center Of Excellence )
Mobile: 9717775634
::DISCLAIMER::
----------------------------------------------------------------------------------------------------------------------------------------------------
The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e mail and its contents
(with or without referred errors) shall therefore not attach any liability on the originator or HCL or its affiliates.
Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the
views or opinions of HCL or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of this message without the prior written consent of authorized representative of
HCL is strictly prohibited. If you have received this email in error please delete it and notify the sender immediately.
Before opening any email and/or attachments, please check them for viruses and other defects.
----------------------------------------------------------------------------------------------------------------------------------------------------
Re: hive query fails
Posted by Nitin Pawar <ni...@gmail.com>.
select * from table does not start a mapreduce job
what you need to check why is your job not started on jobtracker (may
be enough resources not available or something wrong with setup)
On Mon, Oct 1, 2012 at 4:29 PM, Ajit Kumar Shreevastava
<Aj...@hcl.com> wrote:
> Dear all,
>
>
>
> I am running following query and I m not getting any output. But select *
> from pokes is working fine.
>
>
>
> [hadoop@NHCLT-PC44-2 bin]$ hive
>
> Logging initialized using configuration in
> file:/home/hadoop/Hive/conf/hive-log4j.properties
>
> Hive history
> file=/home/hadoop/tmp/hadoop/hive_job_log_hadoop_201210011620_669979453.txt
>
> hive> select count(1) from pokes;
>
> Total MapReduce jobs = 1
>
> Launching Job 1 out of 1
>
> Number of reduce tasks determined at compile time: 1
>
> In order to change the average load for a reducer (in bytes):
>
> set hive.exec.reducers.bytes.per.reducer=<number>
>
> In order to limit the maximum number of reducers:
>
> set hive.exec.reducers.max=<number>
>
> In order to set a constant number of reducers:
>
> set mapred.reduce.tasks=<number>
>
> Starting Job = job_201210011527_0004, Tracking URL =
> http://NHCLT-PC44-2:50030/jobdetails.jsp?jobid=job_201210011527_0004
>
> Kill Command = /home/hadoop/hadoop-1.0.3/bin/hadoop job -kill
> job_201210011527_0004
>
>
>
>
>
> Thanks and Regards
>
> Ajit Kumar Shreevastava
>
> ADCOE (App Development Center Of Excellence )
>
> Mobile: 9717775634
>
>
>
>
>
> ::DISCLAIMER::
> ----------------------------------------------------------------------------------------------------------------------------------------------------
>
> The contents of this e-mail and any attachment(s) are confidential and
> intended for the named recipient(s) only.
> E-mail transmission is not guaranteed to be secure or error-free as
> information could be intercepted, corrupted,
> lost, destroyed, arrive late or incomplete, or may contain viruses in
> transmission. The e mail and its contents
> (with or without referred errors) shall therefore not attach any liability
> on the originator or HCL or its affiliates.
> Views or opinions, if any, presented in this email are solely those of the
> author and may not necessarily reflect the
> views or opinions of HCL or its affiliates. Any form of reproduction,
> dissemination, copying, disclosure, modification,
> distribution and / or publication of this message without the prior written
> consent of authorized representative of
> HCL is strictly prohibited. If you have received this email in error please
> delete it and notify the sender immediately.
> Before opening any email and/or attachments, please check them for viruses
> and other defects.
>
> ----------------------------------------------------------------------------------------------------------------------------------------------------
--
Nitin Pawar
RE: hive query fails
Posted by Mayank Bansal <Ma...@mu-sigma.com>.
Could you give more details, it would be helpful if you could share the log files from the tasktracker for this job.
Your tracking url has details for the process, you could start from there and share the logs.
From: Ajit Kumar Shreevastava [mailto:Ajit.Shreevastava@hcl.com]
Sent: Monday, October 01, 2012 4:29 PM
To: user@hive.apache.org
Subject: hive query fails
Dear all,
I am running following query and I m not getting any output. But select * from pokes is working fine.
[hadoop@NHCLT-PC44-2 bin]$ hive
Logging initialized using configuration in file:/home/hadoop/Hive/conf/hive-log4j.properties
Hive history file=/home/hadoop/tmp/hadoop/hive_job_log_hadoop_201210011620_669979453.txt
hive> select count(1) from pokes;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapred.reduce.tasks=<number>
Starting Job = job_201210011527_0004, Tracking URL = http://NHCLT-PC44-2:50030/jobdetails.jsp?jobid=job_201210011527_0004
Kill Command = /home/hadoop/hadoop-1.0.3/bin/hadoop job -kill job_201210011527_0004
Thanks and Regards
Ajit Kumar Shreevastava
ADCOE (App Development Center Of Excellence )
Mobile: 9717775634
::DISCLAIMER::
----------------------------------------------------------------------------------------------------------------------------------------------------
The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e mail and its contents
(with or without referred errors) shall therefore not attach any liability on the originator or HCL or its affiliates.
Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the
views or opinions of HCL or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of this message without the prior written consent of authorized representative of
HCL is strictly prohibited. If you have received this email in error please delete it and notify the sender immediately.
Before opening any email and/or attachments, please check them for viruses and other defects.
----------------------------------------------------------------------------------------------------------------------------------------------------
________________________________
This email message may contain proprietary, private and confidential information. The information transmitted is intended only for the person(s) or entities to which it is addressed. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited and may be illegal. If you received this in error, please contact the sender and delete the message from your system.
Mu Sigma takes all reasonable steps to ensure that its electronic communications are free from viruses. However, given Internet accessibility, the Company cannot accept liability for any virus introduced by this e-mail or any attachment and you are advised to use up-to-date virus checking software.
RE: hive query fails
Posted by yogesh dhari <yo...@live.com>.
Hi Ajit,
Select * command doesn't invoke reducer, its just dump the data.
check out your network proxy settings.
Regards
Yogesh Kumar Dhari
From: Ajit.Shreevastava@hcl.com
To: user@hive.apache.org
Date: Mon, 1 Oct 2012 16:29:27 +0530
Subject: hive query fails
Dear all, I am running following query and I m not getting any output. But select * from pokes is working fine. [hadoop@NHCLT-PC44-2 bin]$ hiveLogging initialized using configuration in file:/home/hadoop/Hive/conf/hive-log4j.propertiesHive history file=/home/hadoop/tmp/hadoop/hive_job_log_hadoop_201210011620_669979453.txthive> select count(1) from pokes;Total MapReduce jobs = 1Launching Job 1 out of 1Number of reduce tasks determined at compile time: 1In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=<number>In order to limit the maximum number of reducers: set hive.exec.reducers.max=<number>In order to set a constant number of reducers: set mapred.reduce.tasks=<number>Starting Job = job_201210011527_0004, Tracking URL = http://NHCLT-PC44-2:50030/jobdetails.jsp?jobid=job_201210011527_0004Kill Command = /home/hadoop/hadoop-1.0.3/bin/hadoop job -kill job_201210011527_0004 Thanks and RegardsAjit Kumar ShreevastavaADCOE (App Development Center Of Excellence )Mobile: 9717775634
::DISCLAIMER::
----------------------------------------------------------------------------------------------------------------------------------------------------
The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e mail and its contents
(with or without referred errors) shall therefore not attach any liability on the originator or HCL or its affiliates.
Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the
views or opinions of HCL or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of this message without the prior written consent of authorized representative of
HCL is strictly prohibited. If you have received this email in error please delete it and notify the sender immediately.
Before opening any email and/or attachments, please check them for viruses and other defects.
----------------------------------------------------------------------------------------------------------------------------------------------------