You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Vijay Kumar Adhikari <vi...@gmail.com> on 2009/07/28 16:41:39 UTC
Hive can't see a DFS file
Apparently, hive can't access the temporary file or something. My SQLs
fail with an IPException,
+++++++++
hive> select 1 from netflow;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Job Submission failed with exception 'java.io.IOException(cannot find
dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.ExecDriver
+++++++++
but I can see that the files are there,
+++++++++
$HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
Found 1 items
-rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1
+++++++++
Please help.
--
Vijay
Re: Hive can't see a DFS file
Posted by Vijay Kumar Adhikari <vi...@gmail.com>.
Attached.
On Tue, Jul 28, 2009 at 2:17 PM, Ashish Thusoo<at...@facebook.com> wrote:
> Can you put out the contents of
>
> /tmp/<username>/hive.log
>
> From the machine where you launched the hive cli from.
>
> Ashish
>
> -----Original Message-----
> From: Vijay Kumar Adhikari [mailto:vijaykcm@gmail.com]
> Sent: Tuesday, July 28, 2009 7:42 AM
> To: hive-user@hadoop.apache.org
> Subject: Hive can't see a DFS file
>
> Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,
>
> +++++++++
> hive> select 1 from netflow;
> Total MapReduce jobs = 1
> Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver
> +++++++++
>
> but I can see that the files are there,
>
> +++++++++
> $HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
> Found 1 items
> -rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1
> +++++++++
>
> Please help.
> --
> Vijay
>
--
Vijay
RE: Hive can't see a DFS file
Posted by Ashish Thusoo <at...@facebook.com>.
Can you put out the contents of
/tmp/<username>/hive.log
>From the machine where you launched the hive cli from.
Ashish
-----Original Message-----
From: Vijay Kumar Adhikari [mailto:vijaykcm@gmail.com]
Sent: Tuesday, July 28, 2009 7:42 AM
To: hive-user@hadoop.apache.org
Subject: Hive can't see a DFS file
Apparently, hive can't access the temporary file or something. My SQLs fail with an IPException,
+++++++++
hive> select 1 from netflow;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator Job Submission failed with exception 'java.io.IOException(cannot find dir = hdfs://master:54310/tmp/hive-viadhi/1 in partToPartitionInfo!)'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ExecDriver
+++++++++
but I can see that the files are there,
+++++++++
$HADOOP_HOME/bin/hadoop dfs -ls hdfs://master:54310/tmp/hive-viadhi/1
Found 1 items
-rw-r--r-- 2 viadhi supergroup 87 2009-07-28 09:37 /tmp/hive-viadhi/1
+++++++++
Please help.
--
Vijay