You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by 张伟 <zh...@gmail.com> on 2014/06/16 16:29:14 UTC

Hive-0.13 java.io.FileNotFoundException: HIVE_PLAN not found

Hi,

    I run Hadoop-2.2.0 + Hive-0.13.0 on a cluster. WordCount example
succeeds running and it's ok to create table in hive cli. But when i run
hive query with mapreduce jobs, then i keep getting errors like:

Diagnostic Messages for this Task:Error: java.lang.RuntimeException:
java.io.FileNotFoundException:
HIVE_PLAN7b8ea437-8ec3-4c05-af4e-3cd6466dce85 (No such file or
directory)
    at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:230)
    at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255)
    at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381)
    at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374)
    at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:540)
    at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:167)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:408)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157)Caused
by: java.io.FileNotFoundException:
HIVE_PLAN7b8ea437-8ec3-4c05-af4e-3cd6466dce85 (No such file or
directory)
    at java.io.FileInputStream.open(Native Method)
    at java.io.FileInputStream.<init>(FileInputStream.java:146)
    at java.io.FileInputStream.<init>(FileInputStream.java:101)
    at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:221)
    ... 12 more


FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.mr.MapRedTaskMapReduce Jobs
Launched:Job 0: Map: 1   HDFS Read: 0 HDFS Write: 0 FAILTotal
MapReduce CPU Time Spent: 0 msec


According to the error messages above, i find that
hive.exec.scratchdir (/tmp/hive-${user.name}) where hive plan files
are stored is cleaned up, when query finished.
But when i use hive-0.12 version, the directory was not cleaned, and
all hive plan files are kept there. I think it's the main problem
causing the errors.

how can I fix it? Looking forward to your reply!