You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by rohithsharma <ro...@huawei.com> on 2013/04/08 12:39:38 UTC

Where should Hive Process Installed??

Hi

 

I am using Hive-0.9.0 + Hadoop-2.0.1 with 2 machine. One machine contains say

Machine-1 : NameNode, SecondaraNameNode , ResourceManager and Hive

Machine-2 :  Proxy server, JHS , DataNode and NodeManager.

 

Problem : 

When I execute Job queries i.e “select count(key) from src” for the table src, Job is getting killed. 

The exception in application log was

 

 

MODIFY_APP VIEW_APP APPLICATION_OWNERrohith(&container_1365412074766_0031_01_000003�stderr1503WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. 
java.io.FileNotFoundException: /tmp/rohith/hive_2013-04-08_15-36-36_587_2956773547832982704/-mr-10001/41253f2c-9b15-49e0-a419-32ea4559e4e6 (No such file or directory) 
        at java.io.FileInputStream.open(Native Method) 
        at java.io.FileInputStream.<init>(FileInputStream.java:120) 
        at java.io.FileInputStream.<init>(FileInputStream.java:79) 
        at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:215) 
        at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255) 
        at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381) 
        at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374) 
        at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:536) 
        at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:161) 
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:382) 
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:335) 
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:154) 
        at java.security.AccessController.doPrivileged(Native Method) 
        at javax.security.auth.Subject.doAs(Subject.java:396) 
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232) 
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:149) 
stdout0syslog58942013-04-08 15:45:52,293 WARN [main] org.apache.hadoop.conf.Configuration: job 



 

 

Please  let us know, where HiveServer should run exactly??

 

Thanks & Regards

Rohith Sharma K S

Re: Where should Hive Process Installed??

Posted by yuchen xie <xi...@gmail.com>.
I have just met this.

You can try to add this configuration in hive-site.xml
<property>
   <name>mapreduce.jobtracker.address</name>
   <value>ignorethis</value>
</property>

Or you can patch
https://issues.apache.org/jira/browse/HIVE-3029
to your hive



2013/4/8 rohithsharma <ro...@huawei.com>

> Hi****
>
> ** **
>
> I am using Hive-0.9.0 + Hadoop-2.0.1 with 2 machine. One machine contains
> say****
>
> Machine-1 : NameNode, SecondaraNameNode , ResourceManager and Hive****
>
> Machine-2 :  Proxy server, JHS , DataNode and NodeManager.****
>
> ** **
>
> Problem : ****
>
> When I execute Job queries i.e “select count(key) from src” for the table
> src, Job is getting killed. ****
>
> The exception in application log was****
>
> ** **
>
> ** **
>
> MODIFY_APP VIEW_APP
> APPLICATION_OWNERrohith(&container_1365412074766_0031_01_000003�stderr1503WARNING:
> org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use
> org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
> files.
> java.io.FileNotFoundException:
> /tmp/rohith/hive_2013-04-08_15-36-36_587_2956773547832982704/-mr-10001/41253f2c-9b15-49e0-a419-32ea4559e4e6
> (No such file or directory)
>         at java.io.FileInputStream.open(Native Method)
>         at java.io.FileInputStream.<init>(FileInputStream.java:120)
>         at java.io.FileInputStream.<init>(FileInputStream.java:79)
>         at
> org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:215)
>         at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255)
>         at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381)
>         at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374)
>         at
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:536)
>         at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:161)
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:382)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:335)
>         at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:154)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>         at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:149)
> stdout0syslog58942013-04-08 15:45:52,293 WARN [main]
> org.apache.hadoop.conf.Configuration: job
>
> ****
>
> ** **
>
> ** **
>
> Please  let us know, where HiveServer should run exactly??****
>
> ** **
>
> Thanks & Regards****
>
> Rohith Sharma K S****
>