You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Carlotta Hicks <Ca...@sas.com> on 2014/07/22 00:19:29 UTC

Exception when attempting to run a mapReduce job

Hi!  I am getting the following error when attempting to run a mapReduce job.  Any suggestions on how to fix this?

14/07/21 18:00:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/07/21 18:00:11 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x6b12da40 connecting to ZooKeeper ensemble=localhost:2181
14/07/21 18:00:11 WARN security.UserGroupInformation: PriviledgedActionException as:myuser (auth:SIMPLE) cause:java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
Exception in thread "main" java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
                at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
                at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
                at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
                at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1265)
                at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1261)
                at java.security.AccessController.doPrivileged(Native Method)
                at javax.security.auth.Subject.doAs(Subject.java:396)
                at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
                at org.apache.hadoop.mapreduce.Job.connect(Job.java:1260)
                at org.apache.hadoop.mapreduce.Job.submit(Job.java:1289)
                at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1313)
                at tData.cImport.main(cImport.java:86)

Properties from mapred-site.xml:

  <property>
    <name>mapred.jobtracker.address</name>
      <value>localhost:8021</value>
  </property>
  <property>
    <name>mapreduce.framework.name</name>
       <value>yarn</value>
  </property>

Carlotta Hicks

RE: Exception when attempting to run a mapReduce job

Posted by Rohith Sharma K S <ro...@huawei.com>.
Hi Carlotta Hicks

   Can you cross verify that mapred-site.xml is in JobClient classpath. From you exception trace, It looks mapred-default.xml is loaded. May be you can print values or Debug using java opts

How job is submitted? Using Java Client or "yarn jar"


Thanks & Regards
Rohith Sharma K S

This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!

From: Carlotta Hicks [mailto:Carlotta.Hicks@sas.com]
Sent: 22 July 2014 03:49
To: user@hive.apache.org
Subject: Exception when attempting to run a mapReduce job

Hi!  I am getting the following error when attempting to run a mapReduce job.  Any suggestions on how to fix this?

14/07/21 18:00:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/07/21 18:00:11 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x6b12da40 connecting to ZooKeeper ensemble=localhost:2181
14/07/21 18:00:11 WARN security.UserGroupInformation: PriviledgedActionException as:myuser (auth:SIMPLE) cause:java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
Exception in thread "main" java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
                at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
                at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
                at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
                at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1265)
                at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1261)
                at java.security.AccessController.doPrivileged(Native Method)
                at javax.security.auth.Subject.doAs(Subject.java:396)
                at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
                at org.apache.hadoop.mapreduce.Job.connect(Job.java:1260)
                at org.apache.hadoop.mapreduce.Job.submit(Job.java:1289)
                at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1313)
                at tData.cImport.main(cImport.java:86)

Properties from mapred-site.xml:

  <property>
    <name>mapred.jobtracker.address</name>
      <value>localhost:8021</value>
  </property>
  <property>
    <name>mapreduce.framework.name</name>
       <value>yarn</value>
  </property>


Carlotta Hicks