You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Nishant Neeraj <ni...@gmail.com> on 2012/10/26 06:50:00 UTC

Hadoop 2.0.2 -- warnings

I am new to Hadoop. When I execute

bin/hadoop jar
share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.2-alpha.jar  pi -
Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory
-libjars
share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.2-alpha.jar 16
10000

1. I get many warnings, see footnote [1]. How to get rid of them?
2. I also get "WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable".
Why is so?

You can see config files in footnote [2]

= = = =
[1]
12/10/26 09:59:31 WARN conf.Configuration: mapred.job.classpath.files is
deprecated. Instead, use mapreduce.job.classpath.files
12/10/26 09:59:31 WARN conf.Configuration: mapred.jar is deprecated.
Instead, use mapreduce.job.jar
12/10/26 09:59:31 WARN conf.Configuration: mapred.cache.files is
deprecated. Instead, use mapreduce.job.cache.files
12/10/26 09:59:31 WARN conf.Configuration:
mapred.map.tasks.speculative.execution is deprecated. Instead, use
mapreduce.map.speculative
12/10/26 09:59:31 WARN conf.Configuration: mapred.reduce.tasks is
deprecated. Instead, use mapreduce.job.reduces
12/10/26 09:59:31 WARN conf.Configuration: mapred.output.value.class is
deprecated. Instead, use mapreduce.job.output.value.class
12/10/26 09:59:31 WARN conf.Configuration:
mapred.reduce.tasks.speculative.execution is deprecated. Instead, use
mapreduce.reduce.speculative
12/10/26 09:59:31 WARN conf.Configuration: mapred.used.genericoptionsparser
is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
12/10/26 09:59:31 WARN conf.Configuration: mapreduce.map.class is
deprecated. Instead, use mapreduce.job.map.class
12/10/26 09:59:31 WARN conf.Configuration: mapred.job.name is deprecated.
Instead, use mapreduce.job.name
12/10/26 09:59:31 WARN conf.Configuration: mapreduce.reduce.class is
deprecated. Instead, use mapreduce.job.reduce.class
12/10/26 09:59:31 WARN conf.Configuration: mapreduce.inputformat.class is
deprecated. Instead, use mapreduce.job.inputformat.class
12/10/26 09:59:31 WARN conf.Configuration: mapred.input.dir is deprecated.
Instead, use mapreduce.input.fileinputformat.inputdir
12/10/26 09:59:31 WARN conf.Configuration: mapred.output.dir is deprecated.
Instead, use mapreduce.output.fileoutputformat.outputdir
12/10/26 09:59:31 WARN conf.Configuration: mapreduce.outputformat.class is
deprecated. Instead, use mapreduce.job.outputformat.class
12/10/26 09:59:31 WARN conf.Configuration: mapred.map.tasks is deprecated.
Instead, use mapreduce.job.maps
12/10/26 09:59:31 WARN conf.Configuration: mapred.cache.files.timestamps is
deprecated. Instead, use mapreduce.job.cache.files.timestamps
12/10/26 09:59:31 WARN conf.Configuration: mapred.output.key.class is
deprecated. Instead, use mapreduce.job.output.key.class
12/10/26 09:59:31 WARN conf.Configuration: mapred.working.dir is
deprecated. Instead, use mapreduce.job.working.dir

--------------------

[2]
<!-- core-site.xml -->
<configuration>
 <property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:9000</value>
 </property>
</configuration>
----------------------
<!-- hdfs-site.xml -->
<configuration>
 <property>
  <name>dfs.replication</name>
  <value>1</value>
 </property>
</configuration>
-----------------------
<!-- mapred-site.xml -->
<configuration>
 <property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
 </property>
</configuration>
------------------------
<!-- yarn-site.xml -->
<configuration>
 <property>
  <name>yarn.nodemanager.aux-services</name>
  <value>mapreduce.shuffle</value>
 </property>
 <property>
  <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
  <value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
</configuration>