You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Tianying Chang <ty...@gmail.com> on 2014/05/07 17:16:41 UTC

distcp2 with bandwidth throttle failed with NoSuchMethodError

Hi,

I am using Hadoop 2.0.0-cdh4.2.0, and I copied
hadoop-distcp-2.0.3-alpha.jar under /usr/lib/hadoop folder. I can see it
support bandwidth parameter for throttle. However, I got below error.  I
found people have similar problem, but seems no answer.
http://grokbase.com/p/cloudera/cdh-user/13b95mcz31/bandwidth-throttling-in-distcp

Any idea what is missing?

Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(Lorg/apache/hadoop/mapreduce/Cluster;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/Path;

at org.apache.hadoop.tools.DistCp.createMetaFolderPath(DistCp.java:352)

at org.apache.hadoop.tools.DistCp.execute(DistCp.java:146)

at org.apache.hadoop.tools.DistCp.run(DistCp.java:118)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

at org.apache.hadoop.tools.DistCp.main(DistCp.java:374)

Thanks

Tian-Ying