You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Aki Tanaka (Jira)" <ji...@apache.org> on 2020/05/14 17:42:00 UTC

[jira] [Created] (HADOOP-17042) Hadoop distcp throws "ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found"

Aki Tanaka created HADOOP-17042:
-----------------------------------

             Summary: Hadoop distcp throws "ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found"
                 Key: HADOOP-17042
                 URL: https://issues.apache.org/jira/browse/HADOOP-17042
             Project: Hadoop Common
          Issue Type: Improvement
    Affects Versions: 3.1.3, 3.2.1
            Reporter: Aki Tanaka
         Attachments: HADOOP-17042.patch

On Hadoop 3.x, we see following "ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found." message on the first line of the command output when running Hadoop DistCp.
{code:java}
$ hadoop distcp /path/to/src /user/hadoop/
ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found.
2020-05-14 17:11:53,173 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false, ignoreFailures=false, overwrite=false, append=false, useDiff=false, useRdiff=false, fromSnapshot=null, toSnapshot=null, skipCRC=false, blocking=true
..
{code}
This message was added by HADOOP-12857 and it would be an expected behavior.
 DistCp calls 'hadoop_add_to_classpath_tools hadoop-distcp' when [it starts|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-distcp/src/main/shellprofile.d/hadoop-distcp.sh], and the error is returned because the hadoop-distcp.sh does not exist in the tools directory.

However, that error message confuses us. Since this is not an user end configuration issue, I would think it's better to change the log level to debug (hadoop_debug).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org