You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Hongyuan Li (JIRA)" <ji...@apache.org> on 2017/06/25 16:06:00 UTC
[jira] [Comment Edited] (HADOOP-14567) DistCP NullPointerException
when -atomic is set but -tmp is not
[ https://issues.apache.org/jira/browse/HADOOP-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062365#comment-16062365 ]
Hongyuan Li edited comment on HADOOP-14567 at 6/25/17 4:05 PM:
---------------------------------------------------------------
[~harisekhon] Can you please list the commands that you used to run distcp. I deeped into the code to find that maybe the targetPath is "/", so its parent is null,thus causing this problem.
*Update*
tmp does not set make AtomicWorkPath = null.
was (Author: hongyuan li):
[~harisekhon] Can you please list the commands that you used to run distcp. I deeped into the code to find that maybe the targetPath is "/", so its parent is null,thus causing this problem.
> DistCP NullPointerException when -atomic is set but -tmp is not
> ---------------------------------------------------------------
>
> Key: HADOOP-14567
> URL: https://issues.apache.org/jira/browse/HADOOP-14567
> Project: Hadoop Common
> Issue Type: Bug
> Components: tools/distcp
> Affects Versions: 2.7.3
> Environment: HDP 2.5.0 kerberized cluster -> HDP 2.6.0 kerberized cluster
> Reporter: Hari Sekhon
> Priority: Minor
>
> When running distcp if using -atomic but not specifying -tmp then the following NullPointerException is encountered - removing -atomic avoids this bug:
> {code}
> 17/06/21 16:50:59 ERROR tools.DistCp: Exception encountered
> java.lang.NullPointerException
> at org.apache.hadoop.fs.Path.<init>(Path.java:104)
> at org.apache.hadoop.fs.Path.<init>(Path.java:93)
> at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:363)
> at org.apache.hadoop.tools.DistCp.createJob(DistCp.java:247)
> at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:176)
> at org.apache.hadoop.tools.DistCp.execute(DistCp.java:155)
> at org.apache.hadoop.tools.DistCp.run(DistCp.java:128)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at org.apache.hadoop.tools.DistCp.main(DistCp.java:462)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org