You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Alex <si...@gmail.com> on 2017/05/25 14:32:49 UTC

access error while trying to run distcp from source cluster

Hi team,

I am trying to copy data from A cluster to B cluster and same user for both

I am running distcp command on source cluster A

but i am getting error

17/05/25 07:24:08 INFO mapreduce.Job: Running job: job_1492549627402_344485
17/05/25 07:24:17 INFO mapreduce.Job: Job job_1492549627402_344485 running
in uber mode : false 17/05/25 07:24:17 INFO mapreduce.Job:  map 0% reduce
0% 17/05/25 07:24:26 INFO mapreduce.Job: Task Id :
attempt_1492549627402_344485_m_000000_0, Status : FAILED Error:
org.apache.hadoop.security.AccessControlException: User abcde (user id
50006054)  has been denied access to create distcptest2         at
com.mapr.fs.MapRFileSystem.makeDir(MapRFileSystem.java:1282)         at
com.mapr.fs.MapRFileSystem.mkdirs(MapRFileSystem.java:1302)         at
org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1913)         at
org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:272)
at
org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:51)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)         at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)         at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)         at
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)         at
java.security.AccessController.doPrivileged(Native Method)         at
javax.security.auth.Subject.doAs(Subject.java:415)         at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
this is the error

Re: access error while trying to run distcp from source cluster

Posted by Brahma Reddy Battula <br...@hotmail.com>.
Looks it's related to "MapRFileSystem"..? can you please post in MapR mailing list.?


________________________________
From: Alex <si...@gmail.com>
Sent: Thursday, May 25, 2017 10:32 PM
To: common-dev@hadoop.apache.org; common-issues-subscribe@hadoop.apache.org
Subject: access error while trying to run distcp from source cluster

Hi team,

I am trying to copy data from A cluster to B cluster and same user for both

I am running distcp command on source cluster A

but i am getting error

17/05/25 07:24:08 INFO mapreduce.Job: Running job: job_1492549627402_344485
17/05/25 07:24:17 INFO mapreduce.Job: Job job_1492549627402_344485 running
in uber mode : false 17/05/25 07:24:17 INFO mapreduce.Job:  map 0% reduce
0% 17/05/25 07:24:26 INFO mapreduce.Job: Task Id :
attempt_1492549627402_344485_m_000000_0, Status : FAILED Error:
org.apache.hadoop.security.AccessControlException: User abcde (user id
50006054)  has been denied access to create distcptest2         at
com.mapr.fs.MapRFileSystem.makeDir(MapRFileSystem.java:1282)         at
com.mapr.fs.MapRFileSystem.mkdirs(MapRFileSystem.java:1302)         at
org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1913)         at
org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:272)
at
org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:51)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)         at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)         at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)         at
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)         at
java.security.AccessController.doPrivileged(Native Method)         at
javax.security.auth.Subject.doAs(Subject.java:415)         at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
this is the error