You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Julian Bui <ju...@gmail.com> on 2013/04/15 12:43:35 UTC
jobtracker not starting - access control exception - folder not owned
by me (it claims)
Hello hadoop users,
I can't start my jobtracker and am getting an
org.apache.hadoop.security.AccessControlException saying that
my hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
is not owned by jbu (me, my user). However, I check the folder and it is
indeed owned by me. Details follow.
$ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
$ ls -al
drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
org.apache.hadoop.security.AccessControlException: The systemdir
hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
is not owned by jbu
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
org.apache.hadoop.security.AccessControlException: The systemdir
hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
is not owned by jbu
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
So it's still having problems thinking that directory is not owned by me.
The log also said:
2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed to
operate on mapred.system.dir
(hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
because of permissions.
2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
delete the mapred.system.dir
(hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
and then start the JobTracker.
So I deleted the system directory and restarted and the same problem
appeared, that I didn't have ownership of the directory. Still won't start.
I am using hadoop 1.0.4 on linux mint.
Any ideas?
Thanks,
-Julian
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Azuryy Yu <az...@gmail.com>.
I supposed you start-mapred by user mapred.
then hadoop fs -chown -R mpared:mapred /home/jbu/hadoop_local_install/
hadoop-1.0.4/tmp/mapred/system
this is caused by fairscheduler, please reach
MAPREDUCE-4398<https://issues.apache.org/jira/browse/MAPREDUCE-4398>
On Mon, Apr 15, 2013 at 6:43 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that
> my hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Azuryy Yu <az...@gmail.com>.
I supposed you start-mapred by user mapred.
then hadoop fs -chown -R mpared:mapred /home/jbu/hadoop_local_install/
hadoop-1.0.4/tmp/mapred/system
this is caused by fairscheduler, please reach
MAPREDUCE-4398<https://issues.apache.org/jira/browse/MAPREDUCE-4398>
On Mon, Apr 15, 2013 at 6:43 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that
> my hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Julian Bui <ju...@gmail.com>.
I thought it was talking about the hdfs, but I don't recall ever making
that directory and plus I thought everything was under /user/$USER in the
hdfs? I just stubbornly assumed was talking about my local fs :/
Anyway, thanks guys!
On Mon, Apr 15, 2013 at 6:12 AM, Harsh J <ha...@cloudera.com> wrote:
> The folder the JT warns about is on the HDFS, not local filesystem.
>
> On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> > Hello hadoop users,
> >
> > I can't start my jobtracker and am getting an
> > org.apache.hadoop.security.AccessControlException saying that my
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu (me, my user). However, I check the folder and it is
> > indeed owned by me. Details follow.
> >
> > $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> > $ ls -al
> > drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> > drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
> >
> > Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
> >
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> > 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> >
> > So it's still having problems thinking that directory is not owned by me.
> >
> > The log also said:
> >
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to
> > operate on mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > because of permissions.
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker:
> Manually
> > delete the mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > and then start the JobTracker.
> >
> > So I deleted the system directory and restarted and the same problem
> > appeared, that I didn't have ownership of the directory. Still won't
> start.
> >
> > I am using hadoop 1.0.4 on linux mint.
> >
> > Any ideas?
> >
> > Thanks,
> > -Julian
>
>
>
> --
> Harsh J
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Julian Bui <ju...@gmail.com>.
I thought it was talking about the hdfs, but I don't recall ever making
that directory and plus I thought everything was under /user/$USER in the
hdfs? I just stubbornly assumed was talking about my local fs :/
Anyway, thanks guys!
On Mon, Apr 15, 2013 at 6:12 AM, Harsh J <ha...@cloudera.com> wrote:
> The folder the JT warns about is on the HDFS, not local filesystem.
>
> On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> > Hello hadoop users,
> >
> > I can't start my jobtracker and am getting an
> > org.apache.hadoop.security.AccessControlException saying that my
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu (me, my user). However, I check the folder and it is
> > indeed owned by me. Details follow.
> >
> > $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> > $ ls -al
> > drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> > drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
> >
> > Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
> >
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> > 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> >
> > So it's still having problems thinking that directory is not owned by me.
> >
> > The log also said:
> >
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to
> > operate on mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > because of permissions.
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker:
> Manually
> > delete the mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > and then start the JobTracker.
> >
> > So I deleted the system directory and restarted and the same problem
> > appeared, that I didn't have ownership of the directory. Still won't
> start.
> >
> > I am using hadoop 1.0.4 on linux mint.
> >
> > Any ideas?
> >
> > Thanks,
> > -Julian
>
>
>
> --
> Harsh J
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Julian Bui <ju...@gmail.com>.
I thought it was talking about the hdfs, but I don't recall ever making
that directory and plus I thought everything was under /user/$USER in the
hdfs? I just stubbornly assumed was talking about my local fs :/
Anyway, thanks guys!
On Mon, Apr 15, 2013 at 6:12 AM, Harsh J <ha...@cloudera.com> wrote:
> The folder the JT warns about is on the HDFS, not local filesystem.
>
> On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> > Hello hadoop users,
> >
> > I can't start my jobtracker and am getting an
> > org.apache.hadoop.security.AccessControlException saying that my
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu (me, my user). However, I check the folder and it is
> > indeed owned by me. Details follow.
> >
> > $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> > $ ls -al
> > drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> > drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
> >
> > Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
> >
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> > 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> >
> > So it's still having problems thinking that directory is not owned by me.
> >
> > The log also said:
> >
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to
> > operate on mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > because of permissions.
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker:
> Manually
> > delete the mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > and then start the JobTracker.
> >
> > So I deleted the system directory and restarted and the same problem
> > appeared, that I didn't have ownership of the directory. Still won't
> start.
> >
> > I am using hadoop 1.0.4 on linux mint.
> >
> > Any ideas?
> >
> > Thanks,
> > -Julian
>
>
>
> --
> Harsh J
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Julian Bui <ju...@gmail.com>.
I thought it was talking about the hdfs, but I don't recall ever making
that directory and plus I thought everything was under /user/$USER in the
hdfs? I just stubbornly assumed was talking about my local fs :/
Anyway, thanks guys!
On Mon, Apr 15, 2013 at 6:12 AM, Harsh J <ha...@cloudera.com> wrote:
> The folder the JT warns about is on the HDFS, not local filesystem.
>
> On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> > Hello hadoop users,
> >
> > I can't start my jobtracker and am getting an
> > org.apache.hadoop.security.AccessControlException saying that my
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu (me, my user). However, I check the folder and it is
> > indeed owned by me. Details follow.
> >
> > $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> > $ ls -al
> > drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> > drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
> >
> > Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
> >
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> > 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> > org.apache.hadoop.security.AccessControlException: The systemdir
> >
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> > is not owned by jbu
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> > at
> org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> > at
> > org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> > at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> >
> > So it's still having problems thinking that directory is not owned by me.
> >
> > The log also said:
> >
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to
> > operate on mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > because of permissions.
> > 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker:
> Manually
> > delete the mapred.system.dir
> >
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> > and then start the JobTracker.
> >
> > So I deleted the system directory and restarted and the same problem
> > appeared, that I didn't have ownership of the directory. Still won't
> start.
> >
> > I am using hadoop 1.0.4 on linux mint.
> >
> > Any ideas?
> >
> > Thanks,
> > -Julian
>
>
>
> --
> Harsh J
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Harsh J <ha...@cloudera.com>.
The folder the JT warns about is on the HDFS, not local filesystem.
On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that my
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed to
> operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
--
Harsh J
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Harsh J <ha...@cloudera.com>.
The folder the JT warns about is on the HDFS, not local filesystem.
On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that my
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed to
> operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
--
Harsh J
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Azuryy Yu <az...@gmail.com>.
I supposed you start-mapred by user mapred.
then hadoop fs -chown -R mpared:mapred /home/jbu/hadoop_local_install/
hadoop-1.0.4/tmp/mapred/system
this is caused by fairscheduler, please reach
MAPREDUCE-4398<https://issues.apache.org/jira/browse/MAPREDUCE-4398>
On Mon, Apr 15, 2013 at 6:43 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that
> my hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Azuryy Yu <az...@gmail.com>.
I supposed you start-mapred by user mapred.
then hadoop fs -chown -R mpared:mapred /home/jbu/hadoop_local_install/
hadoop-1.0.4/tmp/mapred/system
this is caused by fairscheduler, please reach
MAPREDUCE-4398<https://issues.apache.org/jira/browse/MAPREDUCE-4398>
On Mon, Apr 15, 2013 at 6:43 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that
> my hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed
> to operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
>
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Harsh J <ha...@cloudera.com>.
The folder the JT warns about is on the HDFS, not local filesystem.
On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that my
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed to
> operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
--
Harsh J
Re: jobtracker not starting - access control exception - folder not
owned by me (it claims)
Posted by Harsh J <ha...@cloudera.com>.
The folder the JT warns about is on the HDFS, not local filesystem.
On Mon, Apr 15, 2013 at 4:13 PM, Julian Bui <ju...@gmail.com> wrote:
> Hello hadoop users,
>
> I can't start my jobtracker and am getting an
> org.apache.hadoop.security.AccessControlException saying that my
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu (me, my user). However, I check the folder and it is
> indeed owned by me. Details follow.
>
> $ cd /home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/
> $ ls -al
> drwxrwxr-x 6 jbu jbu 4096 Apr 15 03:30 local
> drwxrwxr-x 2 jbu jbu 4096 Apr 15 03:33 system
>
> Looking inside ./hadoop-jbu-jobtracker-jbu-laptop.log:
>
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
> 2013-04-15 03:34:13,697 FATAL org.apache.hadoop.mapred.JobTracker:
> org.apache.hadoop.security.AccessControlException: The systemdir
> hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system
> is not owned by jbu
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2379)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)
>
> So it's still having problems thinking that directory is not owned by me.
>
> The log also said:
>
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Failed to
> operate on mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> because of permissions.
> 2013-04-15 03:34:13,695 WARN org.apache.hadoop.mapred.JobTracker: Manually
> delete the mapred.system.dir
> (hdfs://localhost:9000/home/jbu/hadoop_local_install/hadoop-1.0.4/tmp/mapred/system)
> and then start the JobTracker.
>
> So I deleted the system directory and restarted and the same problem
> appeared, that I didn't have ownership of the directory. Still won't start.
>
> I am using hadoop 1.0.4 on linux mint.
>
> Any ideas?
>
> Thanks,
> -Julian
--
Harsh J