You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Masoud <ma...@agape.hanyang.ac.kr> on 2011/11/01 06:35:35 UTC
under cygwin JUST tasktracker run by cyg_server user, Permission
denied .....
Hi
I have problem in running hadoop under cygwin 1.7
only tasktracker ran by cyg_server user and so make some problems,
so any idea please???
BS.
Masoud.
Re: under cygwin JUST tasktracker run by cyg_server user,
Permission denied .....
Posted by Uma Maheswara Rao G 72686 <ma...@huawei.com>.
in 205, code is different than trace Which version are you using?
I just verified the code in older versions,
http://mail-archives.apache.org/mod_mbox/hadoop-common-commits/201109.mbox/%3C20110902221116.D0B192388A68@eris.apache.org%3E
below is the code snippet.
+ boolean rv = true;
+
+ // read perms
+ rv = f.setReadable(group.implies(FsAction.READ), false);
+ checkReturnValue(rv, f, permission);
if rv is false then it throws the below error.
Can you please create a simple program with the below path and try call setReadable with the user where task tracker starts. Then we can get to know what error it is giving.
look at the javadoc http://download.oracle.com/javase/6/docs/api/java/io/File.html#setReadable(boolean,%20boolean)
setReadable
public boolean setReadable(boolean readable,
boolean ownerOnly)Sets the owner's or everybody's read permission for this abstract pathname.
Parameters:
readable - If true, sets the access permission to allow read operations; if false to disallow read operations
ownerOnly - If true, the read permission applies only to the owner's read permission; otherwise, it applies to everybody. If the underlying file system can not distinguish the owner's read permission from that of others, then the permission will apply to everybody, regardless of this value.
Returns:
true if and only if the operation succeeded. The operation will fail if the user does not have permission to change the access permissions of this abstract pathname. If readable is false and the underlying file system does not implement a read permission, then the operation will fail.
I am not sure how to provide the athentications in Cygwin. Please make sure you should have rights to change the permissions with the user. If i get some more info, i will update you.
i sent it to mapreduce user and cced to common
Regards,
Uma
*********----- Original Message -----
From: Masoud <ma...@agape.hanyang.ac.kr>
Date: Friday, November 4, 2011 7:01 am
Subject: Re: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
To: common-user@hadoop.apache.org
> Dear Uma,
> as you know when we use start-all.sh command, all the outputs
> saved in
> log files,
> when i check the tasktracker log file, i see the below error
> message and
> its shutdown.
> im really confused, its more than 4 days im working in this issue
> and
> tried different ways but no result.^^
>
> BS.
> Masoud
>
> On 11/03/2011 08:34 PM, Uma Maheswara Rao G 72686 wrote:
> > it wont disply any thing on console.
> > If you get any error while exceuting the command, then only it
> will disply on console. In your case it might executed successfully.
> > Still you are facing same problem with TT startup?
> >
> > Regards,
> > Uma
> > ----- Original Message -----
> > From: Masoud<ma...@agape.hanyang.ac.kr>
> > Date: Thursday, November 3, 2011 7:02 am
> > Subject: Re: under cygwin JUST tasktracker run by cyg_server
> user, Permission denied .....
> > To: common-user@hadoop.apache.org
> >
> >> Hi,
> >> thanks for info, i checked that report, seems same with mine but
> >> no
> >> specific solution mentioned.
> >> Yes, i changed this folder permission via cygwin,NO RESULT.
> >> Im really confused. ...
> >>
> >> any idea please ...?
> >>
> >> Thanks,
> >> B.S
> >>
> >>
> >> On 11/01/2011 05:38 PM, Uma Maheswara Rao G 72686 wrote:
> >>> Looks, that is permissions related issue on local dirs
> >>> There is an issue filed in mapred, related to this problem
> >> https://issues.apache.org/jira/browse/MAPREDUCE-2921
> >>> Can you please provide permissions explicitely and try?
> >>>
> >>> Regards,
> >>> Uma
> >>> ----- Original Message -----
> >>> From: Masoud<ma...@agape.hanyang.ac.kr>
> >>> Date: Tuesday, November 1, 2011 1:19 pm
> >>> Subject: Re: under cygwin JUST tasktracker run by cyg_server
> >> user, Permission denied .....
> >>> To: common-user@hadoop.apache.org
> >>>
> >>>> Sure, ^^
> >>>>
> >>>> when I run {namenode -fromat} it makes dfs in c:/tmp/
> >>>> administrator_hadoop/....
> >>>> after that by running "start-all.sh" every thing is OK, all
> daemons>>>> run
> >>>> except tasktracker.
> >>>> My current user in administrator, but tacktracker runs by
> >>>> cyg_server
> >>>> user that made by cygwin in installation time;This is a part
> of log
> >>>> file:
> >>>> 2011-11-01 14:26:54,463 INFO
> org.apache.hadoop.mapred.TaskTracker:>>>> Starting tasktracker
> with owner as cyg_server
> >>>> 2011-11-01 14:26:54,463 INFO
> org.apache.hadoop.mapred.TaskTracker:>>>> Good
> >>>> mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
> >>>> 2011-11-01 14:26:54,479 ERROR
> org.apache.hadoop.mapred.TaskTracker:>>>> Can
> >>>> not start task tracker because java.io.IOException: Failed to set
> >>>> permissions of path: \tmp\hadoop-
> cyg_server\mapred\local\ttprivate>>>> to 0700
> >>>> at
> >>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
> >>>> at
> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)>>>>
> at
> >>>>
> >>
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)>> at
> >>
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)>> at
> >>
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)>> at
> >>
> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)>> at
> >>>>
> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)>>>> at
> >> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)>>
> >>>> 2011-11-01 14:26:54,479 INFO
> org.apache.hadoop.mapred.TaskTracker:>>>> SHUTDOWN_MSG:
> >>>> /************************************************************
> >>>>
> >>>>
> >>>> Thanks,
> >>>> BR.
> >>>>
> >>>> On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
> >>>>> Can you please give some trace?
> >>>>> ----- Original Message -----
> >>>>> From: Masoud<ma...@agape.hanyang.ac.kr>
> >>>>> Date: Tuesday, November 1, 2011 11:08 am
> >>>>> Subject: under cygwin JUST tasktracker run by cyg_server user,
> >>>> Permission denied .....
> >>>>> To: common-user@hadoop.apache.org
> >>>>>
> >>>>>> Hi
> >>>>>> I have problem in running hadoop under cygwin 1.7
> >>>>>> only tasktracker ran by cyg_server user and so make some
> >> problems,>>>> so any idea please???
> >>>>>> BS.
> >>>>>> Masoud.
> >>>>>>
> >>
>
>
Re: under cygwin JUST tasktracker run by cyg_server user,
Permission denied .....
Posted by Uma Maheswara Rao G 72686 <ma...@huawei.com>.
in 205, code is different than trace Which version are you using?
I just verified the code in older versions,
http://mail-archives.apache.org/mod_mbox/hadoop-common-commits/201109.mbox/%3C20110902221116.D0B192388A68@eris.apache.org%3E
below is the code snippet.
+ boolean rv = true;
+
+ // read perms
+ rv = f.setReadable(group.implies(FsAction.READ), false);
+ checkReturnValue(rv, f, permission);
if rv is false then it throws the below error.
Can you please create a simple program with the below path and try call setReadable with the user where task tracker starts. Then we can get to know what error it is giving.
look at the javadoc http://download.oracle.com/javase/6/docs/api/java/io/File.html#setReadable(boolean,%20boolean)
setReadable
public boolean setReadable(boolean readable,
boolean ownerOnly)Sets the owner's or everybody's read permission for this abstract pathname.
Parameters:
readable - If true, sets the access permission to allow read operations; if false to disallow read operations
ownerOnly - If true, the read permission applies only to the owner's read permission; otherwise, it applies to everybody. If the underlying file system can not distinguish the owner's read permission from that of others, then the permission will apply to everybody, regardless of this value.
Returns:
true if and only if the operation succeeded. The operation will fail if the user does not have permission to change the access permissions of this abstract pathname. If readable is false and the underlying file system does not implement a read permission, then the operation will fail.
I am not sure how to provide the athentications in Cygwin. Please make sure you should have rights to change the permissions with the user. If i get some more info, i will update you.
i sent it to mapreduce user and cced to common
Regards,
Uma
*********----- Original Message -----
From: Masoud <ma...@agape.hanyang.ac.kr>
Date: Friday, November 4, 2011 7:01 am
Subject: Re: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
To: common-user@hadoop.apache.org
> Dear Uma,
> as you know when we use start-all.sh command, all the outputs
> saved in
> log files,
> when i check the tasktracker log file, i see the below error
> message and
> its shutdown.
> im really confused, its more than 4 days im working in this issue
> and
> tried different ways but no result.^^
>
> BS.
> Masoud
>
> On 11/03/2011 08:34 PM, Uma Maheswara Rao G 72686 wrote:
> > it wont disply any thing on console.
> > If you get any error while exceuting the command, then only it
> will disply on console. In your case it might executed successfully.
> > Still you are facing same problem with TT startup?
> >
> > Regards,
> > Uma
> > ----- Original Message -----
> > From: Masoud<ma...@agape.hanyang.ac.kr>
> > Date: Thursday, November 3, 2011 7:02 am
> > Subject: Re: under cygwin JUST tasktracker run by cyg_server
> user, Permission denied .....
> > To: common-user@hadoop.apache.org
> >
> >> Hi,
> >> thanks for info, i checked that report, seems same with mine but
> >> no
> >> specific solution mentioned.
> >> Yes, i changed this folder permission via cygwin,NO RESULT.
> >> Im really confused. ...
> >>
> >> any idea please ...?
> >>
> >> Thanks,
> >> B.S
> >>
> >>
> >> On 11/01/2011 05:38 PM, Uma Maheswara Rao G 72686 wrote:
> >>> Looks, that is permissions related issue on local dirs
> >>> There is an issue filed in mapred, related to this problem
> >> https://issues.apache.org/jira/browse/MAPREDUCE-2921
> >>> Can you please provide permissions explicitely and try?
> >>>
> >>> Regards,
> >>> Uma
> >>> ----- Original Message -----
> >>> From: Masoud<ma...@agape.hanyang.ac.kr>
> >>> Date: Tuesday, November 1, 2011 1:19 pm
> >>> Subject: Re: under cygwin JUST tasktracker run by cyg_server
> >> user, Permission denied .....
> >>> To: common-user@hadoop.apache.org
> >>>
> >>>> Sure, ^^
> >>>>
> >>>> when I run {namenode -fromat} it makes dfs in c:/tmp/
> >>>> administrator_hadoop/....
> >>>> after that by running "start-all.sh" every thing is OK, all
> daemons>>>> run
> >>>> except tasktracker.
> >>>> My current user in administrator, but tacktracker runs by
> >>>> cyg_server
> >>>> user that made by cygwin in installation time;This is a part
> of log
> >>>> file:
> >>>> 2011-11-01 14:26:54,463 INFO
> org.apache.hadoop.mapred.TaskTracker:>>>> Starting tasktracker
> with owner as cyg_server
> >>>> 2011-11-01 14:26:54,463 INFO
> org.apache.hadoop.mapred.TaskTracker:>>>> Good
> >>>> mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
> >>>> 2011-11-01 14:26:54,479 ERROR
> org.apache.hadoop.mapred.TaskTracker:>>>> Can
> >>>> not start task tracker because java.io.IOException: Failed to set
> >>>> permissions of path: \tmp\hadoop-
> cyg_server\mapred\local\ttprivate>>>> to 0700
> >>>> at
> >>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
> >>>> at
> org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)>>>>
> at
> >>>>
> >>
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)>> at
> >>
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)>> at
> >>
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)>> at
> >>
> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)>> at
> >>>>
> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)>>>> at
> >> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)>>
> >>>> 2011-11-01 14:26:54,479 INFO
> org.apache.hadoop.mapred.TaskTracker:>>>> SHUTDOWN_MSG:
> >>>> /************************************************************
> >>>>
> >>>>
> >>>> Thanks,
> >>>> BR.
> >>>>
> >>>> On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
> >>>>> Can you please give some trace?
> >>>>> ----- Original Message -----
> >>>>> From: Masoud<ma...@agape.hanyang.ac.kr>
> >>>>> Date: Tuesday, November 1, 2011 11:08 am
> >>>>> Subject: under cygwin JUST tasktracker run by cyg_server user,
> >>>> Permission denied .....
> >>>>> To: common-user@hadoop.apache.org
> >>>>>
> >>>>>> Hi
> >>>>>> I have problem in running hadoop under cygwin 1.7
> >>>>>> only tasktracker ran by cyg_server user and so make some
> >> problems,>>>> so any idea please???
> >>>>>> BS.
> >>>>>> Masoud.
> >>>>>>
> >>
>
>
Re: under cygwin JUST tasktracker run by cyg_server user, Permission
denied .....
Posted by Masoud <ma...@agape.hanyang.ac.kr>.
Dear Uma,
as you know when we use start-all.sh command, all the outputs saved in
log files,
when i check the tasktracker log file, i see the below error message and
its shutdown.
im really confused, its more than 4 days im working in this issue and
tried different ways but no result.^^
BS.
Masoud
On 11/03/2011 08:34 PM, Uma Maheswara Rao G 72686 wrote:
> it wont disply any thing on console.
> If you get any error while exceuting the command, then only it will disply on console. In your case it might executed successfully.
> Still you are facing same problem with TT startup?
>
> Regards,
> Uma
> ----- Original Message -----
> From: Masoud<ma...@agape.hanyang.ac.kr>
> Date: Thursday, November 3, 2011 7:02 am
> Subject: Re: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
> To: common-user@hadoop.apache.org
>
>> Hi,
>> thanks for info, i checked that report, seems same with mine but
>> no
>> specific solution mentioned.
>> Yes, i changed this folder permission via cygwin,NO RESULT.
>> Im really confused. ...
>>
>> any idea please ...?
>>
>> Thanks,
>> B.S
>>
>>
>> On 11/01/2011 05:38 PM, Uma Maheswara Rao G 72686 wrote:
>>> Looks, that is permissions related issue on local dirs
>>> There is an issue filed in mapred, related to this problem
>> https://issues.apache.org/jira/browse/MAPREDUCE-2921
>>> Can you please provide permissions explicitely and try?
>>>
>>> Regards,
>>> Uma
>>> ----- Original Message -----
>>> From: Masoud<ma...@agape.hanyang.ac.kr>
>>> Date: Tuesday, November 1, 2011 1:19 pm
>>> Subject: Re: under cygwin JUST tasktracker run by cyg_server
>> user, Permission denied .....
>>> To: common-user@hadoop.apache.org
>>>
>>>> Sure, ^^
>>>>
>>>> when I run {namenode -fromat} it makes dfs in c:/tmp/
>>>> administrator_hadoop/....
>>>> after that by running "start-all.sh" every thing is OK, all daemons
>>>> run
>>>> except tasktracker.
>>>> My current user in administrator, but tacktracker runs by
>>>> cyg_server
>>>> user that made by cygwin in installation time;This is a part of log
>>>> file:
>>>> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as cyg_server
>>>> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good
>>>> mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
>>>> 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker:
>>>> Can
>>>> not start task tracker because java.io.IOException: Failed to set
>>>> permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate
>>>> to 0700
>>>> at
>>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
>>>> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
>>>> at
>>>>
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)>> at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)>> at
>> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)>> at
>>>> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)
>>>> at
>> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)>>
>>>> 2011-11-01 14:26:54,479 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> SHUTDOWN_MSG:
>>>> /************************************************************
>>>>
>>>>
>>>> Thanks,
>>>> BR.
>>>>
>>>> On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
>>>>> Can you please give some trace?
>>>>> ----- Original Message -----
>>>>> From: Masoud<ma...@agape.hanyang.ac.kr>
>>>>> Date: Tuesday, November 1, 2011 11:08 am
>>>>> Subject: under cygwin JUST tasktracker run by cyg_server user,
>>>> Permission denied .....
>>>>> To: common-user@hadoop.apache.org
>>>>>
>>>>>> Hi
>>>>>> I have problem in running hadoop under cygwin 1.7
>>>>>> only tasktracker ran by cyg_server user and so make some
>> problems,>>>> so any idea please???
>>>>>> BS.
>>>>>> Masoud.
>>>>>>
>>
Re: under cygwin JUST tasktracker run by cyg_server user,
Permission denied .....
Posted by Uma Maheswara Rao G 72686 <ma...@huawei.com>.
it wont disply any thing on console.
If you get any error while exceuting the command, then only it will disply on console. In your case it might executed successfully.
Still you are facing same problem with TT startup?
Regards,
Uma
----- Original Message -----
From: Masoud <ma...@agape.hanyang.ac.kr>
Date: Thursday, November 3, 2011 7:02 am
Subject: Re: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
To: common-user@hadoop.apache.org
> Hi,
> thanks for info, i checked that report, seems same with mine but
> no
> specific solution mentioned.
> Yes, i changed this folder permission via cygwin,NO RESULT.
> Im really confused. ...
>
> any idea please ...?
>
> Thanks,
> B.S
>
>
> On 11/01/2011 05:38 PM, Uma Maheswara Rao G 72686 wrote:
> > Looks, that is permissions related issue on local dirs
> > There is an issue filed in mapred, related to this problem
> https://issues.apache.org/jira/browse/MAPREDUCE-2921
> >
> > Can you please provide permissions explicitely and try?
> >
> > Regards,
> > Uma
> > ----- Original Message -----
> > From: Masoud<ma...@agape.hanyang.ac.kr>
> > Date: Tuesday, November 1, 2011 1:19 pm
> > Subject: Re: under cygwin JUST tasktracker run by cyg_server
> user, Permission denied .....
> > To: common-user@hadoop.apache.org
> >
> >> Sure, ^^
> >>
> >> when I run {namenode -fromat} it makes dfs in c:/tmp/
> >> administrator_hadoop/....
> >> after that by running "start-all.sh" every thing is OK, all daemons
> >> run
> >> except tasktracker.
> >> My current user in administrator, but tacktracker runs by
> >> cyg_server
> >> user that made by cygwin in installation time;This is a part of log
> >> file:
> >> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
> >> Starting tasktracker with owner as cyg_server
> >> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
> >> Good
> >> mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
> >> 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker:
> >> Can
> >> not start task tracker because java.io.IOException: Failed to set
> >> permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate
> >> to 0700
> >> at
> >> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
> >> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
> >> at
> >>
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)>> at
> >>
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)>> at
> >>
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)>> at
> >>
> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)>> at
> >> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)
> >> at
> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)>>
> >> 2011-11-01 14:26:54,479 INFO org.apache.hadoop.mapred.TaskTracker:
> >> SHUTDOWN_MSG:
> >> /************************************************************
> >>
> >>
> >> Thanks,
> >> BR.
> >>
> >> On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
> >>> Can you please give some trace?
> >>> ----- Original Message -----
> >>> From: Masoud<ma...@agape.hanyang.ac.kr>
> >>> Date: Tuesday, November 1, 2011 11:08 am
> >>> Subject: under cygwin JUST tasktracker run by cyg_server user,
> >> Permission denied .....
> >>> To: common-user@hadoop.apache.org
> >>>
> >>>> Hi
> >>>> I have problem in running hadoop under cygwin 1.7
> >>>> only tasktracker ran by cyg_server user and so make some
> problems,>>>> so any idea please???
> >>>>
> >>>> BS.
> >>>> Masoud.
> >>>>
> >>
>
>
Re: under cygwin JUST tasktracker run by cyg_server user, Permission
denied .....
Posted by Masoud <ma...@agape.hanyang.ac.kr>.
Hi,
thanks for info, i checked that report, seems same with mine but no
specific solution mentioned.
Yes, i changed this folder permission via cygwin,NO RESULT.
Im really confused. ...
any idea please ...?
Thanks,
B.S
On 11/01/2011 05:38 PM, Uma Maheswara Rao G 72686 wrote:
> Looks, that is permissions related issue on local dirs
> There is an issue filed in mapred, related to this problem https://issues.apache.org/jira/browse/MAPREDUCE-2921
>
> Can you please provide permissions explicitely and try?
>
> Regards,
> Uma
> ----- Original Message -----
> From: Masoud<ma...@agape.hanyang.ac.kr>
> Date: Tuesday, November 1, 2011 1:19 pm
> Subject: Re: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
> To: common-user@hadoop.apache.org
>
>> Sure, ^^
>>
>> when I run {namenode -fromat} it makes dfs in c:/tmp/
>> administrator_hadoop/....
>> after that by running "start-all.sh" every thing is OK, all daemons
>> run
>> except tasktracker.
>> My current user in administrator, but tacktracker runs by
>> cyg_server
>> user that made by cygwin in installation time;This is a part of log
>> file:
>> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
>> Starting tasktracker with owner as cyg_server
>> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
>> Good
>> mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
>> 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker:
>> Can
>> not start task tracker because java.io.IOException: Failed to set
>> permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate
>> to 0700
>> at
>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
>> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
>> at
>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
>> at
>> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)
>> at
>> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)
>> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)
>>
>> 2011-11-01 14:26:54,479 INFO org.apache.hadoop.mapred.TaskTracker:
>> SHUTDOWN_MSG:
>> /************************************************************
>>
>>
>> Thanks,
>> BR.
>>
>> On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
>>> Can you please give some trace?
>>> ----- Original Message -----
>>> From: Masoud<ma...@agape.hanyang.ac.kr>
>>> Date: Tuesday, November 1, 2011 11:08 am
>>> Subject: under cygwin JUST tasktracker run by cyg_server user,
>> Permission denied .....
>>> To: common-user@hadoop.apache.org
>>>
>>>> Hi
>>>> I have problem in running hadoop under cygwin 1.7
>>>> only tasktracker ran by cyg_server user and so make some problems,
>>>> so any idea please???
>>>>
>>>> BS.
>>>> Masoud.
>>>>
>>
Re: under cygwin JUST tasktracker run by cyg_server user, Permission
denied .....
Posted by Masoud <ma...@agape.hanyang.ac.kr>.
Hi,
what do you mean of cygwin is my path?
I add c:/cygwin/bin and c:/cygwin/usr/sbin to windows path...
you had this problem too? let me know how you fixed it
Thanks,
B.R
On 11/02/2011 01:29 AM, Shevek wrote:
> Smells like failure to execute chmod to me; make sure cygwin is on your
> path?
>
> On 1 November 2011 01:38, Uma Maheswara Rao G 72686<ma...@huawei.com>wrote:
>
>> Looks, that is permissions related issue on local dirs
>> There is an issue filed in mapred, related to this problem
>> https://issues.apache.org/jira/browse/MAPREDUCE-2921
>>
>> Can you please provide permissions explicitely and try?
>>
>> Regards,
>> Uma
>> ----- Original Message -----
>> From: Masoud<ma...@agape.hanyang.ac.kr>
>> Date: Tuesday, November 1, 2011 1:19 pm
>> Subject: Re: under cygwin JUST tasktracker run by cyg_server user,
>> Permission denied .....
>> To: common-user@hadoop.apache.org
>>
>>> Sure, ^^
>>>
>>> when I run {namenode -fromat} it makes dfs in c:/tmp/
>>> administrator_hadoop/....
>>> after that by running "start-all.sh" every thing is OK, all daemons
>>> run
>>> except tasktracker.
>>> My current user in administrator, but tacktracker runs by
>>> cyg_server
>>> user that made by cygwin in installation time;This is a part of log
>>> file:
>>> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as cyg_server
>>> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good
>>> mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
>>> 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker:
>>> Can
>>> not start task tracker because java.io.IOException: Failed to set
>>> permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate
>>> to 0700
>>> at
>>> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
>>> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
>>> at
>>>
>> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)
>>> at
>>>
>> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
>>> at
>>> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
>>> at
>>> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)
>>> at
>>> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)
>>> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)
>>>
>>> 2011-11-01 14:26:54,479 INFO org.apache.hadoop.mapred.TaskTracker:
>>> SHUTDOWN_MSG:
>>> /************************************************************
>>>
>>>
>>> Thanks,
>>> BR.
>>>
>>> On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
>>>> Can you please give some trace?
>>>> ----- Original Message -----
>>>> From: Masoud<ma...@agape.hanyang.ac.kr>
>>>> Date: Tuesday, November 1, 2011 11:08 am
>>>> Subject: under cygwin JUST tasktracker run by cyg_server user,
>>> Permission denied .....
>>>> To: common-user@hadoop.apache.org
>>>>
>>>>> Hi
>>>>> I have problem in running hadoop under cygwin 1.7
>>>>> only tasktracker ran by cyg_server user and so make some problems,
>>>>> so any idea please???
>>>>>
>>>>> BS.
>>>>> Masoud.
>>>>>
>>>
Re: under cygwin JUST tasktracker run by cyg_server user, Permission
denied .....
Posted by Shevek <sh...@karmasphere.com>.
Smells like failure to execute chmod to me; make sure cygwin is on your
path?
On 1 November 2011 01:38, Uma Maheswara Rao G 72686 <ma...@huawei.com>wrote:
> Looks, that is permissions related issue on local dirs
> There is an issue filed in mapred, related to this problem
> https://issues.apache.org/jira/browse/MAPREDUCE-2921
>
> Can you please provide permissions explicitely and try?
>
> Regards,
> Uma
> ----- Original Message -----
> From: Masoud <ma...@agape.hanyang.ac.kr>
> Date: Tuesday, November 1, 2011 1:19 pm
> Subject: Re: under cygwin JUST tasktracker run by cyg_server user,
> Permission denied .....
> To: common-user@hadoop.apache.org
>
> > Sure, ^^
> >
> > when I run {namenode -fromat} it makes dfs in c:/tmp/
> > administrator_hadoop/....
> > after that by running "start-all.sh" every thing is OK, all daemons
> > run
> > except tasktracker.
> > My current user in administrator, but tacktracker runs by
> > cyg_server
> > user that made by cygwin in installation time;This is a part of log
> > file:
> > 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
> > Starting tasktracker with owner as cyg_server
> > 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
> > Good
> > mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
> > 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker:
> > Can
> > not start task tracker because java.io.IOException: Failed to set
> > permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate
> > to 0700
> > at
> > org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
> > at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
> > at
> >
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)
> > at
> >
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
> > at
> > org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
> > at
> > org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)
> > at
> > org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)
> > at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)
> >
> > 2011-11-01 14:26:54,479 INFO org.apache.hadoop.mapred.TaskTracker:
> > SHUTDOWN_MSG:
> > /************************************************************
> >
> >
> > Thanks,
> > BR.
> >
> > On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
> > > Can you please give some trace?
> > > ----- Original Message -----
> > > From: Masoud<ma...@agape.hanyang.ac.kr>
> > > Date: Tuesday, November 1, 2011 11:08 am
> > > Subject: under cygwin JUST tasktracker run by cyg_server user,
> > Permission denied .....
> > > To: common-user@hadoop.apache.org
> > >
> > >> Hi
> > >> I have problem in running hadoop under cygwin 1.7
> > >> only tasktracker ran by cyg_server user and so make some problems,
> > >> so any idea please???
> > >>
> > >> BS.
> > >> Masoud.
> > >>
> >
> >
>
Re: under cygwin JUST tasktracker run by cyg_server user,
Permission denied .....
Posted by Uma Maheswara Rao G 72686 <ma...@huawei.com>.
Looks, that is permissions related issue on local dirs
There is an issue filed in mapred, related to this problem https://issues.apache.org/jira/browse/MAPREDUCE-2921
Can you please provide permissions explicitely and try?
Regards,
Uma
----- Original Message -----
From: Masoud <ma...@agape.hanyang.ac.kr>
Date: Tuesday, November 1, 2011 1:19 pm
Subject: Re: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
To: common-user@hadoop.apache.org
> Sure, ^^
>
> when I run {namenode -fromat} it makes dfs in c:/tmp/
> administrator_hadoop/....
> after that by running "start-all.sh" every thing is OK, all daemons
> run
> except tasktracker.
> My current user in administrator, but tacktracker runs by
> cyg_server
> user that made by cygwin in installation time;This is a part of log
> file:
> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
> Starting tasktracker with owner as cyg_server
> 2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
> Good
> mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
> 2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker:
> Can
> not start task tracker because java.io.IOException: Failed to set
> permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate
> to 0700
> at
> org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
> at
> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)
> at
> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)
>
> 2011-11-01 14:26:54,479 INFO org.apache.hadoop.mapred.TaskTracker:
> SHUTDOWN_MSG:
> /************************************************************
>
>
> Thanks,
> BR.
>
> On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
> > Can you please give some trace?
> > ----- Original Message -----
> > From: Masoud<ma...@agape.hanyang.ac.kr>
> > Date: Tuesday, November 1, 2011 11:08 am
> > Subject: under cygwin JUST tasktracker run by cyg_server user,
> Permission denied .....
> > To: common-user@hadoop.apache.org
> >
> >> Hi
> >> I have problem in running hadoop under cygwin 1.7
> >> only tasktracker ran by cyg_server user and so make some problems,
> >> so any idea please???
> >>
> >> BS.
> >> Masoud.
> >>
>
>
Re: under cygwin JUST tasktracker run by cyg_server user, Permission
denied .....
Posted by Masoud <ma...@agape.hanyang.ac.kr>.
Sure, ^^
when I run {namenode -fromat} it makes dfs in c:/tmp/
administrator_hadoop/....
after that by running "start-all.sh" every thing is OK, all daemons run
except tasktracker.
My current user in administrator, but tacktracker runs by cyg_server
user that made by cygwin in installation time;This is a part of log file:
2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as cyg_server
2011-11-01 14:26:54,463 INFO org.apache.hadoop.mapred.TaskTracker: Good
mapred local directories are: /tmp/hadoop-cyg_server/mapred/local
2011-11-01 14:26:54,479 ERROR org.apache.hadoop.mapred.TaskTracker: Can
not start task tracker because java.io.IOException: Failed to set
permissions of path: \tmp\hadoop-cyg_server\mapred\local\ttprivate to 0700
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
at
org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
at
org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:741)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1463)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3611)
2011-11-01 14:26:54,479 INFO org.apache.hadoop.mapred.TaskTracker:
SHUTDOWN_MSG:
/************************************************************
Thanks,
BR.
On 11/01/2011 04:33 PM, Uma Maheswara Rao G 72686 wrote:
> Can you please give some trace?
> ----- Original Message -----
> From: Masoud<ma...@agape.hanyang.ac.kr>
> Date: Tuesday, November 1, 2011 11:08 am
> Subject: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
> To: common-user@hadoop.apache.org
>
>> Hi
>> I have problem in running hadoop under cygwin 1.7
>> only tasktracker ran by cyg_server user and so make some problems,
>> so any idea please???
>>
>> BS.
>> Masoud.
>>
Re: under cygwin JUST tasktracker run by cyg_server user,
Permission denied .....
Posted by Uma Maheswara Rao G 72686 <ma...@huawei.com>.
Can you please give some trace?
----- Original Message -----
From: Masoud <ma...@agape.hanyang.ac.kr>
Date: Tuesday, November 1, 2011 11:08 am
Subject: under cygwin JUST tasktracker run by cyg_server user, Permission denied .....
To: common-user@hadoop.apache.org
> Hi
> I have problem in running hadoop under cygwin 1.7
> only tasktracker ran by cyg_server user and so make some problems,
> so any idea please???
>
> BS.
> Masoud.
>