You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Dave Shine <Da...@channelintelligence.com> on 2012/07/03 22:50:44 UTC
RE: User Logs questions
I never saw a response to this request. Is it possible to configure these properties?
Thanks,
Dave Shine
Sr. Software Engineer
321.939.5093 direct | 407.314.0122 mobile
CI Boost(tm) Clients Outperform Online(tm) www.ciboost.com<http://www.ciboost.com/>
From: Dave Shine [mailto:Dave.Shine@channelintelligence.com]
Sent: Friday, June 29, 2012 3:56 PM
To: cdh-user@cloudera.org
Cc: Eric Lyna; Gary Every
Subject: User Logs questions
On CDH3U4, what determines the permissions of the folders and files under /var/log/hadoop/userlogs? In my cluster everything has drwx--x--- 2 mapred mapred. How can I change that to be drwxr-xr-- 2 mapred mapred?
Finally, where can I set the retention period for these job logs?
Thanks,
Dave Shine
Sr. Software Engineer
321.939.5093 direct | 407.314.0122 mobile
[cid:image001.png@01CD593B.FCF1A5D0]
CI Boost(tm) Clients Outperform Online(tm) www.ciboost.com<http://www.ciboost.com/>
facebook platform | where-to-buy | product search engines | shopping engines
________________________________
The information contained in this email message is considered confidential and proprietary to the sender and is intended solely for review and use by the named recipient. Any unauthorized review, use or distribution is strictly prohibited. If you have received this message in error, please advise the sender by reply email and delete the message.
Fw: Fwd: User Logs questions
Posted by sumit ghosh <su...@yahoo.com>.
Hi,
Anyone aware of the solution to the user log permission issue on CDH?
Warm Regards,
Sumit
---------- Forwarded message ----------
From: Sumit Ghosh <su...@gmail.com>
Date: Sat, Feb 9, 2013 at 10:16 AM
Subject: Re: User Logs questions
To: cdh-user@cloudera.org
Whenever we have the new job directories they will be created with this no permissions.on them.
Have a great Day Ahead!
Sumit
On Sat, Feb 9, 2013 at 9:44 AM, Patai Sangbutsarakum <si...@gmail.com> wrote:
i don't recall that there is specific key value in any mapred-site.xml
>what happen when you chmod 755 on the directory. is it fall bak to 710 again ?
>
>
>
>
>
>On Fri, Feb 8, 2013 at 7:13 PM, Sumit Ghosh <su...@gmail.com> wrote:
>
>I am hit with the same problem.
>>Changed the umask to 0022 then restarted the Task Tracker & Job Tracker but that did not help.
>>
>>some of these folders have permissions like:
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>
>>Please update if you have already figured this out.
>>
>>On Tuesday, 3 July 2012 13:50:44 UTC-7, Dave Shine wrote:
>>I never saw a response to this request. Is it possible to configure these properties?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>
>>>From:Dave Shine [mailto:Dave....@channelintelligence.com]
>>>
>>>Sent: Friday, June 29, 2012 3:56 PM
>>>To: cdh-...@cloudera.org
>>>
>>>Cc: Eric Lyna; Gary Every
>>>Subject: User Logs questions
>>>
>>>On CDH3U4, what determines the permissions of the folders and files under /var/log/hadoop/userlogs? In my cluster everything has drwx--x--- 2 mapred mapred. How can I change that to be drwxr-xr-- 2 mapred mapred?
>>>
>>>Finally, where can I set the retention period for these job logs?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>facebook platform | where-to-buy | product search engines | shopping engines
>>>
>>>
>>>
>>>
>>>________________________________
>>>
>>>The information contained in this email message is considered confidential and proprietary to the sender and is intended solely for review and use by the named recipient. Any unauthorized review, use or distribution is strictly prohibited. If you have received this message in error, please advise the sender by reply email and delete the message.--
>>
>>
>>
>>
>--
>
>
>
>
Fw: Fwd: User Logs questions
Posted by sumit ghosh <su...@yahoo.com>.
Hi,
Anyone aware of the solution to the user log permission issue on CDH?
Warm Regards,
Sumit
---------- Forwarded message ----------
From: Sumit Ghosh <su...@gmail.com>
Date: Sat, Feb 9, 2013 at 10:16 AM
Subject: Re: User Logs questions
To: cdh-user@cloudera.org
Whenever we have the new job directories they will be created with this no permissions.on them.
Have a great Day Ahead!
Sumit
On Sat, Feb 9, 2013 at 9:44 AM, Patai Sangbutsarakum <si...@gmail.com> wrote:
i don't recall that there is specific key value in any mapred-site.xml
>what happen when you chmod 755 on the directory. is it fall bak to 710 again ?
>
>
>
>
>
>On Fri, Feb 8, 2013 at 7:13 PM, Sumit Ghosh <su...@gmail.com> wrote:
>
>I am hit with the same problem.
>>Changed the umask to 0022 then restarted the Task Tracker & Job Tracker but that did not help.
>>
>>some of these folders have permissions like:
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>
>>Please update if you have already figured this out.
>>
>>On Tuesday, 3 July 2012 13:50:44 UTC-7, Dave Shine wrote:
>>I never saw a response to this request. Is it possible to configure these properties?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>
>>>From:Dave Shine [mailto:Dave....@channelintelligence.com]
>>>
>>>Sent: Friday, June 29, 2012 3:56 PM
>>>To: cdh-...@cloudera.org
>>>
>>>Cc: Eric Lyna; Gary Every
>>>Subject: User Logs questions
>>>
>>>On CDH3U4, what determines the permissions of the folders and files under /var/log/hadoop/userlogs? In my cluster everything has drwx--x--- 2 mapred mapred. How can I change that to be drwxr-xr-- 2 mapred mapred?
>>>
>>>Finally, where can I set the retention period for these job logs?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>facebook platform | where-to-buy | product search engines | shopping engines
>>>
>>>
>>>
>>>
>>>________________________________
>>>
>>>The information contained in this email message is considered confidential and proprietary to the sender and is intended solely for review and use by the named recipient. Any unauthorized review, use or distribution is strictly prohibited. If you have received this message in error, please advise the sender by reply email and delete the message.--
>>
>>
>>
>>
>--
>
>
>
>
Fw: Fwd: User Logs questions
Posted by sumit ghosh <su...@yahoo.com>.
Hi,
Anyone aware of the solution to the user log permission issue on CDH?
Warm Regards,
Sumit
---------- Forwarded message ----------
From: Sumit Ghosh <su...@gmail.com>
Date: Sat, Feb 9, 2013 at 10:16 AM
Subject: Re: User Logs questions
To: cdh-user@cloudera.org
Whenever we have the new job directories they will be created with this no permissions.on them.
Have a great Day Ahead!
Sumit
On Sat, Feb 9, 2013 at 9:44 AM, Patai Sangbutsarakum <si...@gmail.com> wrote:
i don't recall that there is specific key value in any mapred-site.xml
>what happen when you chmod 755 on the directory. is it fall bak to 710 again ?
>
>
>
>
>
>On Fri, Feb 8, 2013 at 7:13 PM, Sumit Ghosh <su...@gmail.com> wrote:
>
>I am hit with the same problem.
>>Changed the umask to 0022 then restarted the Task Tracker & Job Tracker but that did not help.
>>
>>some of these folders have permissions like:
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>
>>Please update if you have already figured this out.
>>
>>On Tuesday, 3 July 2012 13:50:44 UTC-7, Dave Shine wrote:
>>I never saw a response to this request. Is it possible to configure these properties?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>
>>>From:Dave Shine [mailto:Dave....@channelintelligence.com]
>>>
>>>Sent: Friday, June 29, 2012 3:56 PM
>>>To: cdh-...@cloudera.org
>>>
>>>Cc: Eric Lyna; Gary Every
>>>Subject: User Logs questions
>>>
>>>On CDH3U4, what determines the permissions of the folders and files under /var/log/hadoop/userlogs? In my cluster everything has drwx--x--- 2 mapred mapred. How can I change that to be drwxr-xr-- 2 mapred mapred?
>>>
>>>Finally, where can I set the retention period for these job logs?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>facebook platform | where-to-buy | product search engines | shopping engines
>>>
>>>
>>>
>>>
>>>________________________________
>>>
>>>The information contained in this email message is considered confidential and proprietary to the sender and is intended solely for review and use by the named recipient. Any unauthorized review, use or distribution is strictly prohibited. If you have received this message in error, please advise the sender by reply email and delete the message.--
>>
>>
>>
>>
>--
>
>
>
>
Fw: Fwd: User Logs questions
Posted by sumit ghosh <su...@yahoo.com>.
Hi,
Anyone aware of the solution to the user log permission issue on CDH?
Warm Regards,
Sumit
---------- Forwarded message ----------
From: Sumit Ghosh <su...@gmail.com>
Date: Sat, Feb 9, 2013 at 10:16 AM
Subject: Re: User Logs questions
To: cdh-user@cloudera.org
Whenever we have the new job directories they will be created with this no permissions.on them.
Have a great Day Ahead!
Sumit
On Sat, Feb 9, 2013 at 9:44 AM, Patai Sangbutsarakum <si...@gmail.com> wrote:
i don't recall that there is specific key value in any mapred-site.xml
>what happen when you chmod 755 on the directory. is it fall bak to 710 again ?
>
>
>
>
>
>On Fri, Feb 8, 2013 at 7:13 PM, Sumit Ghosh <su...@gmail.com> wrote:
>
>I am hit with the same problem.
>>Changed the umask to 0022 then restarted the Task Tracker & Job Tracker but that did not help.
>>
>>some of these folders have permissions like:
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>drwx------ 2 mapred mapred 4096 Feb 9 02:41 attempt_201302090*
>>
>>Please update if you have already figured this out.
>>
>>On Tuesday, 3 July 2012 13:50:44 UTC-7, Dave Shine wrote:
>>I never saw a response to this request. Is it possible to configure these properties?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>
>>>From:Dave Shine [mailto:Dave....@channelintelligence.com]
>>>
>>>Sent: Friday, June 29, 2012 3:56 PM
>>>To: cdh-...@cloudera.org
>>>
>>>Cc: Eric Lyna; Gary Every
>>>Subject: User Logs questions
>>>
>>>On CDH3U4, what determines the permissions of the folders and files under /var/log/hadoop/userlogs? In my cluster everything has drwx--x--- 2 mapred mapred. How can I change that to be drwxr-xr-- 2 mapred mapred?
>>>
>>>Finally, where can I set the retention period for these job logs?
>>>
>>>Thanks,
>>>Dave Shine
>>>Sr. Software Engineer
>>>321.939.5093 direct | 407.314.0122 mobile
>>>
>>>CI Boost™ Clients Outperform Online™ www.ciboost.com
>>>facebook platform | where-to-buy | product search engines | shopping engines
>>>
>>>
>>>
>>>
>>>________________________________
>>>
>>>The information contained in this email message is considered confidential and proprietary to the sender and is intended solely for review and use by the named recipient. Any unauthorized review, use or distribution is strictly prohibited. If you have received this message in error, please advise the sender by reply email and delete the message.--
>>
>>
>>
>>
>--
>
>
>
>