[jira] [Updated] (MAPREDUCE-3398) Log Aggregation broken in Secure Mode

["Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Seth updated MAPREDUCE-3398:
--------------------------------------

    Attachment: MR3398_v1.txt

If security and log aggregation are enabled, the NM will send out an app keep alive request when a token is about to expire.
The RM takes care of the first keep-alive.
If the RM does not get a keep-alive request within the keep-alive timeout, the token will be cancelled.

Tested on a secure cluster - to check for logs being aggregated and token renewal requests from the NM.
                
> Log Aggregation broken in Secure Mode
> -------------------------------------
>
>                 Key: MAPREDUCE-3398
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3398
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, nodemanager
>    Affects Versions: 0.23.0
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>            Priority: Critical
>         Attachments: MR3398_v1.txt
>
>
> Log aggregation in secure mode does not work with MAPREDUCE-2977. The nodemanager relies on the users credentials to write out logs to HDFS. These credentials are currently cancelled once a job completes, before the NM can write out the logs.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira