[jira] [Created] (YARN-9030) Log aggregation changes to handle filesystems which do not support permissions

["Suma Shivaprasad (JIRA)" <ji...@apache.org>]

Suma Shivaprasad created YARN-9030:
--------------------------------------

             Summary: Log aggregation changes to handle filesystems which do not support permissions
                 Key: YARN-9030
                 URL: https://issues.apache.org/jira/browse/YARN-9030
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Suma Shivaprasad
            Assignee: Suma Shivaprasad


Some cloud storages like ABFS do not support permissions in which case they throw an UnsupportedOperationException. Log aggregation should hanlde these case and not set permissions for log aggregation base dir/ sub dirs 

{noformat}

2018-11-12 15:37:28,726 WARN  logaggregation.LogAggregationService (LogAggregationService.java:initApp(209)) - Application failed to init aggregation
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to check permissions for dir [abfs://testctr1@test.blob.core.windows.net/app-logs]
        at org.apache.hadoop.yarn.logaggregation.filecontroller.LogAggregationFileController.verifyAndCreateRemoteLogDir(LogAggregationFileController.java:277)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService.initAppAggregator(LogAggregationService.java:238)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService.initApp(LogAggregationService.java:204)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService.handle(LogAggregationService.java:347)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService.handle(LogAggregationService.java:69)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126)
        at java.lang.Thread.run(Thread.java:748)

{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org