You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Takanobu Asanuma (Jira)" <ji...@apache.org> on 2025/02/12 04:17:00 UTC

[jira] [Created] (HDDS-12312) NodeManager log aggregation to Ozone FileSystem fails

Takanobu Asanuma created HDDS-12312:
---------------------------------------

             Summary: NodeManager log aggregation to Ozone FileSystem fails
                 Key: HDDS-12312
                 URL: https://issues.apache.org/jira/browse/HDDS-12312
             Project: Apache Ozone
          Issue Type: Task
            Reporter: Takanobu Asanuma
            Assignee: Takanobu Asanuma


When running a YARN job to Ozone FileSystem, NullPointerException occurs and NodeManagers fail to perform log aggregation.
{noformat}
2025-02-08 03:52:01,054 [NM ContainerManager dispatcher] INFO  logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:finishLogAggregation(590)) - Application just finished : application_1738986708224_0001
2025-02-08 03:52:01,111 [LogAggregationService #0] ERROR logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:run(481)) - Error occurred while aggregating the log for the application application_1738986708224_0001
java.lang.NullPointerException
        at org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat$LogWriter.close(AggregatedLogFormat.java:566)
        at org.apache.hadoop.yarn.logaggregation.filecontroller.tfile.LogAggregationTFileController.closeWriter(LogAggregationTFileController.java:101)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.uploadLogsForContainers(AppLogAggregatorImpl.java:395)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.doAppLogAggregation(AppLogAggregatorImpl.java:525)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.run(AppLogAggregatorImpl.java:472)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService$1.run(LogAggregationService.java:295)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
2025-02-08 03:52:01,113 [LogAggregationService #0] WARN  logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:run(486)) - Log aggregation did not complete for application application_1738986708224_0001 {noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org