You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Ivan Andika (Jira)" <ji...@apache.org> on 2025/10/10 15:31:00 UTC
[jira] [Updated] (HDDS-12312) NodeManager log aggregation to Ozone FileSystem fails
[ https://issues.apache.org/jira/browse/HDDS-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ivan Andika updated HDDS-12312:
-------------------------------
Target Version/s: 2.0.0, 1.4.2 (was: 2.0.0)
> NodeManager log aggregation to Ozone FileSystem fails
> -----------------------------------------------------
>
> Key: HDDS-12312
> URL: https://issues.apache.org/jira/browse/HDDS-12312
> Project: Apache Ozone
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Takanobu Asanuma
> Assignee: Takanobu Asanuma
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.0.0
>
>
> When running a YARN job to Ozone FileSystem, NullPointerException occurs and NodeManagers fail to perform log aggregation.
> {noformat}
> 2025-02-08 03:52:01,054 [NM ContainerManager dispatcher] INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:finishLogAggregation(590)) - Application just finished : application_1738986708224_0001
> 2025-02-08 03:52:01,111 [LogAggregationService #0] ERROR logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:run(481)) - Error occurred while aggregating the log for the application application_1738986708224_0001
> java.lang.NullPointerException
> at org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat$LogWriter.close(AggregatedLogFormat.java:566)
> at org.apache.hadoop.yarn.logaggregation.filecontroller.tfile.LogAggregationTFileController.closeWriter(LogAggregationTFileController.java:101)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.uploadLogsForContainers(AppLogAggregatorImpl.java:395)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.doAppLogAggregation(AppLogAggregatorImpl.java:525)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl.run(AppLogAggregatorImpl.java:472)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService$1.run(LogAggregationService.java:295)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> 2025-02-08 03:52:01,113 [LogAggregationService #0] WARN logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:run(486)) - Log aggregation did not complete for application application_1738986708224_0001 {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org