You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Tsz-wo Sze (Jira)" <ji...@apache.org> on 2023/05/25 04:50:00 UTC

[jira] [Resolved] (HDDS-6126) MR Acceptance test failure

     [ https://issues.apache.org/jira/browse/HDDS-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz-wo Sze resolved HDDS-6126.
------------------------------
    Resolution: Not A Problem

This is no longer a problem.  Resolving ...

> MR Acceptance test failure
> --------------------------
>
>                 Key: HDDS-6126
>                 URL: https://issues.apache.org/jira/browse/HDDS-6126
>             Project: Apache Ozone
>          Issue Type: Bug
>            Reporter: Sadanand Shenoy
>            Assignee: Sadanand Shenoy
>            Priority: Major
>         Attachments: NM-jstack.txt, nm_logs.log
>
>
> The following problem was discovered in the Streaming Branch (HDDS-4454). The same problem can also be reproduced in the master branch (without using Streaming).
> ----
> The ozone MR Acceptance fails on the streaming branch if ozone.fs.datastream.enable is set to true.
> The test basically runs a yarn wordcount job and  the observation here is that the job doesn’t release the Application master (AM container ) as soon as the job is done and the job counters are displayed which is why the second job waits for a long time ~10 min for the AM container to be released. 
> Tried with enabling streaming and disabling streaming and verified that the problem occurs only when  ozone.fs.datastream.enable=true 
> {code:java}
> yarn jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar pi -D   fs.defaultFS=o3fs://bucket1.volume1.om/  -D ozone.fs.datastream.enable=true 3 3{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org