You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by GitBox <gi...@apache.org> on 2020/03/26 10:04:46 UTC

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

adoroszlai opened a new pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725
 
 
   ## What changes were proposed in this pull request?
   
   Disable YARN disk utilization check in `ozonesecure-mr` acceptance test.
   
   Plenty of disk space is available in CI, but more than 90% of the disk is used:
   
   ```
   Filesystem      Size  Used Avail Use% Mounted on
   ...
   /dev/sda1        84G   75G  8.3G  91% /
   ```
   
   Thus directory checker marks it as invalid:
   
   ```
   WARN  DirectoryCollection:418 - Directory /tmp/hadoop-hadoop/nm-local-dir error, used space above threshold of 90.0%, removing from list of valid directories
   WARN  DirectoryCollection:418 - Directory /opt/hadoop/logs/userlogs error, used space above threshold of 90.0%, removing from list of valid directories
   ```
   
   https://issues.apache.org/jira/browse/HDDS-3284
   
   ## How was this patch tested?
   
   https://github.com/adoroszlai/hadoop-ozone/runs/535925282
   
   ```
   ==============================================================================
   Execute PI calculation                                                | PASS |
   ------------------------------------------------------------------------------
   Execute WordCount                                                     | PASS |
   ------------------------------------------------------------------------------
   ozonesecure-mr-mapreduce :: Execute MR jobs                           | PASS |
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org


[GitHub] [hadoop-ozone] adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

Posted by GitBox <gi...@apache.org>.
adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604678295
 
 
   Thanks @sodonnel and @vivekratnavel for the review, and @hanishakoneru for merging it.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org


[GitHub] [hadoop-ozone] hanishakoneru commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

Posted by GitBox <gi...@apache.org>.
hanishakoneru commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604623673
 
 
   Thanks @adoroszlai for working on this. I will go ahead and merge this as the change is only in acceptance tests.
   Thanks @sodonnel and @vivekratnavel for the reviews.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org


[GitHub] [hadoop-ozone] sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

Posted by GitBox <gi...@apache.org>.
sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604396747
 
 
   Yea, I have seen random failures on it-client. As this is a yarn only change, I cannot see how it could impact the integration tests, so I think we are good to merge it.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org


[GitHub] [hadoop-ozone] sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

Posted by GitBox <gi...@apache.org>.
sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604386700
 
 
   Thanks for looking into this. +1 on this from me, pending CI, but some of the "it-*" tests are a bit flaky.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org


[GitHub] [hadoop-ozone] adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

Posted by GitBox <gi...@apache.org>.
adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604392865
 
 
   Thanks @sodonnel.  Since it only changes acceptance tests, I think we can merge it even if `it-client` happens to fail.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org


[GitHub] [hadoop-ozone] vivekratnavel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

Posted by GitBox <gi...@apache.org>.
vivekratnavel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604541141
 
 
   +1 LGTM.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org


[GitHub] [hadoop-ozone] hanishakoneru merged pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

Posted by GitBox <gi...@apache.org>.
hanishakoneru merged pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space
URL: https://github.com/apache/hadoop-ozone/pull/725
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org