You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Stephen O'Donnell (Jira)" <ji...@apache.org> on 2021/09/16 11:00:00 UTC
[jira] [Updated] (HDDS-5751) Use Mini Cluster Provider to speed up
TestHDDSUpgrade
[ https://issues.apache.org/jira/browse/HDDS-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen O'Donnell updated HDDS-5751:
------------------------------------
Description:
TestHDDSUpgrade is one of the longest running test suits as it creates many mini-clusters:
{code}
[INFO] Running org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade
Warning: Tests run: 13, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 694.753 s - in org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade
{code}
It is not possible to reuse the same clusters across multiple tests here, so we can use the MiniClusterProvider to create the clusters in the background and speed things up.
On my laptop the test runtime went from 9min 14s to 5min 12s.
was:
TestHDDSUpgrade is one of the longest running test suits as it creates many mini-clusters:
{code}
[INFO] Running org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade
Warning: Tests run: 13, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 694.753 s - in org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade
{code}
It is not possible to reuse the same clusters across multiple tests here, so we can use the MiniClusterProvider to create the clusters in the background and speed things up.
On my laptop the test runtime went from ? to 5min 12s.
> Use Mini Cluster Provider to speed up TestHDDSUpgrade
> -----------------------------------------------------
>
> Key: HDDS-5751
> URL: https://issues.apache.org/jira/browse/HDDS-5751
> Project: Apache Ozone
> Issue Type: Improvement
> Affects Versions: 1.2.0
> Reporter: Stephen O'Donnell
> Assignee: Stephen O'Donnell
> Priority: Major
>
> TestHDDSUpgrade is one of the longest running test suits as it creates many mini-clusters:
> {code}
> [INFO] Running org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade
> Warning: Tests run: 13, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 694.753 s - in org.apache.hadoop.hdds.upgrade.TestHDDSUpgrade
> {code}
> It is not possible to reuse the same clusters across multiple tests here, so we can use the MiniClusterProvider to create the clusters in the background and speed things up.
> On my laptop the test runtime went from 9min 14s to 5min 12s.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org