You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/02/17 18:46:00 UTC
[jira] [Work logged] (MAPREDUCE-7320) ClusterMapReduceTestCase does
not clean directories
[ https://issues.apache.org/jira/browse/MAPREDUCE-7320?focusedWorklogId=553793&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-553793 ]
ASF GitHub Bot logged work on MAPREDUCE-7320:
---------------------------------------------
Author: ASF GitHub Bot
Created on: 17/Feb/21 18:45
Start Date: 17/Feb/21 18:45
Worklog Time Spent: 10m
Work Description: amahussein opened a new pull request #2705:
URL: https://github.com/apache/hadoop/pull/2705
[MAPREDUCE-7320: ClusterMapReduceTestCase does not clean directories](https://issues.apache.org/jira/browse/MAPREDUCE-7320)
Running Junits that extend ClusterMapReduceTestCase generate lots of directories and folders without cleaning them up.
This PR addresses cleaning up the clusters directories after finishing the unit tests.
- It touches `MiniYARNCluster.java` in order to change the base dir to `target/test-dir/$TEST_CLASS_NAME`
- test classes affected
- TestMRJobClient,
- TestStreamingBadRecords,
- TestClusterMapReduceTestCase,
- TestBadRecords. TestMRCJCJobClient,
- TestJobName
I tested the TestUnits that use `MiniYARNCluster.java` such as:
```bash
Class
MiniYARNCluster
TestOSSMiniYarnCluster (3 usages found)
TestMRTimelineEventHandling (4 usages found)
TestJobHistoryEventHandler (3 usages found)
TestHadoopArchiveLogs (3 usages found)
TestHadoopArchiveLogsRunner (3 usages found)
TestDynamometerInfra (3 usages found)
TestDSTimelineV10
TestDSTimelineV20
TestDSTimelineV15
TestUnmanagedAMLauncher (3 usages found)
TestApplicationMasterServiceProtocolForTimelineV2
TestFederationRMFailoverProxyProvider (3 usages found)
TestHedgingRequestRMFailoverProxyProvider (4 usages found)
TestNoHaRMFailoverProxyProvider (5 usages found)
TestRMFailover (4 usages found)
TestAMRMClient
TestAMRMClientPlacementConstraints
TestAMRMProxy (5 usages found)
TestNMClient (3 usages found)
TestOpportunisticContainerAllocationE2E (3 usages found)
TestYarnClient (3 usages found)
TestYarnClientWithReservation (12 usages found)
TestYarnCLI (7 usages found)
TestContainerManagerSecurity (2 usages found)
TestDiskFailures (2 usages found)
TestMiniYarnCluster (9 usages found)
TestMiniYARNClusterForHA (2 usages found)
TestMiniYarnClusterNodeUtilization (3 usages found)
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 553793)
Remaining Estimate: 0h
Time Spent: 10m
> ClusterMapReduceTestCase does not clean directories
> ---------------------------------------------------
>
> Key: MAPREDUCE-7320
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7320
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Ahmed Hussein
> Assignee: Ahmed Hussein
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Running Junits that extend {{ClusterMapReduceTestCase}} generate lots of directories and folders without cleaning them up.
> For example:
> {code:bash}
> men test -Dtest=TestMRJobClient{code}
> generates the following directories:
> {code:bash}
> - target
> -+ ConfigurableMiniMRCluster_315090884
> -+ ConfigurableMiniMRCluster_1335188990
> -+ ConfigurableMiniMRCluster_1973037511
> -+ test-dir
> -+ dfs
> -+ hadopp-XYZ-01
> -+ hadopp-XYZ-02
> -+ hadopp-XYZ-03
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org