[jira] [Commented] (MAPREDUCE-7320) ClusterMapReduceTestCase does not clean directories

["Ahmed Hussein (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286079#comment-17286079 ] 

Ahmed Hussein commented on MAPREDUCE-7320:
------------------------------------------

This fix is cleaning up the clusters directories after finishing the unit tests.

* It touches {{MiniYARNCluster.java}} in order to change the base dir to {{target/test-dir/$TEST_CLASS_NAME}}
* test classes affected
** TestMRJobClient,
** TestStreamingBadRecords,
** TestClusterMapReduceTestCase,
** TestBadRecords.
** TestMRCJCJobClient,
** TestJobName

I tested the TestUnits that use {{MiniYARNCluster.java}} such as:

{code:bash}
Class
    MiniYARNCluster

        TestOSSMiniYarnCluster  (3 usages found)
        TestMRTimelineEventHandling  (4 usages found)
        TestJobHistoryEventHandler  (3 usages found)
        TestHadoopArchiveLogs  (3 usages found)
        TestHadoopArchiveLogsRunner  (3 usages found)
        TestDynamometerInfra  (3 usages found)
        TestDSTimelineV10
        TestDSTimelineV20
        TestDSTimelineV15
        TestUnmanagedAMLauncher  (3 usages found)
        TestApplicationMasterServiceProtocolForTimelineV2
        TestFederationRMFailoverProxyProvider  (3 usages found)
        TestHedgingRequestRMFailoverProxyProvider  (4 usages found)
        TestNoHaRMFailoverProxyProvider  (5 usages found)
        TestRMFailover  (4 usages found)
        TestAMRMClient
        TestAMRMClientPlacementConstraints
        TestAMRMProxy  (5 usages found)
        TestNMClient  (3 usages found)
        TestOpportunisticContainerAllocationE2E  (3 usages found)
        TestYarnClient  (3 usages found)
        TestYarnClientWithReservation  (12 usages found)
        TestYarnCLI  (7 usages found)
        TestContainerManagerSecurity  (2 usages found)
        TestDiskFailures  (2 usages found)
        TestMiniYarnCluster  (9 usages found)
        TestMiniYARNClusterForHA  (2 usages found)
        TestMiniYarnClusterNodeUtilization  (3 usages found)
{code}




> ClusterMapReduceTestCase does not clean directories
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-7320
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7320
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Ahmed Hussein
>            Assignee: Ahmed Hussein
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Running Junits that extend {{ClusterMapReduceTestCase}} generate lots of directories and folders without cleaning them up.
> For example:
> {code:bash}
> men test -Dtest=TestMRJobClient{code}
> generates the following directories:
> {code:bash}
> - target
>    -+ ConfigurableMiniMRCluster_315090884
>    -+ ConfigurableMiniMRCluster_1335188990
>    -+ ConfigurableMiniMRCluster_1973037511
>    -+ test-dir
>         -+ dfs
>         -+ hadopp-XYZ-01
>         -+ hadopp-XYZ-02 
>         -+ hadopp-XYZ-03
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org