[jira] [Created] (ACCUMULO-4124) integration tests that use map-reduce run under the yarn instance when using IntegrationTestMapReduce

["Eric Newton (JIRA)" <ji...@apache.org>]

Eric Newton created ACCUMULO-4124:
-------------------------------------

             Summary: integration tests that use map-reduce run under the yarn instance when using IntegrationTestMapReduce
                 Key: ACCUMULO-4124
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-4124
             Project: Accumulo
          Issue Type: Bug
          Components: test
         Environment: running integration tests as a map-reduce job on a small cluster
            Reporter: Eric Newton
            Assignee: Eric Newton
             Fix For: 1.8.0


While attempting to run the Integration Tests under a map-reduce job using the fat mrit jar, I found that all the InputFormat and OutputFormat tests were failing. Checking on the cluster, I saw that the ITs were kicking off new applications with in the yarn cluster.

There are several problems with this:

1) the cluster is busy running ITs, so it doesn't have resources to be the M/R infrastructure for a test
2) zookeeper is consistently started on localhost, and the sub-map jobs cannot reach the zookeeper on the host that started it
3) files prepared by the test do not exist in order for the test to run because it is running on another host

This contributes to 15 of the 192 tests to throw unexpected exceptions. That is, they do not run to completion, either with test success, or test failure.  They also create a long tail of timeout failures.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)