You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Suresh Srinivas (JIRA)" <ji...@apache.org> on 2013/10/17 22:44:45 UTC

[jira] [Moved] (MAPREDUCE-5590) MiniMRClientClusterFactory in Hadoop 1.x forces local mode

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suresh Srinivas moved HADOOP-10056 to MAPREDUCE-5590:
-----------------------------------------------------

    Affects Version/s:     (was: 1.0.4)
                       1.0.4
                  Key: MAPREDUCE-5590  (was: HADOOP-10056)
              Project: Hadoop Map/Reduce  (was: Hadoop Common)

> MiniMRClientClusterFactory in Hadoop 1.x forces local mode
> ----------------------------------------------------------
>
>                 Key: MAPREDUCE-5590
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5590
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 1.0.4
>            Reporter: Abraham Elmahrek
>
> Noticed the following in the 1.x branches:
> {code}
> public class MiniMRClientClusterFactory {
>   public static MiniMRClientCluster create(Class<?> caller, int noOfNMs,
>       Configuration conf) throws IOException {
>     FileSystem fs = FileSystem.getLocal(new Configuration());
>     MiniMRCluster miniMRCluster = new MiniMRCluster(noOfNMs, fs.getUri()
>         .toString(), 1);
>     return new MiniMRClusterAdapter(miniMRCluster);
>   }
> }
> {code}
> The 2.x branches allow you to set what hadoop configuration to use (and which DFS cluster to connect to). For instance, in the Sqoop project we are using the MiniDFSCluster in conjunction with the MiniMRCluster.



--
This message was sent by Atlassian JIRA
(v6.1#6144)