You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2007/02/08 01:05:05 UTC

[jira] Created: (HADOOP-992) The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in

The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in
-------------------------------------------------------------------------------------------------------------

                 Key: HADOOP-992
                 URL: https://issues.apache.org/jira/browse/HADOOP-992
             Project: Hadoop
          Issue Type: Bug
          Components: test
    Affects Versions: 0.11.0
            Reporter: Owen O'Malley
         Assigned To: Owen O'Malley
             Fix For: 0.12.0
         Attachments: minimr-conf.patch

The mini map/reduce cluster that is used for testing was incorrectly setting the attribute for the filesystem, causing all of the tests to run against the local file system instead of the mini dfs cluster. This patch fixes that and also adds a new method to the mini mr cluster to generate an appropriate JobConf to submit against that cluster. That makes sure that all of the appropriate fields are set.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-992) The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-992:
---------------------------------

    Attachment: minimr-conf.patch

> The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-992
>                 URL: https://issues.apache.org/jira/browse/HADOOP-992
>             Project: Hadoop
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.12.0
>
>         Attachments: minimr-conf.patch
>
>
> The mini map/reduce cluster that is used for testing was incorrectly setting the attribute for the filesystem, causing all of the tests to run against the local file system instead of the mini dfs cluster. This patch fixes that and also adds a new method to the mini mr cluster to generate an appropriate JobConf to submit against that cluster. That makes sure that all of the appropriate fields are set.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HADOOP-992) The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12471159 ] 

Owen O'Malley commented on HADOOP-992:
--------------------------------------

I should comment that I also factored out a method in JobConf for

void setJarByClass(Class exampleClass);

to set the jar via an example class.

> The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-992
>                 URL: https://issues.apache.org/jira/browse/HADOOP-992
>             Project: Hadoop
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.12.0
>
>         Attachments: minimr-conf.patch
>
>
> The mini map/reduce cluster that is used for testing was incorrectly setting the attribute for the filesystem, causing all of the tests to run against the local file system instead of the mini dfs cluster. This patch fixes that and also adds a new method to the mini mr cluster to generate an appropriate JobConf to submit against that cluster. That makes sure that all of the appropriate fields are set.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-992) The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-992:
--------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

I just committed this.  Thanks, Owen!

> The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-992
>                 URL: https://issues.apache.org/jira/browse/HADOOP-992
>             Project: Hadoop
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.12.0
>
>         Attachments: minimr-conf.patch
>
>
> The mini map/reduce cluster that is used for testing was incorrectly setting the attribute for the filesystem, causing all of the tests to run against the local file system instead of the mini dfs cluster. This patch fixes that and also adds a new method to the mini mr cluster to generate an appropriate JobConf to submit against that cluster. That makes sure that all of the appropriate fields are set.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (HADOOP-992) The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12471166 ] 

Hadoop QA commented on HADOOP-992:
----------------------------------

+1, because http://issues.apache.org/jira/secure/attachment/12350602/minimr-conf.patch applied and successfully tested against trunk revision r504682.

> The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-992
>                 URL: https://issues.apache.org/jira/browse/HADOOP-992
>             Project: Hadoop
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.12.0
>
>         Attachments: minimr-conf.patch
>
>
> The mini map/reduce cluster that is used for testing was incorrectly setting the attribute for the filesystem, causing all of the tests to run against the local file system instead of the mini dfs cluster. This patch fixes that and also adds a new method to the mini mr cluster to generate an appropriate JobConf to submit against that cluster. That makes sure that all of the appropriate fields are set.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (HADOOP-992) The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-992:
---------------------------------

    Status: Patch Available  (was: Open)

> The mini/mr cluster for testing always uses the local file system rather than the namenode that was passed in
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-992
>                 URL: https://issues.apache.org/jira/browse/HADOOP-992
>             Project: Hadoop
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.11.0
>            Reporter: Owen O'Malley
>         Assigned To: Owen O'Malley
>             Fix For: 0.12.0
>
>         Attachments: minimr-conf.patch
>
>
> The mini map/reduce cluster that is used for testing was incorrectly setting the attribute for the filesystem, causing all of the tests to run against the local file system instead of the mini dfs cluster. This patch fixes that and also adds a new method to the mini mr cluster to generate an appropriate JobConf to submit against that cluster. That makes sure that all of the appropriate fields are set.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.