You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2011/05/31 19:22:47 UTC

[jira] [Created] (MAPREDUCE-2550) RPM packages broke bin/mapred script

RPM packages broke bin/mapred script
------------------------------------

                 Key: MAPREDUCE-2550
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: build
         Environment: Java 6, Redhat 5.5
            Reporter: Eric Yang
            Assignee: Eric Yang
            Priority: Blocker


Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2550) RPM packages broke bin/mapred script

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated MAPREDUCE-2550:
---------------------------------

    Attachment: MAPREDUCE-2550.patch

Restore HADOOP_COMMON_HOME and environment based control. This was removed per Owen's request to make the system more secure without depending on environment variables.

This revision will check for $HADOOP_PREFIX/libexec/hadoop-config.sh exists. If libexec/hadoop-config.sh exists, it will be used. If libexec/hadoop-config.sh does not exist, then it falls back to developer environment setup.


> RPM packages broke bin/mapred script
> ------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048830#comment-13048830 ] 

Eric Yang commented on MAPREDUCE-2550:
--------------------------------------

Anyone wants to commit this?

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046168#comment-13046168 ] 

Aaron T. Myers commented on MAPREDUCE-2550:
-------------------------------------------

+1. I applied the patch to trunk and can confirm that `bin/mapred' did not work without this patch, and does work with it.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050576#comment-13050576 ] 

Todd Lipcon commented on MAPREDUCE-2550:
----------------------------------------

Sorry for slow response, I missed this in my jira box.

Eric: my point is that the next thing after "export HADOOP_PREFIX=..." is to source hadoop-config.sh (wherever it might be found). The first export in that file is to export HADOOP_PREFIX again. So regardless of whether this is a dev env or installed env, the export in mapred-config.sh should be redundant, no?

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated MAPREDUCE-2550:
---------------------------------

    Summary: bin/mapred no longer works from a source checkout  (was: RPM packages broke bin/mapred script)

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051277#comment-13051277 ] 

Hadoop QA commented on MAPREDUCE-2550:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12482952/MAPREDUCE-2550-2.patch
  against trunk revision 1136261.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these core unit tests:
                  org.apache.hadoop.cli.TestMRCLI
                  org.apache.hadoop.fs.TestFileSystem

    -1 contrib tests.  The patch failed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/404//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/404//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/404//console

This message is automatically generated.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050148#comment-13050148 ] 

Aaron T. Myers commented on MAPREDUCE-2550:
-------------------------------------------

Todd, are you satisfied with Eric's response to your question? If so, I'll go ahead and commit this.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated MAPREDUCE-2550:
---------------------------------

    Attachment: MAPREDUCE-2550-2.patch

Same patch with HADOOP_PREFIX removed from mapred-config.sh.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050149#comment-13050149 ] 

Aaron T. Myers commented on MAPREDUCE-2550:
-------------------------------------------

Never mind - I can't commit this since it's M/R. :P

Todd, are you satisfied with Eric's response to your question? If so, would you mind committing this?

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051318#comment-13051318 ] 

Todd Lipcon commented on MAPREDUCE-2550:
----------------------------------------

+1, I'll check this into trunk momentarily.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2550) RPM packages broke bin/mapred script

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043160#comment-13043160 ] 

Hadoop QA commented on MAPREDUCE-2550:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12481296/MAPREDUCE-2550-1.patch
  against trunk revision 1130554.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs.  The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these core unit tests:
                  org.apache.hadoop.cli.TestMRCLI

    +1 contrib tests.  The patch passed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/338//testReport/
Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/338//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/338//console

This message is automatically generated.

> RPM packages broke bin/mapred script
> ------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) RPM packages broke bin/mapred script

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043094#comment-13043094 ] 

Eric Yang commented on MAPREDUCE-2550:
--------------------------------------

bq. Does this change apply to trunk as well? I had been using the 
bq. HADOOP_HDFS_HOME/HADOOP_COMMON_HOME/HADOOP_MAPRED_HOME vars with trunk and it was pretty bq. much working until I updated today.

Hi Eric, yes, this patch applies to trunk.

> RPM packages broke bin/mapred script
> ------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) RPM packages broke bin/mapred script

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13041815#comment-13041815 ] 

Hadoop QA commented on MAPREDUCE-2550:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12480973/MAPREDUCE-2550.patch
  against trunk revision 1129771.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs.  The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/323//testReport/
Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/323//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/323//console

This message is automatically generated.

> RPM packages broke bin/mapred script
> ------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046173#comment-13046173 ] 

Todd Lipcon commented on MAPREDUCE-2550:
----------------------------------------

Do we need the following export?
+export HADOOP_PREFIX="${HADOOP_PREFIX:-$bin/..}"

the sourcing of {{hadoop-config.sh}} should set this to point at COMMON_HOME in dev env or the appropriate prefix in an installed env, right?

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057260#comment-13057260 ] 

Hudson commented on MAPREDUCE-2550:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #722 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/722/])
    

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051189#comment-13051189 ] 

Eric Yang commented on MAPREDUCE-2550:
--------------------------------------

Todd, thanks for catching the duplicates.  :)

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon updated MAPREDUCE-2550:
-----------------------------------

       Resolution: Fixed
    Fix Version/s:     (was: 0.20.3)
                   0.23.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

Committed to trunk, thanks Eric.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2550) RPM packages broke bin/mapred script

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated MAPREDUCE-2550:
---------------------------------

        Fix Version/s: 0.20.3
    Affects Version/s: 0.20.3
               Status: Patch Available  (was: Open)

> RPM packages broke bin/mapred script
> ------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2550) RPM packages broke bin/mapred script

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated MAPREDUCE-2550:
---------------------------------

    Attachment: MAPREDUCE-2550-1.patch

Modified the script to be more consistent for locating hadoop-config.sh.

> RPM packages broke bin/mapred script
> ------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang resolved MAPREDUCE-2550.
----------------------------------

    Resolution: Fixed

Arun updated the incremental changes of the script in MAPREDUCE-2885.  Resolve this as fixed.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046241#comment-13046241 ] 

Eric Yang commented on MAPREDUCE-2550:
--------------------------------------

bq. Do we need the following export?
bq. +export HADOOP_PREFIX="${HADOOP_PREFIX:-$bin/..}"

This is required for "ant tar" release tarball deployment without merging the artificates to the same directory, and used COMMON_HOME to drive environments.

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) RPM packages broke bin/mapred script

Posted by "Eric Caspole (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13041743#comment-13041743 ] 

Eric Caspole commented on MAPREDUCE-2550:
-----------------------------------------

Does this change apply to trunk as well? I had been using the HADOOP_HDFS_HOME/HADOOP_COMMON_HOME/HADOOP_MAPRED_HOME vars with trunk and it was pretty much working until I updated today.


> RPM packages broke bin/mapred script
> ------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.20.3
>
>         Attachments: MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051328#comment-13051328 ] 

Hudson commented on MAPREDUCE-2550:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #730 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/730/])
    MAPREDUCE-2550. Fix bin/mapred to work properly from within a source checkout. Contributed by Eric Yang.

todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1137017
Files : 
* /hadoop/common/trunk/mapreduce/bin/mapred-config.sh
* /hadoop/common/trunk/mapreduce/CHANGES.txt
* /hadoop/common/trunk/mapreduce/bin/start-mapred.sh
* /hadoop/common/trunk/mapreduce/bin/stop-mapred.sh
* /hadoop/common/trunk/mapreduce/bin/mapred


> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Reopened] (MAPREDUCE-2550) bin/mapred no longer works from a source checkout

Posted by "Ravi Prakash (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravi Prakash reopened MAPREDUCE-2550:
-------------------------------------


Commit 103374ed71a22d614e77e79ac816fc72fbf93463 (Revision 161793) on branch-0.23
mapred-config.sh searches for hadoop-config.sh in bin. Whereas after the recent mavenization and restructuring, if I had done 
{noformat} $ mvn -Pdist install {noformat} in the top level directory then, hadoop-config.sh is put in libexec.

Can we please include this case too?

> bin/mapred no longer works from a source checkout
> -------------------------------------------------
>
>                 Key: MAPREDUCE-2550
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2550
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.20.3
>         Environment: Java 6, Redhat 5.5
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2550-1.patch, MAPREDUCE-2550-2.patch, MAPREDUCE-2550.patch
>
>
> Developer may want to run hadoop without extracting tarball.  It would be nice if existing method to run mapred scripts from source code is preserved for developers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira