You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Milind Bhandarkar (JIRA)" <ji...@apache.org> on 2011/08/02 23:12:41 UTC

[jira] [Created] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Remove Linux task-controller from 0.22 branch
---------------------------------------------

                 Key: MAPREDUCE-2767
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: security
    Affects Versions: 0.22.0
            Reporter: Milind Bhandarkar
            Assignee: Milind Bhandarkar
            Priority: Blocker
             Fix For: 0.22.0


There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Status: Open  (was: Patch Available)

Cancelling patch, and re-submitting to see if the (now available) jenkins picks it up.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment: MR2767.patch

Removed LinuxTaskController, associated tests, and C++ files. Modified build.xml to not build task-controller.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094794#comment-13094794 ] 

Hadoop QA commented on MAPREDUCE-2767:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12492500/MR2767new.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 46 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/574//console

This message is automatically generated.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch, MR2767new.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13096109#comment-13096109 ] 

Milind Bhandarkar commented on MAPREDUCE-2767:
----------------------------------------------

Re: FindBugs warnings. These are not new. In fact none of these directories (all in mrv2 code) have been touched by the patch.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13080229#comment-13080229 ] 

Aaron T. Myers commented on MAPREDUCE-2767:
-------------------------------------------

Hey Milind, I'm pretty sure you have to actually attach a new patch. Simply going Patch Available -> Open -> Patch Available isn't sufficient, I believe.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Status: Open  (was: Patch Available)

Following @atm's directions.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098410#comment-13098410 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #839 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/839/])
    MAPREDUCE-2767. CHANGES.txt

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165894
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098372#comment-13098372 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #837 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/837/])
    MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165864
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/.autom4te.cfg
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/Makefile.am
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configure.ac
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/main.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/tests/test-task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/ClusterWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestDebugScriptWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobExecutionAsDifferentUser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestKillSubProcessesWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestTrackerDistributedCacheManagerWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/pipes/TestPipesAsDifferentUser.java


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Status: Patch Available  (was: Open)

Dear jenkins, please pick up the patch.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095809#comment-13095809 ] 

Hadoop QA commented on MAPREDUCE-2767:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12492662/MR2767-trunk.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 46 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/585//console

This message is automatically generated.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095556#comment-13095556 ] 

Milind Bhandarkar commented on MAPREDUCE-2767:
----------------------------------------------

@Arun, LTC changes made in 0.20.203 have not propagated to 0.23 and trunk ? I thought the race condition fix is already in trunk/0.23, no ?

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098834#comment-13098834 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Mapreduce-22-branch #66 (See [https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/66/])
    MAPREDUCE-2767. Remove Linux task-controller from 0.22 branch. Contributed by Milind Bhandarkar.

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165914
Files : 
* /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
* /hadoop/common/branches/branch-0.22/mapreduce/build.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/.autom4te.cfg
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/Makefile.am
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/configuration.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/configuration.h
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/configure.ac
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/main.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/task-controller.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/task-controller.h
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/tests/test-task-controller.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/ClusterWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestDebugScriptWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobExecutionAsDifferentUser.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestKillSubProcessesWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestTrackerDistributedCacheManagerWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/pipes/TestPipesAsDifferentUser.java


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment: MR2767-trunk.patch

Removing conflict in trunk due to recent commits. Re-did patch for trunk.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095560#comment-13095560 ] 

Mahadev konar commented on MAPREDUCE-2767:
------------------------------------------

@Milind,
 There is a newer version of LTC in 
{code}
hadoop-yarn-server-nodemanager/src/main/c/container-executor/
{code}
which fixes all the issues, but the MRv1 version is still there and needs to be removed:

{code}
hadoop-mapreduce-project/src/c++/task-controller
{code}




> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Status: Patch Available  (was: Open)

Submitting for tests to run.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289419#comment-13289419 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Mapreduce-22-branch #104 (See [https://builds.apache.org/job/Hadoop-Mapreduce-22-branch/104/])
    MAPREDUCE-4240. Revert MAPREDUCE-2767. Contributed by Benoy Antony. (Revision 1346206)

     Result = SUCCESS
shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346206
Files : 
* /hadoop/common/branches/branch-0.22/mapreduce/CHANGES.txt
* /hadoop/common/branches/branch-0.22/mapreduce/build.xml
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/.autom4te.cfg
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/Makefile.am
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/configuration.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/configuration.h
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/configure.ac
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/main.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/task-controller.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/task-controller.h
* /hadoop/common/branches/branch-0.22/mapreduce/src/c++/task-controller/tests/test-task-controller.c
* /hadoop/common/branches/branch-0.22/mapreduce/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/ClusterWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestDebugScriptWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobExecutionAsDifferentUser.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestKillSubProcessesWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestTrackerDistributedCacheManagerWithLinuxTaskController.java
* /hadoop/common/branches/branch-0.22/mapreduce/src/test/mapred/org/apache/hadoop/mapred/pipes/TestPipesAsDifferentUser.java

                
> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098412#comment-13098412 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #850 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/850/])
    MAPREDUCE-2767. CHANGES.txt

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165894
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13080496#comment-13080496 ] 

Milind Bhandarkar commented on MAPREDUCE-2767:
----------------------------------------------

That will cause test-failures etc. I think removing it entirely is the cleanest way of turning it off.


---
Milind Bhandarkar
(typing on glass, please ignore spelling mistakes)




> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094908#comment-13094908 ] 

Milind Bhandarkar commented on MAPREDUCE-2767:
----------------------------------------------

Re: the comment by Hadoop QA: this patch is not for trunk. It's only for 0.22 branch.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Konstantin Shvachko updated MAPREDUCE-2767:
-------------------------------------------

    Status: Patch Available  (was: Open)

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Konstantin Shvachko updated MAPREDUCE-2767:
-------------------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

I just committed this. Thank you Milind.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment:     (was: MR2767.patch)

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095561#comment-13095561 ] 

Milind Bhandarkar commented on MAPREDUCE-2767:
----------------------------------------------

Aha. Okay, will do.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Status: Patch Available  (was: Open)

Making patch available for trunk.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13096082#comment-13096082 ] 

Hadoop QA commented on MAPREDUCE-2767:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12492764/MR2767-trunk.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 46 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    -1 findbugs.  The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in hadoop-mapreduce-project.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-hs.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-shuffle.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-app.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-jobclient.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-api.html
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/587//console

This message is automatically generated.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Affects Version/s: 0.24.0
                       0.23.0
        Fix Version/s: 0.24.0
                       0.23.0

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment:     (was: MR2767-trunk.patch)

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13080487#comment-13080487 ] 

Konstantin Shvachko commented on MAPREDUCE-2767:
------------------------------------------------

Aren't we trying to remove the entire palm because one nail grew ugly?
We can just turn it off by throwing, e.g. UnsupportedOperationException on an attempt to use it. And then turn it back on when the fix is provided.


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment: MR2767.patch

Attaching the same patch as before for jenkins to pick up.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-2767:
-------------------------------------

    Status: Open  (was: Patch Available)

Milind, you need to do this for trunk, 0.22 and 0.23 - we shouldn't have the LTC in any branch. Can you please provide a patch? Thanks.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment:     (was: MR2767.patch)

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098884#comment-13098884 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #786 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/786/])
    MAPREDUCE-2767. CHANGES.txt
MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165894
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165864
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/.autom4te.cfg
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/Makefile.am
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configure.ac
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/main.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/tests/test-task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/ClusterWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestDebugScriptWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobExecutionAsDifferentUser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestKillSubProcessesWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestTrackerDistributedCacheManagerWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/pipes/TestPipesAsDifferentUser.java


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Status: Patch Available  (was: Open)

Patch submitted for hudson testing. Tested locally.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098411#comment-13098411 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #916 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/916/])
    MAPREDUCE-2767. CHANGES.txt

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165894
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094719#comment-13094719 ] 

Milind Bhandarkar commented on MAPREDUCE-2767:
----------------------------------------------

For some time after the merge of three projects (common, hdfs, mapreduce), the test-patch ant target was broken (since it tried to apply the patch from inside the mapreduce directory (where build.xml exists), whereas the patch is generated from the top level. This never got fixed in the 0.22 branch, and so my "ant test-patch" is failing in the patch application step.

After manually applying the patch, I ran ant test in mapreduce directory, and I get only unrelated failures.


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098397#comment-13098397 ] 

Arun C Murthy commented on MAPREDUCE-2767:
------------------------------------------

Konstantin - can you pls merge the trunk commit to branch-0.23 too? Thanks.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment: MR2767-trunk.patch
                MR2767-23.patch
                MR2767-22.patch

Attaching patches for 0.22, 0.23, and trunk.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098909#comment-13098909 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #809 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/809/])
    MAPREDUCE-2767. CHANGES.txt
MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165894
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165864
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/.autom4te.cfg
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/Makefile.am
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configure.ac
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/main.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/tests/test-task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/ClusterWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestDebugScriptWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobExecutionAsDifferentUser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestKillSubProcessesWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestTrackerDistributedCacheManagerWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/pipes/TestPipesAsDifferentUser.java


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098379#comment-13098379 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #848 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/848/])
    MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165864
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/.autom4te.cfg
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/Makefile.am
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configure.ac
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/main.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/tests/test-task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/ClusterWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestDebugScriptWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobExecutionAsDifferentUser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestKillSubProcessesWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestTrackerDistributedCacheManagerWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/pipes/TestPipesAsDifferentUser.java


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098375#comment-13098375 ] 

Hudson commented on MAPREDUCE-2767:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #914 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/914/])
    MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.

shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1165864
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/build.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/.autom4te.cfg
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/Makefile.am
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configuration.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/configure.ac
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/main.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/task-controller.h
* /hadoop/common/trunk/hadoop-mapreduce-project/src/c++/task-controller/tests/test-task-controller.c
* /hadoop/common/trunk/hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/LinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/ClusterWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestDebugScriptWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobExecutionAsDifferentUser.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestKillSubProcessesWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestLocalizationWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestTrackerDistributedCacheManagerWithLinuxTaskController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/pipes/TestPipesAsDifferentUser.java


> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment: MR2767new.patch

New patch that fixes the build.xml merge issues.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767.patch, MR2767new.patch
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment:     (was: MR2767new.patch)

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Status: Open  (was: Patch Available)

Cancelling, and re-making patch-available.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0, 0.23.0, 0.24.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0, 0.23.0, 0.24.0
>
>         Attachments: MR2767-22.patch, MR2767-23.patch, MR2767-trunk.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094913#comment-13094913 ] 

Hadoop QA commented on MAPREDUCE-2767:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12492529/TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 152 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/580//console

This message is automatically generated.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2767) Remove Linux task-controller from 0.22 branch

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Milind Bhandarkar updated MAPREDUCE-2767:
-----------------------------------------

    Attachment: TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt
                testlog.txt

Attaching the log of "ant test". There were two failures: testMiniMRChildTask, and testDFSIO. testDFSIO is definitely unrelated. I have attached testMiniMRChildTask log, which looks unrelated as well.

> Remove Linux task-controller from 0.22 branch
> ---------------------------------------------
>
>                 Key: MAPREDUCE-2767
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2767
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 0.22.0
>            Reporter: Milind Bhandarkar
>            Assignee: Milind Bhandarkar
>            Priority: Blocker
>             Fix For: 0.22.0
>
>         Attachments: MR2767new.patch, TEST-org.apache.hadoop.mapred.TestMiniMRChildTask.txt, testlog.txt
>
>
> There's a potential security hole in the task-controller as it stands. Based on the discussion on general@, removing task-controller from the 0.22 branch will pave way for 0.22.0 release. (This was done for the 0.21.0 release as well: see MAPREDUCE-2014.) We can roll a 0.22.1 release with the task-controller when it is fixed.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira