You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2011/05/28 02:00:54 UTC
[jira] [Created] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
LocalDirAllocator improvements for MR-2178
------------------------------------------
Key: HADOOP-7338
URL: https://issues.apache.org/jira/browse/HADOOP-7338
Project: Hadoop Common
Issue Type: Improvement
Affects Versions: 0.22.0
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Fix For: 0.22.0
Attachments: hadoop-7338.txt
These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
commit 446e41f2424ddc866770cda677450c18feeb597f
Author: Chris Douglas <cd...@apache.org>
Date: Sun Oct 3 02:00:15 2010 -0700
Apply y201 to trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HADOOP-7338:
--------------------------------
Attachment: hadoop-7338.txt
Attaching patch from yahoo-merge. This probably needs a couple unit tests.
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: 0.22.0
>
> Attachments: hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko resolved HADOOP-7338.
-----------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
+1
I just committed this to branch 0.22.1. Thank you Benoy.
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Benoy Antony
> Fix For: 0.22.1
>
> Attachments: hadoop-7338-022.patch, hadoop-7338.patch, hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated HADOOP-7338:
---------------------------------
Status: Open (was: Patch Available)
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Benoy Antony
> Fix For: 0.22.1
>
> Attachments: hadoop-7338.patch, hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Konstantin Shvachko (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HADOOP-7338:
----------------------------------------
Fix Version/s: (was: 0.22.0)
0.22.1
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: 0.22.1
>
> Attachments: hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271944#comment-13271944 ]
Hadoop QA commented on HADOOP-7338:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12526237/hadoop-7338.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/974//console
This message is automatically generated.
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Benoy Antony
> Fix For: 0.22.1
>
> Attachments: hadoop-7338.patch, hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated HADOOP-7338:
---------------------------------
Attachment: hadoop-7338.patch
This patch basically uses the original patch, but made changes so that it compiles with the current code.
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: 0.22.1
>
> Attachments: hadoop-7338.patch, hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated HADOOP-7338:
---------------------------------
Assignee: Benoy Antony (was: Todd Lipcon)
Status: Patch Available (was: Open)
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Benoy Antony
> Fix For: 0.22.1
>
> Attachments: hadoop-7338.patch, hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058632#comment-13058632 ]
Nigel Daley commented on HADOOP-7338:
-------------------------------------
>From Hadoop Dev Mtg 7/1/11: Owen will try to get more context on this from the Y! branch merge.
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: 0.22.0
>
> Attachments: hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated HADOOP-7338:
---------------------------------
Attachment: hadoop-7338-022.patch
new patch is attached.
The unused function which returns all paths are removed.
Also added a unit test to test the case when checkwrite is set to false.
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Benoy Antony
> Fix For: 0.22.1
>
> Attachments: hadoop-7338-022.patch, hadoop-7338.patch, hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7338) LocalDirAllocator improvements for
MR-2178
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289262#comment-13289262 ]
Hudson commented on HADOOP-7338:
--------------------------------
Integrated in Hadoop-Common-22-branch #106 (See [https://builds.apache.org/job/Hadoop-Common-22-branch/106/])
HADOOP-7338. LocalDirAllocator improvements for MR-2178. Contributed by Benoy Antony. (Revision 1346212)
Result = SUCCESS
shv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346212
Files :
* /hadoop/common/branches/branch-0.22/common/CHANGES.txt
* /hadoop/common/branches/branch-0.22/common/src/java/org/apache/hadoop/fs/LocalDirAllocator.java
* /hadoop/common/branches/branch-0.22/common/src/test/core/org/apache/hadoop/fs/TestLocalDirAllocator.java
> LocalDirAllocator improvements for MR-2178
> ------------------------------------------
>
> Key: HADOOP-7338
> URL: https://issues.apache.org/jira/browse/HADOOP-7338
> Project: Hadoop Common
> Issue Type: Improvement
> Affects Versions: 0.22.0
> Reporter: Todd Lipcon
> Assignee: Benoy Antony
> Fix For: 0.22.1
>
> Attachments: hadoop-7338-022.patch, hadoop-7338.patch, hadoop-7338.txt
>
>
> These are some changes that come from the following yahoo-merge commit, necessary for MAPREDUCE-2178 to build.
> commit 446e41f2424ddc866770cda677450c18feeb597f
> Author: Chris Douglas <cd...@apache.org>
> Date: Sun Oct 3 02:00:15 2010 -0700
>
> Apply y201 to trunk
>
> git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/yahoo-merge@1079151 13f79535-47bb-0310-9956-ffa450edef68
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira