You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Tanping Wang (JIRA)" <ji...@apache.org> on 2011/02/23 00:12:38 UTC
[jira] Created: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
------------------------------------------------------------------------------------------------------
Key: HDFS-1632
URL: https://issues.apache.org/jira/browse/HDFS-1632
Project: Hadoop HDFS
Issue Type: New Feature
Components: data-node
Affects Versions: Federation Branch
Reporter: Tanping Wang
Assignee: Tanping Wang
Fix For: Federation Branch
In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998474#comment-12998474 ]
Suresh Srinivas commented on HDFS-1632:
---------------------------------------
I have reviewed this change before. +1 for the change.
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998529#comment-12998529 ]
Suresh Srinivas commented on HDFS-1632:
---------------------------------------
Todd, we plan to do that for all the jiras. In this case most of what is implemented is from the attached design document.
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Tanping Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998130#comment-12998130 ]
Tanping Wang commented on HDFS-1632:
------------------------------------
ant test-patch
[exec] BUILD SUCCESSFUL
[exec] Total time: 33 seconds
[exec]
[exec]
[exec]
[exec]
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 12 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
[exec] +1 system tests framework. The patch passed system tests framework compile.
[exec]
[exec]
[exec]
[exec]
[exec] ======================================================================
[exec] ======================================================================
[exec] Finished build.
[exec] ======================================================================
[exec] ======================================================================
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Tanping Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tanping Wang updated HDFS-1632:
-------------------------------
Attachment: HDFS-1632.patch
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas resolved HDFS-1632.
-----------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
I committed the patch. Thank you Tanping.
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998624#comment-12998624 ]
Suresh Srinivas commented on HDFS-1632:
---------------------------------------
As I posted in another jira, this commit is to a feature branch and not trunk. As was posted earlier by Owen in the mailing list, instead of posting a jumbo patch, we are creating smaller jiras, describing the change and posting smaller patches.
Please comment on these jiras, irrespective of whether it is committed or not. If you do not do it now, there is an opportunity to comment again, when federation branch gets merged to the trunk.
All comments will be considered and new jiras will be created to address the required changes.
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Tanping Wang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tanping Wang updated HDFS-1632:
-------------------------------
Issue Type: Sub-task (was: New Feature)
Parent: HDFS-1052
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998523#comment-12998523 ]
Todd Lipcon commented on HDFS-1632:
-----------------------------------
Hi Suresh. Would you mind copy-pasting your internal review to the ASF JIRA? This will help others understand the code and will make it easier to merge this branch into trunk when the time comes, I think.
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HDFS-1632:
----------------------------------
Attachment: Federation-upgrade.htm
Storage directory changes and upgrade design for federation.
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HDFS-1632) HDFS Federation: data node storage
structure changes and introduce block pool storage for Federation.
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998562#comment-12998562 ]
Allen Wittenauer commented on HDFS-1632:
----------------------------------------
I'm half tempted to -1 this on basic principle. It was impossible for anyone outside of Y! to review this before it got committed to trunk.
> HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-1632
> URL: https://issues.apache.org/jira/browse/HDFS-1632
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: data-node
> Affects Versions: Federation Branch
> Reporter: Tanping Wang
> Assignee: Tanping Wang
> Fix For: Federation Branch
>
> Attachments: Federation-upgrade.htm, HDFS-1632.patch
>
>
> In Federation, we introduced block pool into HDFS. We are making changes to data node storage and and block pool storage.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira