You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Todd Lipcon (Created) (JIRA)" <ji...@apache.org> on 2011/12/15 21:07:31 UTC
[jira] [Created] (HDFS-2688) HA: write tests for quota tracking and
HA
HA: write tests for quota tracking and HA
-----------------------------------------
Key: HDFS-2688
URL: https://issues.apache.org/jira/browse/HDFS-2688
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha, test
Affects Versions: HA branch (HDFS-1623)
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Quota is one of the areas I suspect we might have bugs in the current state HA implementation. We need to track quotas correctly on the standby so that when a failover occurs, all of the stats are up to date. Let's add some functional tests that exercise quotas during failover/failback.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2688) HA: write tests for quota tracking and
HA
Posted by "Todd Lipcon (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-2688:
------------------------------
Attachment: hdfs-2688.txt
Yep, good catch. I'll commit this version of the patch which fixes the argument ordering. Thanks
> HA: write tests for quota tracking and HA
> -----------------------------------------
>
> Key: HDFS-2688
> URL: https://issues.apache.org/jira/browse/HDFS-2688
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: hdfs-2688.txt, hdfs-2688.txt
>
>
> Quota is one of the areas I suspect we might have bugs in the current state HA implementation. We need to track quotas correctly on the standby so that when a failover occurs, all of the stats are up to date. Let's add some functional tests that exercise quotas during failover/failback.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2688) HA: write tests for quota tracking
and HA
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191369#comment-13191369 ]
Eli Collins commented on HDFS-2688:
-----------------------------------
+1 looks good.
Nit: NS/DS_QUOTA and expectedSize should be the 1st parameter to assertEquals.
> HA: write tests for quota tracking and HA
> -----------------------------------------
>
> Key: HDFS-2688
> URL: https://issues.apache.org/jira/browse/HDFS-2688
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: hdfs-2688.txt
>
>
> Quota is one of the areas I suspect we might have bugs in the current state HA implementation. We need to track quotas correctly on the standby so that when a failover occurs, all of the stats are up to date. Let's add some functional tests that exercise quotas during failover/failback.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-2688) HA: write tests for quota tracking
and HA
Posted by "Todd Lipcon (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HDFS-2688.
-------------------------------
Resolution: Fixed
Fix Version/s: HA branch (HDFS-1623)
Hadoop Flags: Reviewed
> HA: write tests for quota tracking and HA
> -----------------------------------------
>
> Key: HDFS-2688
> URL: https://issues.apache.org/jira/browse/HDFS-2688
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: HA branch (HDFS-1623)
>
> Attachments: hdfs-2688.txt, hdfs-2688.txt
>
>
> Quota is one of the areas I suspect we might have bugs in the current state HA implementation. We need to track quotas correctly on the standby so that when a failover occurs, all of the stats are up to date. Let's add some functional tests that exercise quotas during failover/failback.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2688) HA: write tests for quota tracking and
HA
Posted by "Todd Lipcon (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-2688:
------------------------------
Attachment: hdfs-2688.txt
Here's a simple test which makes sure the space and ns quotas are properly tracked through changes applied by the edit tailer.
> HA: write tests for quota tracking and HA
> -----------------------------------------
>
> Key: HDFS-2688
> URL: https://issues.apache.org/jira/browse/HDFS-2688
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: hdfs-2688.txt
>
>
> Quota is one of the areas I suspect we might have bugs in the current state HA implementation. We need to track quotas correctly on the standby so that when a failover occurs, all of the stats are up to date. Let's add some functional tests that exercise quotas during failover/failback.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2688) HA: write tests for quota tracking
and HA
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192106#comment-13192106 ]
Hudson commented on HDFS-2688:
------------------------------
Integrated in Hadoop-Hdfs-HAbranch-build #57 (See [https://builds.apache.org/job/Hadoop-Hdfs-HAbranch-build/57/])
HDFS-2688. Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon.
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1235017
Files :
* /hadoop/common/branches/HDFS-1623/hadoop-hdfs-project/hadoop-hdfs/CHANGES.HDFS-1623.txt
* /hadoop/common/branches/HDFS-1623/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestQuotasWithHA.java
> HA: write tests for quota tracking and HA
> -----------------------------------------
>
> Key: HDFS-2688
> URL: https://issues.apache.org/jira/browse/HDFS-2688
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: HA branch (HDFS-1623)
>
> Attachments: hdfs-2688.txt, hdfs-2688.txt
>
>
> Quota is one of the areas I suspect we might have bugs in the current state HA implementation. We need to track quotas correctly on the standby so that when a failover occurs, all of the stats are up to date. Let's add some functional tests that exercise quotas during failover/failback.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira