You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Todd Lipcon (Created) (JIRA)" <ji...@apache.org> on 2011/12/01 21:32:40 UTC
[jira] [Created] (HDFS-2623) HA: Add test case for hot standby
capability
HA: Add test case for hot standby capability
--------------------------------------------
Key: HDFS-2623
URL: https://issues.apache.org/jira/browse/HDFS-2623
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha, test
Affects Versions: HA branch (HDFS-1623)
Reporter: Todd Lipcon
Assignee: Todd Lipcon
Putting up a fairly test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2623) HA: Add test case for hot standby
capability
Posted by "Uma Maheswara Rao G (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174740#comment-13174740 ]
Uma Maheswara Rao G commented on HDFS-2623:
-------------------------------------------
Hi Todd,
Is this tests started passing for you now?
Still they are failing for me in local box (Windows).
java.io.IOException: The process cannot access the file because another process has locked a portion of the file
at java.io.FileInputStream.readBytes(Native Method)
at java.io.FileInputStream.read(FileInputStream.java:177)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:75)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:49)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:95)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:328)
at org.apache.hadoop.hdfs.MiniDFSCluster.copyNameDirs(MiniDFSCluster.java:672)
at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:616)
at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:542)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:274)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:102)
at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:256)
at org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyIsHot.testStandbyIsHot
Do i need to configure somethings extra here?
Thanks
Uma
> HA: Add test case for hot standby capability
> --------------------------------------------
>
> Key: HDFS-2623
> URL: https://issues.apache.org/jira/browse/HDFS-2623
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: HA branch (HDFS-1623)
>
> Attachments: hdfs-2623.txt
>
>
> Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2623) HA: Add test case for hot standby
capability
Posted by "Aaron T. Myers (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13161163#comment-13161163 ]
Aaron T. Myers commented on HDFS-2623:
--------------------------------------
+1, the test looks good to me. I think we might as well commit this now even if it doesn't yet pass. Agreed?
> HA: Add test case for hot standby capability
> --------------------------------------------
>
> Key: HDFS-2623
> URL: https://issues.apache.org/jira/browse/HDFS-2623
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: hdfs-2623.txt
>
>
> Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2623) HA: Add test case for hot standby
capability
Posted by "Uma Maheswara Rao G (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174959#comment-13174959 ]
Uma Maheswara Rao G commented on HDFS-2623:
-------------------------------------------
Ok Todd, will take a look.
yes, As i know locking is different in windows, like when one process is accessing a file then others can not delete. But in linux that is possible.
> HA: Add test case for hot standby capability
> --------------------------------------------
>
> Key: HDFS-2623
> URL: https://issues.apache.org/jira/browse/HDFS-2623
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: HA branch (HDFS-1623)
>
> Attachments: hdfs-2623.txt
>
>
> Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2623) HA: Add test case for hot standby
capability
Posted by "Todd Lipcon (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-2623:
------------------------------
Attachment: hdfs-2623.txt
Here's the test case. It doesn't currently pass due to some of the other open JIRAs that are still in flight, but will be useful for testing those JIRAs as they progress.
> HA: Add test case for hot standby capability
> --------------------------------------------
>
> Key: HDFS-2623
> URL: https://issues.apache.org/jira/browse/HDFS-2623
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: hdfs-2623.txt
>
>
> Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2623) HA: Add test case for hot standby
capability
Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174942#comment-13174942 ]
Todd Lipcon commented on HDFS-2623:
-----------------------------------
Hi Uma. Yes, it passes here on Linux... my guess is there's an issue related to Windows having different semantics for file locking... can you look into it? I have no Windows box to test on.
> HA: Add test case for hot standby capability
> --------------------------------------------
>
> Key: HDFS-2623
> URL: https://issues.apache.org/jira/browse/HDFS-2623
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: HA branch (HDFS-1623)
>
> Attachments: hdfs-2623.txt
>
>
> Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-2623) HA: Add test case for hot standby
capability
Posted by "Todd Lipcon (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HDFS-2623.
-------------------------------
Resolution: Fixed
Fix Version/s: HA branch (HDFS-1623)
Hadoop Flags: Reviewed
Committed the failing test case so we can all share it while working towards getting the hot-standby in working shape.
> HA: Add test case for hot standby capability
> --------------------------------------------
>
> Key: HDFS-2623
> URL: https://issues.apache.org/jira/browse/HDFS-2623
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: HA branch (HDFS-1623)
>
> Attachments: hdfs-2623.txt
>
>
> Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2623) HA: Add test case for hot standby
capability
Posted by "Todd Lipcon (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-2623:
------------------------------
Description: Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot" (was: Putting up a fairly test case I wrote that verifies that the standby is kept "hot")
> HA: Add test case for hot standby capability
> --------------------------------------------
>
> Key: HDFS-2623
> URL: https://issues.apache.org/jira/browse/HDFS-2623
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ha, test
> Affects Versions: HA branch (HDFS-1623)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
>
> Putting up a fairly simple test case I wrote that verifies that the standby is kept "hot"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira