You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Hairong Kuang (JIRA)" <ji...@apache.org> on 2009/10/23 02:35:59 UTC
[jira] Created: (HDFS-728) Creat a comprehensive functional test
for append
Creat a comprehensive functional test for append
------------------------------------------------
Key: HDFS-728
URL: https://issues.apache.org/jira/browse/HDFS-728
Project: Hadoop HDFS
Issue Type: New Feature
Affects Versions: 0.21.0
Reporter: Hairong Kuang
Fix For: 0.21.0
This test aims to do
1. create a file of len1;
2. reopen the file for append;
3. write len2 bytes to the file and hflush;
4. write len3 bytes to the file and close the file;
5. validate the content of the file.
Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-728) Create a comprehensive functional test
for append
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-728:
-------------------------------
Issue Type: Improvement (was: New Feature)
Summary: Create a comprehensive functional test for append (was: Creat a comprehensive functional test for append)
> Create a comprehensive functional test for append
> -------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769400#action_12769400 ]
Konstantin Boudnik commented on HDFS-728:
-----------------------------------------
I've ran the test by the means of Ant build and it hands after 15 minutes. Apparently it happens after JUnit timeout is reached.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Create a comprehensive functional test
for append
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12775228#action_12775228 ]
Hudson commented on HDFS-728:
-----------------------------
Integrated in Hdfs-Patch-h5.grid.sp2.yahoo.net #100 (See [http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/100/])
> Create a comprehensive functional test for append
> -------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769448#action_12769448 ]
Tsz Wo (Nicholas), SZE commented on HDFS-728:
---------------------------------------------
> ... You can name the test appropriately so that it doesn't get picked up by the test target (simply don't start the test class name with the word Test). ...
We have already moved to junit 4 and so we are using the @Test annotation. The name of the test does not matter.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang resolved HDFS-728.
--------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
I've committed this!
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Create a comprehensive functional test
for append
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770302#action_12770302 ]
Hudson commented on HDFS-728:
-----------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #85 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/85/])
. Create a comprehensive functional test for append. Contributed by Hairong Kuang.
> Create a comprehensive functional test for append
> -------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770212#action_12770212 ]
Konstantin Boudnik commented on HDFS-728:
-----------------------------------------
+1 patch looks good
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769410#action_12769410 ]
Hairong Kuang commented on HDFS-728:
------------------------------------
This test is not intended as a junit test. Instead, it should run as an application from the command line.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769289#action_12769289 ]
Konstantin Boudnik commented on HDFS-728:
-----------------------------------------
Actually, I'm confused - HDFS-522 is about stress tests for append. Please disregard the comment above
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Boudnik updated HDFS-728:
------------------------------------
Attachment: HDFS-728.patch
What I can offer on another hand is to run this 'comprehensive' test under JUnit control. However, in order to avoid timeout issues it needs to be split in a few smaller sub-tests.
And the mini-cluster is needed to be brought up only one per class in this case.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769443#action_12769443 ]
Nigel Daley commented on HDFS-728:
----------------------------------
Hairong, please write this as a Junit test. You can name the test appropriately so that it doesn't get picked up by the test target (simply don't start the test class name with the word Test). We should then file a Jira to add a functional test target to Ant that can pick up this and other similar tests.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770174#action_12770174 ]
Konstantin Boudnik commented on HDFS-728:
-----------------------------------------
And, the target creation has to be done as a separate JIRA's patch
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769414#action_12769414 ]
Konstantin Boudnik commented on HDFS-728:
-----------------------------------------
Right, I've understood this. My question is: "How do we suppose to run it in Hudson then?"
It has to be executed by Hudson on a regular basis if it suppose to be a part of standard development cycle. Shell it be moved to a special load (or stressful) test suite? It might be an open discussion for this. However, there's no way to run a command line application as a part of CI build/test cycle.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769450#action_12769450 ]
Tsz Wo (Nicholas), SZE commented on HDFS-728:
---------------------------------------------
>> ... You can name the test appropriately so that it doesn't get picked up by the test target (simply don't start the test class name with the word Test). ...
>
> We have already moved to junit 4 and so we are using the @Test annotation. The name of the test does not matter.
It is not true. Only the method name does not matter but not the class name.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang reassigned HDFS-728:
----------------------------------
Assignee: Hairong Kuang
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770172#action_12770172 ]
Hairong Kuang commented on HDFS-728:
------------------------------------
For this issue, I plan to take Nigel's suggestion for now.
> this is clearly a functional test, so it make sense to create a separate directory structure like test/src/functional.
+1. This is the way to go! We also need a new target in build.xml. Shall we do it in a different jira?
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-728:
-------------------------------
Attachment: appendTest1.patch
This patch makes the test to be a unit test and changes the class name not to start with Test. Part of the patch came from Cos' patch. Thanks Cos!
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Create a comprehensive functional test
for append
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771240#action_12771240 ]
Hudson commented on HDFS-728:
-----------------------------
Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #65 (See [http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h2.grid.sp2.yahoo.net/65/])
> Create a comprehensive functional test for append
> -------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769446#action_12769446 ]
Konstantin Boudnik commented on HDFS-728:
-----------------------------------------
Merging together last two comments and adding some thoughts on top:
- no split of the test case is required then. So, my patch could be modified slightly and seems to be good to go.
- this is clearly a functional test, so it make sense to create a separate directory structure like {{test/src/functional}}
- for this new target a different timeout settings would be required
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HDFS-728) Create a comprehensive functional test
for append
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770497#action_12770497 ]
Hudson commented on HDFS-728:
-----------------------------
Integrated in Hadoop-Hdfs-trunk #122 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Hdfs-trunk/122/])
. Create a comprehensive functional test for append. Contributed by Hairong Kuang.
> Create a comprehensive functional test for append
> -------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch, appendTest1.patch, HDFS-728.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-728) Creat a comprehensive functional test
for append
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hairong Kuang updated HDFS-728:
-------------------------------
Attachment: appendTest.patch
Here is a patch that implements the above idea.
> Creat a comprehensive functional test for append
> ------------------------------------------------
>
> Key: HDFS-728
> URL: https://issues.apache.org/jira/browse/HDFS-728
> Project: Hadoop HDFS
> Issue Type: New Feature
> Affects Versions: 0.21.0
> Reporter: Hairong Kuang
> Fix For: 0.21.0
>
> Attachments: appendTest.patch
>
>
> This test aims to do
> 1. create a file of len1;
> 2. reopen the file for append;
> 3. write len2 bytes to the file and hflush;
> 4. write len3 bytes to the file and close the file;
> 5. validate the content of the file.
> Len1 ranges from [0, 2*BLOCK_SIZE+1], len2 ranges from [0, BLOCK_SIZE+1], and len3 ranges from [0, BLOCK_SIZE+1]. The test tries all combination of len1, len2, and len3. To minimize the running time, bytes per checksum is set to be 4 bytes, each packet size is set to be bytes per checksum, and each block contains 2 packets.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.