You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Giridharan Kesavan (Created) (JIRA)" <ji...@apache.org> on 2011/12/21 22:33:31 UTC
[jira] [Created] (HBASE-5085) fix test-patch script from setting
the ulimit
fix test-patch script from setting the ulimit
---------------------------------------------
Key: HBASE-5085
URL: https://issues.apache.org/jira/browse/HBASE-5085
Project: HBase
Issue Type: Bug
Reporter: Giridharan Kesavan
Assignee: Giridharan Kesavan
test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175005#comment-13175005 ]
stack commented on HBASE-5085:
------------------------------
I applied the patch last night but it seems to have no effect when this issue was submitted to hadoop-qa again (I'll retry just to be sure to be sure).
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Status: Patch Available (was: Open)
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Status: Patch Available (was: Open)
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, 5085-v4-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Status: Open (was: Patch Available)
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Zhihong Yu (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Yu updated HBASE-5085:
------------------------------
Status: Patch Available (was: Open)
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "nkeywal (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174457#comment-13174457 ]
nkeywal commented on HBASE-5085:
--------------------------------
Would it be possible to change "max user processes (-u) 2048" as well? This limit is used for java native threads as well, and HBase uses a lot of them.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Giridharan Kesavan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Giridharan Kesavan updated HBASE-5085:
--------------------------------------
Attachment: hbase-5085.patch
patch removes the ulimit setting in the test-patch script
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Resolution: Fixed
Fix Version/s: 0.94.0
Status: Resolved (was: Patch Available)
Closing. In console for hadoop-qa can see that file descriptors are indeed now at 60k rather than at 1024. If max processes is not north of 2k, will go bug Giri offline again.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.94.0
>
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, 5085-v4-experiment.txt, 5085-v5.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174941#comment-13174941 ]
Zhihong Yu commented on HBASE-5085:
-----------------------------------
I suggest adding call to whoami or id in test-patch.sh so that we can know the effective user running the tests.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "nkeywal (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175374#comment-13175374 ]
nkeywal commented on HBASE-5085:
--------------------------------
On prebuild #584, we have:
open files (-n) 60000
max user processes (-u) 10240
This should be ok, trying immediately.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.94.0
>
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, 5085-v4-experiment.txt, 5085-v5.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Attachment: 5085-v2-experiment.txt
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175011#comment-13175011 ]
Hadoop QA commented on HBASE-5085:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508423/5085-v4-experiment.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/581//console
This message is automatically generated.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, 5085-v4-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174638#comment-13174638 ]
Zhihong Yu commented on HBASE-5085:
-----------------------------------
Looking at https://builds.apache.org/job/PreCommit-HBASE-Build/579/console, it seems patch v3 wasn't effective either.
We should check in either v2 or v3 and observe other PreCommit builds.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Attachment: 5085-v4-experiment.txt
v4 is same as v3
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, 5085-v4-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Zhihong Yu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174431#comment-13174431 ]
Zhihong Yu commented on HBASE-5085:
-----------------------------------
+1 on patch.
Let's see what result Hadoop QA would give us based on this patch.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174583#comment-13174583 ]
Hadoop QA commented on HBASE-5085:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508326/5085-v2-experiment.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated -152 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 76 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.mapred.TestTableMapReduce
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/576//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/576//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/576//console
This message is automatically generated.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Attachment: 5085-v2-experiment.txt
Experiment.... try setting the ulimits higher in script in the runTest method
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174649#comment-13174649 ]
stack commented on HBASE-5085:
------------------------------
Good idea. I checked in 5085-v3-experiment.txt. Let me retrigger this hadoop-qa build and see if it does anything.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Status: Open (was: Patch Available)
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Attachment: 5085-v5.txt
It looks like my committing of patch last night did the trick. My patch had Giri's removal of setting the ulimit down to 1024 for open files. Giri says he just upped the max processes per user to 10240 on all hadoop-qa machines. This patch cleans the 'experimental' part of last nights patch. I committed it to trunk.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Fix For: 0.94.0
>
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, 5085-v4-experiment.txt, 5085-v5.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Giridharan Kesavan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174932#comment-13174932 ]
Giridharan Kesavan commented on HBASE-5085:
-------------------------------------------
this patch cannot be submitted to test-patch as we are patching test-patch script itself. Only option is to review and commit or manually run the test-patch after applying the patch.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Giridharan Kesavan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174960#comment-13174960 ]
Giridharan Kesavan commented on HBASE-5085:
-------------------------------------------
The effective user is jenkins as the jenkins slave is launched to run as jenkins user. This should not matter much b'coz the ulimit is set to all the users system wide except root. Also Im very sure that the system wide ulimit would come into effect when we remove the override set in the test-patch.sh. (which is my initial patch).
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Status: Patch Available (was: Open)
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Status: Open (was: Patch Available)
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174677#comment-13174677 ]
Hadoop QA commented on HBASE-5085:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508348/5085-v3-experiment.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated -152 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 76 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.client.TestInstantSchemaChange
org.apache.hadoop.hbase.regionserver.wal.TestLogRolling
org.apache.hadoop.hbase.mapred.TestTableMapReduce
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/579//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/579//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/579//console
This message is automatically generated.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174822#comment-13174822 ]
Hudson commented on HBASE-5085:
-------------------------------
Integrated in HBase-TRUNK #2568 (See [https://builds.apache.org/job/HBase-TRUNK/2568/])
HBASE-5085 fix test-patch script from setting the ulimit -- EXPERIMENT
stack :
Files :
* /hbase/trunk/dev-support/test-patch.sh
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Attachment: 5085-v3-experiment.txt
The previous run did not use my patch. Retrying.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174828#comment-13174828 ]
stack commented on HBASE-5085:
------------------------------
So, my script changes have still not been noticed. Maybe the script has to be checked out by Giri for changes to take effect.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174516#comment-13174516 ]
Hadoop QA commented on HBASE-5085:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508303/hbase-5085.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 4 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated -152 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 76 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.client.TestInstantSchemaChange
org.apache.hadoop.hbase.mapred.TestTableMapReduce
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/574//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/574//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/574//console
This message is automatically generated.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5085) fix test-patch script from setting
the ulimit
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5085:
-------------------------
Attachment: 5085-v3-experiment.txt
This v3 is same as old v3.
> fix test-patch script from setting the ulimit
> ---------------------------------------------
>
> Key: HBASE-5085
> URL: https://issues.apache.org/jira/browse/HBASE-5085
> Project: HBase
> Issue Type: Bug
> Reporter: Giridharan Kesavan
> Assignee: Giridharan Kesavan
> Attachments: 5085-v2-experiment.txt, 5085-v2-experiment.txt, 5085-v3-experiment.txt, 5085-v3-experiment.txt, hbase-5085.patch
>
>
> test-patch.sh script sets the ulimit -n 1024 just after triggering the patch setting this overrides the underlying systems ulimit and hence failing the hbase tests.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira