You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2008/04/01 00:24:25 UTC
[jira] Created: (HADOOP-3142) Increase the number of open files for
unit tests under Hudson
Increase the number of open files for unit tests under Hudson
-------------------------------------------------------------
Key: HADOOP-3142
URL: https://issues.apache.org/jira/browse/HADOOP-3142
Project: Hadoop Core
Issue Type: Bug
Components: scripts
Reporter: Owen O'Malley
Assignee: Mukund Madhugiri
Fix For: hudson
Lucene.zones.apache.org and I assume hudson.zones limit the number of file handles to 256. TestMiniMRDFSSort runs better with more file handles. (I set it to 10000 in my testing, but a smaller value is probably ok.) I suggest the QA scripts increase the ulimit before running the unit tests with "ulimit -n 10000".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-3142) Increase the number of open files
for unit tests under Hudson
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley resolved HADOOP-3142.
---------------------------------
Resolution: Fixed
Assignee: Nigel Daley (was: Mukund Madhugiri)
I just commit a fix to the hudson scripts.
> Increase the number of open files for unit tests under Hudson
> -------------------------------------------------------------
>
> Key: HADOOP-3142
> URL: https://issues.apache.org/jira/browse/HADOOP-3142
> Project: Hadoop Core
> Issue Type: Bug
> Components: scripts
> Reporter: Owen O'Malley
> Assignee: Nigel Daley
> Fix For: hudson
>
>
> Lucene.zones.apache.org and I assume hudson.zones limit the number of file handles to 256. TestMiniMRDFSSort runs better with more file handles. (I set it to 10000 in my testing, but a smaller value is probably ok.) I suggest the QA scripts increase the ulimit before running the unit tests with "ulimit -n 10000".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3142) Increase the number of open files
for unit tests under Hudson
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583931#action_12583931 ]
Doug Cutting commented on HADOOP-3142:
--------------------------------------
The default on linux has long been 1024, so it would be nice if things ran in that by default.
> Increase the number of open files for unit tests under Hudson
> -------------------------------------------------------------
>
> Key: HADOOP-3142
> URL: https://issues.apache.org/jira/browse/HADOOP-3142
> Project: Hadoop Core
> Issue Type: Bug
> Components: scripts
> Reporter: Owen O'Malley
> Assignee: Mukund Madhugiri
> Fix For: hudson
>
>
> Lucene.zones.apache.org and I assume hudson.zones limit the number of file handles to 256. TestMiniMRDFSSort runs better with more file handles. (I set it to 10000 in my testing, but a smaller value is probably ok.) I suggest the QA scripts increase the ulimit before running the unit tests with "ulimit -n 10000".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3142) Increase the number of open files
for unit tests under Hudson
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583939#action_12583939 ]
Owen O'Malley commented on HADOOP-3142:
---------------------------------------
1024 should be fine.
> Increase the number of open files for unit tests under Hudson
> -------------------------------------------------------------
>
> Key: HADOOP-3142
> URL: https://issues.apache.org/jira/browse/HADOOP-3142
> Project: Hadoop Core
> Issue Type: Bug
> Components: scripts
> Reporter: Owen O'Malley
> Assignee: Mukund Madhugiri
> Fix For: hudson
>
>
> Lucene.zones.apache.org and I assume hudson.zones limit the number of file handles to 256. TestMiniMRDFSSort runs better with more file handles. (I set it to 10000 in my testing, but a smaller value is probably ok.) I suggest the QA scripts increase the ulimit before running the unit tests with "ulimit -n 10000".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.