You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2007/04/03 19:06:33 UTC
[jira] Created: (HADOOP-1198) ipc.client.timeout of 2000ms for test
cases seems too small; causes too many timeouts and leads to hung test
cases
ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
------------------------------------------------------------------------------------------------------------------
Key: HADOOP-1198
URL: https://issues.apache.org/jira/browse/HADOOP-1198
Project: Hadoop
Issue Type: Bug
Components: test
Affects Versions: 0.12.2
Reporter: Arun C Murthy
Assigned To: Arun C Murthy
Fix For: 0.13.0
We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488052 ]
Hadoop QA commented on HADOOP-1198:
-----------------------------------
Integrated in Hadoop-Nightly #54 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/54/)
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch, HADOOP-1198_20070407_2.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486505 ]
Raghu Angadi commented on HADOOP-1198:
--------------------------------------
In my test time went from 12 min with 2 sec to 13 min with 60 sec time out. May be there is just one test where this affects.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486442 ]
Raghu Angadi commented on HADOOP-1198:
--------------------------------------
5 sec is obviously an improvement I think. Doug answered my concern.. it might delay test times and if it does not increase the test times, it could be much higher. so that we don't need to readjust again.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486461 ]
Arun C Murthy commented on HADOOP-1198:
---------------------------------------
Yes, that was with a 5s timeout.
I ran without ipc.client.timeout in src/test/hadoop-site.xml i.e. default of 60s and the total time was 23mins. :)
I vote we remove this altogether, can someone else corroborate? Thanks!
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486441 ]
Arun C Murthy commented on HADOOP-1198:
---------------------------------------
On my gentoo (2.6.16.11) with 1GB of ram I see too many timeouts with 2s. None with 5s. Total test time on my box: ~22mins.
Nigel seems to see timeouts on Solaris with 2s too...
I'm ok ignoring this if others feel otherwise.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487395 ]
Hadoop QA commented on HADOOP-1198:
-----------------------------------
+1
http://issues.apache.org/jira/secure/attachment/12355117/HADOOP-1198_20070407_2.patch applied and successfully tested against trunk revision r526411.
Results are at http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch, HADOOP-1198_20070407_2.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test
cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-1198:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Arun!
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch, HADOOP-1198_20070407_2.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
Posted by Nigel Daley <nd...@yahoo-inc.com>.
+1
On Apr 7, 2007, at 3:12 AM, Arun C Murthy (JIRA) wrote:
>
> [ https://issues.apache.org/jira/browse/HADOOP-1198?
> page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> Arun C Murthy updated HADOOP-1198:
> ----------------------------------
>
> Attachment: HADOOP-1198_20070407_2.patch
>
> If others are comfortable with this... here is a patch which
> removes the ipc.client.timeout parameter from src/test/hadoop-
> site.xml.
>
>> ipc.client.timeout of 2000ms for test cases seems too small;
>> causes too many timeouts and leads to hung test cases
>> ---------------------------------------------------------------------
>> ---------------------------------------------
>>
>> Key: HADOOP-1198
>> URL: https://issues.apache.org/jira/browse/
>> HADOOP-1198
>> Project: Hadoop
>> Issue Type: Bug
>> Components: test
>> Affects Versions: 0.12.2
>> Reporter: Arun C Murthy
>> Assigned To: Arun C Murthy
>> Fix For: 0.13.0
>>
>> Attachments: HADOOP-1198_20070403_1.patch,
>> HADOOP-1198_20070407_2.patch
>>
>>
>> We should increase the timeout slightly... what do other think?
>> 5000ms? 10000ms?
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
[jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test
cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-1198:
----------------------------------
Attachment: HADOOP-1198_20070407_2.patch
If others are comfortable with this... here is a patch which removes the ipc.client.timeout parameter from src/test/hadoop-site.xml.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch, HADOOP-1198_20070407_2.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487588 ]
Doug Cutting commented on HADOOP-1198:
--------------------------------------
+1 This looks like a good change to me.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch, HADOOP-1198_20070407_2.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486436 ]
Doug Cutting commented on HADOOP-1198:
--------------------------------------
It was 1 second for many months, until I increased it to 2 seconds in HADOOP-1030, a bit over a month ago, so that things would run better on the heavily loaded Solaris box where we run nightly benchmarks.
How often do you see timeouts with {1,2,5,10} seconds? On what kind of machine?
Related is, how much difference does changing this have on total unit test time? It used to make a big difference, but now that many daemons are stopped with Thread.interrupt() instead of waiting for the timeout interval, total unit test time may not be so sensitive to this parameter. If it's not, then we might even just leave it at the default.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486450 ]
Doug Cutting commented on HADOOP-1198:
--------------------------------------
> Total test time on my box: ~22mins.
That's with a 5 second timeout? How about with a 30 second timeout? The only reason to use a lower-than-default timeout for unit tests is to make them run faster. If it is not serving that purpose, then let's remove this from the test config altogether.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test
cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-1198:
----------------------------------
Status: Patch Available (was: Open)
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch, HADOOP-1198_20070407_2.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Jim Kellerman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487859 ]
Jim Kellerman commented on HADOOP-1198:
---------------------------------------
Thank you for this patch!
I have a MacBook Pro that dual boots Mac OS X and Fedora Core 6 and have been trying to figure out why this one particular test I was running was always successful under Mac OS but always had timeouts under Linux.
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch, HADOOP-1198_20070407_2.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
Posted by Nigel Daley <nd...@yahoo-inc.com>.
Seems right. I've seen lots of IPC timeouts on our Solaris build
machine.
On Apr 3, 2007, at 10:26 AM, Arun C Murthy (JIRA) wrote:
>
> [ https://issues.apache.org/jira/browse/HADOOP-1198?
> page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> Arun C Murthy updated HADOOP-1198:
> ----------------------------------
>
> Attachment: HADOOP-1198_20070403_1.patch
>
> Increasing it to 5000ms... thoughts?
>
>> ipc.client.timeout of 2000ms for test cases seems too small;
>> causes too many timeouts and leads to hung test cases
>> ---------------------------------------------------------------------
>> ---------------------------------------------
>>
>> Key: HADOOP-1198
>> URL: https://issues.apache.org/jira/browse/
>> HADOOP-1198
>> Project: Hadoop
>> Issue Type: Bug
>> Components: test
>> Affects Versions: 0.12.2
>> Reporter: Arun C Murthy
>> Assigned To: Arun C Murthy
>> Fix For: 0.13.0
>>
>> Attachments: HADOOP-1198_20070403_1.patch
>>
>>
>> We should increase the timeout slightly... what do other think?
>> 5000ms? 10000ms?
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
[jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test
cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-1198:
----------------------------------
Attachment: HADOOP-1198_20070403_1.patch
Increasing it to 5000ms... thoughts?
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for
test cases seems too small; causes too many timeouts and leads to hung test
cases
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486432 ]
Raghu Angadi commented on HADOOP-1198:
--------------------------------------
Just curious, why is 5 seconds ok? Is this based on some expected server behavior?
> ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases
> ------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1198
> URL: https://issues.apache.org/jira/browse/HADOOP-1198
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.12.2
> Reporter: Arun C Murthy
> Assigned To: Arun C Murthy
> Fix For: 0.13.0
>
> Attachments: HADOOP-1198_20070403_1.patch
>
>
> We should increase the timeout slightly... what do other think? 5000ms? 10000ms?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.