You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2006/05/04 20:00:17 UTC

[jira] Commented: (HADOOP-195) transfer map output transfer with http instead of rpc

    [ http://issues.apache.org/jira/browse/HADOOP-195?page=comments#action_12377857 ] 

Doug Cutting commented on HADOOP-195:
-------------------------------------

The RPC mechanism is designed to be able to support large values.  Timeouts are for inactivity on a request, not for completion.  So perhaps there is just a bug in the RPC mechanism that can be fixed.  Or perhaps this really is an inappropriate use of it.  I'd like to hear more about the failures you're seeing before we decide.

> transfer map output transfer with http instead of rpc
> -----------------------------------------------------
>
>          Key: HADOOP-195
>          URL: http://issues.apache.org/jira/browse/HADOOP-195
>      Project: Hadoop
>         Type: Improvement

>   Components: mapred
>     Versions: 0.2
>     Reporter: Owen O'Malley
>     Assignee: Owen O'Malley
>      Fix For: 0.3

>
> The data transfer of the map output should be transfered via http instead rpc, because rpc is very slow for this application and the timeout behavior is suboptimal. (server sends data and client ignores it because it took more than 10 seconds to be received.)

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira