You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Dennis Kubes (JIRA)" <ji...@apache.org> on 2008/03/19 23:58:24 UTC
[jira] Created: (HADOOP-3053) New Server Framework for Hadoop RPC
New Server Framework for Hadoop RPC
-----------------------------------
Key: HADOOP-3053
URL: https://issues.apache.org/jira/browse/HADOOP-3053
Project: Hadoop Core
Issue Type: Improvement
Components: ipc
Affects Versions: 0.17.0
Environment: All
Reporter: Dennis Kubes
Assignee: Dennis Kubes
Fix For: 0.17.0
This is a new Server framework for Hadoop RPC which replaces the current Server class. This new framework uses a reactor model to allow better throughput and better handling of clients.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3053) New Server Framework for Hadoop RPC
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-3053:
------------------------------------
Fix Version/s: (was: 0.17.0)
> New Server Framework for Hadoop RPC
> -----------------------------------
>
> Key: HADOOP-3053
> URL: https://issues.apache.org/jira/browse/HADOOP-3053
> Project: Hadoop Core
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 0.17.0
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Attachments: HADOOP-3053-0-rough.patch
>
>
> This is a new Server framework for Hadoop RPC which replaces the current Server class. This new framework uses a reactor model to allow better throughput and better handling of clients.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3053) New Server Framework for Hadoop RPC
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580641#action_12580641 ]
Dennis Kubes commented on HADOOP-3053:
--------------------------------------
The current patch is not ready for production. It is for first look, seeing the overall architecture. Some benefits of this new framework are:
1) No blocking on reads, all reads and writes are handled in their own thread. With current server reads are handled serially and writes in parallel.
2) Protocol is abstracted. Allows for protocol decoration if desired or for completely new protocols. Also changing the protocol doesn't require an understanding of the server internals.
3) High performance design. Not limited by a number of handlers. Processing threads will block on queue insertion but can still accept connections. Standard writes are queued then drained.
That is a basic list. The main idea is that this will be a cleaner, high performance framework which will allow evolution of the RPC protocol.
Dennis
> New Server Framework for Hadoop RPC
> -----------------------------------
>
> Key: HADOOP-3053
> URL: https://issues.apache.org/jira/browse/HADOOP-3053
> Project: Hadoop Core
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 0.17.0
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 0.17.0
>
> Attachments: HADOOP-3053-0-rough.patch
>
>
> This is a new Server framework for Hadoop RPC which replaces the current Server class. This new framework uses a reactor model to allow better throughput and better handling of clients.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3053) New Server Framework for Hadoop RPC
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580612#action_12580612 ]
Raghu Angadi commented on HADOOP-3053:
--------------------------------------
Could you list some of the major improvements over the current implementation with the patch? Thanks.
> New Server Framework for Hadoop RPC
> -----------------------------------
>
> Key: HADOOP-3053
> URL: https://issues.apache.org/jira/browse/HADOOP-3053
> Project: Hadoop Core
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 0.17.0
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 0.17.0
>
> Attachments: HADOOP-3053-0-rough.patch
>
>
> This is a new Server framework for Hadoop RPC which replaces the current Server class. This new framework uses a reactor model to allow better throughput and better handling of clients.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-3053) New Server Framework for Hadoop RPC
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dennis Kubes resolved HADOOP-3053.
----------------------------------
Resolution: Won't Fix
> New Server Framework for Hadoop RPC
> -----------------------------------
>
> Key: HADOOP-3053
> URL: https://issues.apache.org/jira/browse/HADOOP-3053
> Project: Hadoop Core
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 0.17.0
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Attachments: HADOOP-3053-0-rough.patch
>
>
> This is a new Server framework for Hadoop RPC which replaces the current Server class. This new framework uses a reactor model to allow better throughput and better handling of clients.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3053) New Server Framework for Hadoop RPC
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dennis Kubes updated HADOOP-3053:
---------------------------------
Attachment: HADOOP-3053-0-rough.patch
Very rough patch for a new Server framework for hadoop RPC. Still includes sample testing programs and extra code. Has passed most unit tests. Not intended for production but for a first look at the new framework.
> New Server Framework for Hadoop RPC
> -----------------------------------
>
> Key: HADOOP-3053
> URL: https://issues.apache.org/jira/browse/HADOOP-3053
> Project: Hadoop Core
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 0.17.0
> Environment: All
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 0.17.0
>
> Attachments: HADOOP-3053-0-rough.patch
>
>
> This is a new Server framework for Hadoop RPC which replaces the current Server class. This new framework uses a reactor model to allow better throughput and better handling of clients.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.