Is it possible to use AF_UINX sockets in hadoop?

[Raghu Reddy <rr...@psc.edu>]

Currently I'm experimenting with version 0.20.

I would like to modify it so that it uses Unix Domain Sockets instead of 
INET sockets because we will be using this on a single node with a large 
number of cores.

I would like to use junixsockets 1.3 implementation of AFUNIXSocket in 
place of INET sockets.

The first question is is this possible?

For the clients, it appears that one can provide a socket factory that 
returns AFUNIXSocket.  The problem seems to be to get the servers to use a 
different implementation because the servers are using 
ServerSocketChannels, and according to:

<http://docs.oracle.com/javase/6/docs/api/java/nio/channels/ServerSocketChannel.html>

it is not possible to specify SocketImpl.

I have tried to use ServerSocket.setSocketFactory() to try and set a 
different implementation, but I have not yet figured out if this is working 
or not.

Does anyone have any idea if this is supposed to work?  Is there a better 
way of accomplishing this?

Thanks!

--rr

Re: Is it possible to use AF_UINX sockets in hadoop?

["Aaron T. Myers" <at...@cloudera.com>]

Hi Raghu,

You might want to check out the work that's been done over at
https://issues.apache.org/jira/browse/HDFS-347.

--
Aaron T. Myers
Software Engineer, Cloudera



On Thu, Nov 24, 2011 at 12:56 PM, Raghu Reddy <rr...@psc.edu> wrote:

> Currently I'm experimenting with version 0.20.
>
> I would like to modify it so that it uses Unix Domain Sockets instead of
> INET sockets because we will be using this on a single node with a large
> number of cores.
>
> I would like to use junixsockets 1.3 implementation of AFUNIXSocket in
> place of INET sockets.
>
> The first question is is this possible?
>
> For the clients, it appears that one can provide a socket factory that
> returns AFUNIXSocket.  The problem seems to be to get the servers to use a
> different implementation because the servers are using
> ServerSocketChannels, and according to:
>
> <http://docs.oracle.com/**javase/6/docs/api/java/nio/**
> channels/ServerSocketChannel.**html<http://docs.oracle.com/javase/6/docs/api/java/nio/channels/ServerSocketChannel.html>
> >
>
> it is not possible to specify SocketImpl.
>
> I have tried to use ServerSocket.setSocketFactory(**) to try and set a
> different implementation, but I have not yet figured out if this is working
> or not.
>
> Does anyone have any idea if this is supposed to work?  Is there a better
> way of accomplishing this?
>
> Thanks!
>
> --rr
>