You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Subroto <ss...@datameer.com> on 2012/05/29 14:46:10 UTC
Custom Socket Factory
Hi,
As part of the fix HDFS-2129 it is mentioned:
" If you use a custom socket factory, it must generate sockets that have associated Channels."
Does hadoop provide any sample implementation of the same?
Actually I use custom socket factory which is now not working with 0.23.1.
There is an option to use legacy BlockReader (dfs.client.use.legacy.blockreader) but, I am planning to upgrade my custom socket factory rather than failing back to the old approach.
Request some guidance in this direction….
Cheers,
Subroto Sanyal
Re: Custom Socket Factory
Posted by Subroto <ss...@datameer.com>.
Hi Todd,
Thanks for your response. I will give it a try.
Our CustomSocketFactory allows us to grab a CustomSocket.
The main logic of our custom socket is to translate the End-Points coming to API(private IP to public IP):
void java.net.Socket.connect(SocketAddress endpoint, int timeout)
Cheers,
Subroto Sanyal
On May 31, 2012, at 8:29 PM, Todd Lipcon wrote:
> Hi Subroto,
>
> You'll need to implement the "getChannel()" method in such a way that
> it returns a SocketChannel implementation -- and then implement the
> appropriate methods in that class to read/write ByteBuffers.
>
> Out of curiosity, what is your custom socket factory doing?
>
> -Todd
>
> On Tue, May 29, 2012 at 5:49 AM, Subroto <ss...@datameer.com> wrote:
>> I missed to mention that my custom socket factory returns a Custom Socket as
>> well. :-(
>>
>> Cheers,
>> Subroto Sanyal
>>
>> On May 29, 2012, at 2:46 PM, Subroto wrote:
>>
>> Hi,
>>
>> As part of the fix HDFS-2129 it is mentioned:
>> " If you use a custom socket factory, it must generate sockets that have
>> associated Channels."
>> Does hadoop provide any sample implementation of the same?
>> Actually I use custom socket factory which is now not working with 0.23.1.
>> There is an option to use legacy BlockReader
>> (dfs.client.use.legacy.blockreader) but, I am planning to upgrade my custom
>> socket factory rather than failing back to the old approach.
>>
>> Request some guidance in this direction….
>>
>> Cheers,
>> Subroto Sanyal
>>
>>
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
Re: Custom Socket Factory
Posted by Todd Lipcon <to...@cloudera.com>.
Hi Subroto,
You'll need to implement the "getChannel()" method in such a way that
it returns a SocketChannel implementation -- and then implement the
appropriate methods in that class to read/write ByteBuffers.
Out of curiosity, what is your custom socket factory doing?
-Todd
On Tue, May 29, 2012 at 5:49 AM, Subroto <ss...@datameer.com> wrote:
> I missed to mention that my custom socket factory returns a Custom Socket as
> well. :-(
>
> Cheers,
> Subroto Sanyal
>
> On May 29, 2012, at 2:46 PM, Subroto wrote:
>
> Hi,
>
> As part of the fix HDFS-2129 it is mentioned:
> " If you use a custom socket factory, it must generate sockets that have
> associated Channels."
> Does hadoop provide any sample implementation of the same?
> Actually I use custom socket factory which is now not working with 0.23.1.
> There is an option to use legacy BlockReader
> (dfs.client.use.legacy.blockreader) but, I am planning to upgrade my custom
> socket factory rather than failing back to the old approach.
>
> Request some guidance in this direction….
>
> Cheers,
> Subroto Sanyal
>
>
--
Todd Lipcon
Software Engineer, Cloudera
Re: Custom Socket Factory
Posted by Subroto <ss...@datameer.com>.
I missed to mention that my custom socket factory returns a Custom Socket as well. :-(
Cheers,
Subroto Sanyal
On May 29, 2012, at 2:46 PM, Subroto wrote:
> Hi,
>
> As part of the fix HDFS-2129 it is mentioned:
> " If you use a custom socket factory, it must generate sockets that have associated Channels."
> Does hadoop provide any sample implementation of the same?
> Actually I use custom socket factory which is now not working with 0.23.1.
> There is an option to use legacy BlockReader (dfs.client.use.legacy.blockreader) but, I am planning to upgrade my custom socket factory rather than failing back to the old approach.
>
> Request some guidance in this direction….
>
> Cheers,
> Subroto Sanyal