[jira] [Commented] (HAWQ-1788) providing non-empty value for dfs.domain.socket.path in libhdfs

["Wan Chiyang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAWQ-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302360#comment-17302360 ] 

Wan Chiyang commented on HAWQ-1788:
-----------------------------------

Hi yuan,

Searching around the code base, the default dfs.domin.socker.path is already set in hdfs-client.xml, and short-circuit read seems to work for any new setup. 
{quote}$ git grep -C 3 /var/lib/hadoop-hdfs/dn_socket
src/backend/utils/misc/etc/hdfs-client.xml-308-
src/backend/utils/misc/etc/hdfs-client.xml-309- <property>
src/backend/utils/misc/etc/hdfs-client.xml-310- <name>dfs.domain.socket.path</name>
src/backend/utils/misc/etc/hdfs-client.xml:311: <value>/var/lib/hadoop-hdfs/dn_socket</value>
src/backend/utils/misc/etc/hdfs-client.xml-312- <description>
src/backend/utils/misc/etc/hdfs-client.xml-313- Optional. This is a path to a UNIX domain socket that will be used for
src/backend/utils/misc/etc/hdfs-client.xml-314- communication between the DataNode and local HDFS clients.
{quote}

> providing non-empty value for dfs.domain.socket.path in libhdfs
> ---------------------------------------------------------------
>
>                 Key: HAWQ-1788
>                 URL: https://issues.apache.org/jira/browse/HAWQ-1788
>             Project: Apache HAWQ
>          Issue Type: Improvement
>          Components: libhdfs
>            Reporter: Yuan Zhou
>            Assignee: Ruilong Huo
>            Priority: Major
>
> Hi HAWQ developers, 
> trying to enable the short-circuit read feature here and i found the default value for dfs.domain.socket.path is empty string
> [https://github.com/apache/hawq/blob/master/depends/libhdfs3/src/common/SessionConfig.cpp#L151]
> it looks better to provide an aligned value with the documents from HDFS:
> [https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html]
> This would allow users to test against vanilla HDFS setup quickly. 
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)