You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Sean Mackrory (JIRA)" <ji...@apache.org> on 2014/07/03 20:37:37 UTC

[jira] [Commented] (BIGTOP-1362) Package NFS service for HDFS

    [ https://issues.apache.org/jira/browse/BIGTOP-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051800#comment-14051800 ] 

Sean Mackrory commented on BIGTOP-1362:
---------------------------------------

So on SUSE you just need nfs-utils, and on Ubuntu you just need nfs-common. I'll add the appropriate package dependencies in a subsequent patch. The use of hadoop-daemon.sh in the init script also needs to be changed as it emits a warning that using that script to invoke hdfs is deprecated. To make this work the following configuration is needed:

NameNode's core-site.xml:
{code}
<property>
   <name>hadoop.proxyuser.hdfs.groups</name>
   <value>*</value>
   <description>
     Set this to '*' to allow the gateway user to proxy any group.
   </description>
</property>
<property>
    <name>hadoop.proxyuser.hdfs.hosts</name>
    <value>*</value>
    <description>
     Set this to '*' to allow requests from any hosts to be proxied.
    </description>
</property>
{code}

NameNode's hdfs-site.xml:
{code}
<property>
    <name>dfs.namenode.accesstime.precision</name>
    <value>3600000</value>
    <description>Access time for an HDFS file is precise up to this value. Default value is 1 hour. 0 disables access times for HDFS.</description>
</property>
{code}

NFS Gateway's hdfs-site.xml:
{code}
<property>
  <name>dfs.nfs3.dump.dir</name>
  <value>/tmp/.hdfs-nfs</value>
  <description>Needs to have enough space to buffer all out-of-sequence writes</description>
</property>
{code}

And once the servers are started you can mount the filesystem with
{code}
mount -t  nfs  -o vers=3,proto=tcp,nolock <hostname>:/ /hdfs_nfs_mount
{code}

> Package NFS service for HDFS
> ----------------------------
>
>                 Key: BIGTOP-1362
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1362
>             Project: Bigtop
>          Issue Type: Bug
>            Reporter: Sean Mackrory
>            Assignee: Sean Mackrory
>         Attachments: 0001-BIGTOP-1362.-Package-NFS-service-for-HDFS.patch
>
>
> Yo Dawg, I heard Hadoop 2.3.0 included an NFS service, so Bigtop 0.8.0 should also contain an NFS service, so you can mount stuff while you mount stuff.



--
This message was sent by Atlassian JIRA
(v6.2#6252)