You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by Ma...@fiduciagad.de on 2019/05/08 19:46:47 UTC

accessing HDFS Snapshot using HDFS NFS Gateway

Hi!

I have mounted the HDFS root path over the HDFS NFS Gateway and I'm able to
do all kind of file operations. Now I want to read a from a HDFS snapshot
using the NFS mount,


snapshot in hdfs works and I can see it using hdfs dfs -ls


  hdfs dfs -ls /data/standard/.snapshot/s20190507-063223.621


  Found 2 items





  So when I try a ls command on the nfs mount I get an error.




  ll /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621


  ls: cannot access /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621:
  Input/output error





  I'm using HDP 3.1.0





  Any ideas ?





  Best Regards





  MARKUS

Fiducia & GAD IT AG | www.fiduciagad.de
AG Frankfurt a. M. HRB 102381 | Sitz der Gesellschaft: Frankfurt a. M. |
USt-IdNr. DE 143582320
Vorstand: Klaus-Peter Bruns (Vorsitzender), Jens-Olaf Bartels,
Martin Beyer, Birgit Frohnhoff, Carsten Pfläging, Jörg Staff
Vorsitzender des Aufsichtsrats: Jürgen Brinkmann

Re: accessing HDFS Snapshot using HDFS NFS Gateway

Posted by Mukul Kumar Singh <mk...@gmail.com>.

Hi Markus,

HDFS NFS gateway currently does not support snapshots. Following issues 
are tracking this in HDFS.

https://issues.apache.org/jira/browse/HDFS-5084

https://issues.apache.org/jira/browse/HDFS-11315

However we do not have a fix for these jira.

Thanks,

Mukul

On 5/9/19 1:16 AM, Markus.Gierich@fiduciagad.de wrote:
>
> Hi!
>
> I have mounted the HDFS root path over the HDFS NFS Gateway and I'm 
> able to do all kind of file operations. Now I want to read a from a 
> HDFS snapshot using the NFS mount,
>
>
> snapshot in hdfs works and I can see it using hdfs dfs -ls
>
>     hdfs dfs -ls /data/standard/.snapshot/s20190507-063223.621
>
>     Found 2 items
>
>     So when I try a ls command on the nfs mount I get an error.
>
>     ll /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621
>
>     ls: cannot access
>     /mnt/hdfs/data/standard/.snapshot/s20190507-063223.621:
>     Input/output error
>
>     I'm using HDP 3.1.0
>
>     Any ideas ?
>
>     Best Regards
>
>     MARKUS
>
>
> Fiducia & GAD IT AG | www.fiduciagad.de
> AG Frankfurt a. M. HRB 102381 | Sitz der Gesellschaft: Frankfurt a. M. 
> | USt-IdNr. DE 143582320
> Vorstand: Klaus-Peter Bruns (Vorsitzender), Jens-Olaf Bartels,
> Martin Beyer, Birgit Frohnhoff, Carsten Pfläging, Jörg Staff
> Vorsitzender des Aufsichtsrats: Jürgen Brinkmann