[jira] [Created] (HDFS-8959) Provide an iterator-based API for listing all the snapshottable directories

["Rakesh R (JIRA)" <ji...@apache.org>]

Rakesh R created HDFS-8959:
------------------------------

             Summary: Provide an iterator-based API for listing all the snapshottable directories
                 Key: HDFS-8959
                 URL: https://issues.apache.org/jira/browse/HDFS-8959
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Rakesh R
            Assignee: Rakesh R


Presently {{DistributedFileSystem#getSnapshottableDirListing()}} is sending all the {{SnapshottableDirectoryStatus[]}} array to the clients. Now the client should have enough space to hold it in memory. There could be chance that the client JVMs running out of memory because of this. Also, some time back there was a [comment|https://issues.apache.org/jira/browse/HDFS-8643?focusedCommentId=14658800&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14658800] about RPC packet limitation and a large number of snapshot list can again cause issues.

I believe iterator based {{DistributedFileSystem#listSnapshottableDirs()}} API would be a good addition!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)