You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@jclouds.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/01/30 01:47:00 UTC

[jira] [Commented] (JCLOUDS-1371) LocalBlobStore.list enumerates entire container

    [ https://issues.apache.org/jira/browse/JCLOUDS-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755563#comment-16755563 ] 

ASF subversion and git services commented on JCLOUDS-1371:
----------------------------------------------------------

Commit 29eec441e902162394a5dbceaf98c14d3b2bc87a in jclouds's branch refs/heads/master from Andrew Gaul
[ https://gitbox.apache.org/repos/asf?p=jclouds.git;h=29eec44 ]

JCLOUDS-1371: JCLOUDS-1488: list optimize prefix

Previously getBlobKeysInsideContainer returned all keys and filtered
in LocalBlobStore.  Now getBlobKeysInsideContainer filters via prefix
which can dramatically decrease the number of keys returned,
especially for the filesystem provider.  Further optimizations are
possible for delimiter.


> LocalBlobStore.list enumerates entire container
> -----------------------------------------------
>
>                 Key: JCLOUDS-1371
>                 URL: https://issues.apache.org/jira/browse/JCLOUDS-1371
>             Project: jclouds
>          Issue Type: Improvement
>          Components: jclouds-blobstore
>    Affects Versions: 2.0.3
>            Reporter: Andrew Gaul
>            Priority: Major
>              Labels: filesystem
>
> {{LocalBlobStore.list}} with the filesystem blobstore enumerates the entire container even when prefix and delimiter set.  The File API does not provide a way to list a subset of files except for those within a specific directory and the underlying filesystem makes no guarantees about enumeration order.  We can still optimize the case where prefix is set and delimiter is /.  Reference:
> https://lists.apache.org/thread.html/72e8a101d8a8f99b6f728336633db2cecae1dc443e4c5b195eee8f0d@%3Cuser.jclouds.apache.org%3E



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)