[jira] [Resolved] (ACCUMULO-3369) Recursive Directory Imports

["Christopher Tubbs (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ACCUMULO-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christopher Tubbs resolved ACCUMULO-3369.
-----------------------------------------
    Resolution: Won't Fix

The new bulk import API (for 2.0) would make this trivial to implement on the client-side, so I think it's safe to say that this probably won't be implemented baked in to Accumulo.

Note: It's currently possible in the old API to implement on the client side, but since it's common to have a failure directory as a subdirectory, so it's a bit more sensible using the new API which doesn't have a failure directory.

> Recursive Directory Imports
> ---------------------------
>
>                 Key: ACCUMULO-3369
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3369
>             Project: Accumulo
>          Issue Type: New Feature
>            Reporter: Ariel Valentin
>            Priority: Minor
>
> importDirectory does not recurse through subdirectories to import rifles. It would be nice to add an option that would recurse through subdirectories or accept glob patterns to allow the user to specify multiple directories to import.
> Here is a snippet of our email conversation from the mailing list to provide some context:
> {quote}
> Ah, ok. Thanks, Mike.
> It wouldn't be too bad to ensure that the failures are unique (we could preserve the directory name in the failures dir). I thought that we assign a unique name on the backend (b-XXXXXXX.rf) so I think that's ok now.
> What I'm boiling down to: sounds like a reasonable feature to request if you want to file an issue on JIRA, Ariel. :)
> Mike Drob wrote:
> Name collision of failures and I think name collision of successes might
> cause problems sometimes too. Or maybe that's just with older versions.
> Regardless, having to write your own code puts it out of the realm of
> easy into at least middling territory - if import directory could
> natively handle recursion then it would become easy.
> On Tue, Nov 25, 2014 at 10:44 AM, Josh Elser  wrote:
>     What's the difficulty, Mike? Handling name collision of failures?
>     Mike Drob wrote:
>         Ariel,
>         There is not an easy way to do this recursively. Your best option is
>         going to be writing your own wrapper around the import command. If
>         you're using shell commands, this could be as easy as feeding the
>         results of 'find . -type d' into a script, or in Java you might
>         want to
>         look at DirectoryWalker in Apache Commons as possible solutions.
>         Mike
>         On Tue, Nov 25, 2014 at 10:22 AM, Ariel Valentin
>        
>              Hello!
>              We are running a couple of experiments using
>         importDirectory and are
>              curious if there is a simple way to import directories
>         recursively.
>              Based on looking at the source code it does not look like it
>              currently supports that feature:
>         (https://github.com/apache/__accumulo/blob/__1835c27ca41426ddd570cde14f9612__c45680b917/core/src/main/java/__org/apache/accumulo/core/__client/admin/__TableOperationsImpl.java
>         https://github.com/apache/accumulo/blob/1835c27ca41426ddd570cde14f9612c45680b917/core/src/main/java/org/apache/accumulo/core/client/admin/TableOperationsImpl.java
>              Are there plans to add it in the future? Or is there a
>         simple way to
>              do this right now?
> {quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)