You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Hai (JIRA)" <ji...@apache.org> on 2016/10/07 22:18:20 UTC

[jira] [Created] (SAMZA-1034) Support LATEST path and single file as the input of HDFSSystemConsumer

Hai created SAMZA-1034:
--------------------------

             Summary: Support LATEST path and single file as the input of HDFSSystemConsumer
                 Key: SAMZA-1034
                 URL: https://issues.apache.org/jira/browse/SAMZA-1034
             Project: Samza
          Issue Type: Sub-task
            Reporter: Hai
            Assignee: Hai


Right now users have to specify a directory of the HDFS to be consumed. Many other systems support the idea of "LATEST" file/directory. For example, if we have:

/data/database/db1/snapshot-2016-09-10
/data/database/db1/snapshot-2016-09-11

Then "/data/database/db1/#LATEST" will automatically point to "/data/database/db1/snapshot-2016-09-11"

We want to implement such a feature.

Plus, we also want to support the consumption of single file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)