You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Hai (JIRA)" <ji...@apache.org> on 2016/10/08 00:35:20 UTC

[jira] [Commented] (SAMZA-1034) Support LATEST path and single file as the input of HDFSSystemConsumer

    [ https://issues.apache.org/jira/browse/SAMZA-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556764#comment-15556764 ] 

Hai commented on SAMZA-1034:
----------------------------

https://reviews.apache.org/r/52660/

> Support LATEST path and single file as the input of HDFSSystemConsumer
> ----------------------------------------------------------------------
>
>                 Key: SAMZA-1034
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1034
>             Project: Samza
>          Issue Type: Sub-task
>            Reporter: Hai
>            Assignee: Hai
>
> Right now users have to specify a directory of the HDFS to be consumed. Many other systems support the idea of "LATEST" file/directory. For example, if we have:
> /data/database/db1/snapshot-2016-09-10
> /data/database/db1/snapshot-2016-09-11
> Then "/data/database/db1/#LATEST" will automatically point to "/data/database/db1/snapshot-2016-09-11"
> We want to implement such a feature.
> Plus, we also want to support the consumption of single file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)