You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Pallavi Rao (JIRA)" <ji...@apache.org> on 2015/12/21 06:29:46 UTC

[jira] [Updated] (FALCON-1676) When a paritition is specified in input feed, Falcon should only wait for data availability in that partition

     [ https://issues.apache.org/jira/browse/FALCON-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pallavi Rao updated FALCON-1676:
--------------------------------
    Summary: When a paritition is specified in input feed, Falcon should only wait for data availability in that partition  (was: When a paritition is specified in input feed, Falcon should only wait for data availability in a partition)

> When a paritition is specified in input feed, Falcon should only wait for data availability in that partition
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: FALCON-1676
>                 URL: https://issues.apache.org/jira/browse/FALCON-1676
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Pallavi Rao
>
> When a process uses a feed with partition as its input, Falcon waits for data to be available in all partitions (parent dir), rather than just wait for data availability in that particular partition.
> Example process input:
> {code}
> <inputs>
>         <input name="ConversionEnhance" feed="FETL-ConversionEnhance" start="now(0,-30)" end="now(0,-30)" partition="*/{MATCH}"/>
> {code}
> If the consumer doesn't want to wait for all the data to available and is bothered about data only in that partition, currently, user will be forced to create a feed per partition.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)