You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Pallavi Rao (JIRA)" <ji...@apache.org> on 2015/12/21 06:29:46 UTC
[jira] [Updated] (FALCON-1676) When a partition is specified in
input feed, Falcon should only wait for data availability in that partition
[ https://issues.apache.org/jira/browse/FALCON-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pallavi Rao updated FALCON-1676:
--------------------------------
Summary: When a partition is specified in input feed, Falcon should only wait for data availability in that partition (was: When a paritition is specified in input feed, Falcon should only wait for data availability in that partition)
> When a partition is specified in input feed, Falcon should only wait for data availability in that partition
> ------------------------------------------------------------------------------------------------------------
>
> Key: FALCON-1676
> URL: https://issues.apache.org/jira/browse/FALCON-1676
> Project: Falcon
> Issue Type: Bug
> Reporter: Pallavi Rao
>
> When a process uses a feed with partition as its input, Falcon waits for data to be available in all partitions (parent dir), rather than just wait for data availability in that particular partition.
> Example process input:
> {code}
> <inputs>
> <input name="ConversionEnhance" feed="FETL-ConversionEnhance" start="now(0,-30)" end="now(0,-30)" partition="*/{MATCH}"/>
> {code}
> If the consumer doesn't want to wait for all the data to available and is bothered about data only in that partition, currently, user will be forced to create a feed per partition.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)