You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Balu Vellanki (JIRA)" <ji...@apache.org> on 2015/09/03 03:00:48 UTC

[jira] [Commented] (FALCON-1339) List feed entities shows scheduled Feed entities as submitted

    [ https://issues.apache.org/jira/browse/FALCON-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14728333#comment-14728333 ] 

Balu Vellanki commented on FALCON-1339:
---------------------------------------

There are two issues here.

Issue 1 :  If a user created a feed like the one above, they expect the feed instances to be deleted 90 days after they become available. But if Falcon does not create a retention bundle, this delete never happens. Is this a bug? Should falcon create a bundle? If not, we should update the documentation and explicitly throw a warning when such a Feed is scheduled.

Issue 2 :   Is "Submitted" an accurate status for above Feed. If yes, users who use the UI will be confused. They just scheduled the entity, but the status remains unchanged. They might think something is wrong with Falcon UI.

[~sriksun] , [~ajayyadava], [~venkatnrangan] and [~sowmyaramesh] : Please comment. 

> List feed entities shows scheduled Feed entities as submitted
> -------------------------------------------------------------
>
>                 Key: FALCON-1339
>                 URL: https://issues.apache.org/jira/browse/FALCON-1339
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.6.1
>            Reporter: Balu Vellanki
>            Assignee: Balu Vellanki
>            Priority: Critical
>
> To reproduce this issue, please do the following steps.
> - Submit a source cluster named primaryCluster.
> - Submit a feed.
> {code}
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <feed name="rawEmailFeed" description="Raw customer email feed" xmlns="uri:falcon:feed:0.1">
>     <tags>externalSystem=USWestEmailServers</tags>
>     <groups>churnAnalysisDataPipeline</groups>
>     <frequency>hours(1)</frequency>
>     <timezone>UTC</timezone>
>     <late-arrival cut-off="hours(1)"/>
>     <clusters>
>         <cluster name="primaryCluster" type="source">
>             <validity start="2015-07-22T01:00Z" end="2015-07-22T03:00Z"/>
>             <retention limit="days(90)" action="delete"/>
>         </cluster>
>     </clusters>
>     <locations>
>         <location type="data" path="/user/ambari-qa/falcon/demo/primary/input/enron/${YEAR}-${MONTH}-${DAY}-${HOUR}"/>
>         <location type="stats" path="/"/>
>         <location type="meta" path="/"/>
>     </locations>
>     <ACL owner="ambari-qa" group="users" permission="0x755"/>
>     <schema location="/none" provider="/none"/>
> </feed>
> {code}
> - Schedule this feed.
> - A bundle is not created for this feed because,
> {code}
> "Feed Retention is not applicable as Feed's end time for cluster primaryCluster is not in the future"
> {code}
> Since there are no running bundles on the cluster, the status of this feed will always be shown as "SUBMITTED" even after being scheduled. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)