[jira] [Commented] (FALCON-284) Hcatalog based feed retention doesn't work when partition filter spans across multiple partition keys

["Srikanth Sundarrajan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FALCON-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13920957#comment-13920957 ] 

Srikanth Sundarrajan commented on FALCON-284:
---------------------------------------------

[~svenkat], Can you please share your thoughts on this?

> Hcatalog based feed retention doesn't work when partition filter spans across multiple partition keys
> -----------------------------------------------------------------------------------------------------
>
>                 Key: FALCON-284
>                 URL: https://issues.apache.org/jira/browse/FALCON-284
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.5
>            Reporter: Satish Mittal
>            Assignee: Satish Mittal
>         Attachments: FALCON-284.patch.txt
>
>
> When an HCatalog based feed is scheduled in falcon, retention only looks at the first partition key that satisfies either of date pattern: yyyy | MM | dd | HH | mm. As a result, it calculates a partition filter that contains only one of these patterns. However if HCatalog table is defined in such a way that date spans across multiple partition keys (year/month/day/hour/minute), then feed retention doesn't delete any partitions that are granular than first level (year).



--
This message was sent by Atlassian JIRA
(v6.2#6252)