You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2013/01/15 16:08:12 UTC
[jira] [Created] (OOZIE-1167) Fix and rework PartitionDependency
Management
Rohini Palaniswamy created OOZIE-1167:
-----------------------------------------
Summary: Fix and rework PartitionDependency Management
Key: OOZIE-1167
URL: https://issues.apache.org/jira/browse/OOZIE-1167
Project: Oozie
Issue Type: Sub-task
Reporter: Rohini Palaniswamy
Assignee: Rohini Palaniswamy
Currently the PDMService only works if the hcat dependency URI partitions match exactly with all the partitions in the notification. This is mostly not the case as there will be lot of sub-partitions in a table, but only the date partition will be specified for dependency check. So need to do a subset match.
Also need to extract out the dependency cache and make an interface, so that a cache which spills to disk can later be substituted. Spillable cache is required for scale when number of pending dependencies will be high.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira