You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Abhishek Tiwari (JIRA)" <ji...@apache.org> on 2018/11/30 06:37:01 UTC
[jira] [Updated] (GOBBLIN-565) Implement partition level lineage
event for job using TimePartitionedDataPublisher
[ https://issues.apache.org/jira/browse/GOBBLIN-565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Abhishek Tiwari updated GOBBLIN-565:
------------------------------------
Fix Version/s: 0.14.0
> Implement partition level lineage event for job using TimePartitionedDataPublisher
> ----------------------------------------------------------------------------------
>
> Key: GOBBLIN-565
> URL: https://issues.apache.org/jira/browse/GOBBLIN-565
> Project: Apache Gobblin
> Issue Type: Task
> Reporter: Zhixiong Chen
> Assignee: Zhixiong Chen
> Priority: Major
> Fix For: 0.14.0
>
>
> Currently Gobblin reports dataset level lineage, for example, it reports lineage from `(kafka:topic1)` to `(hdfs:/data/tracking/PageViewEvent)`. The task is to report lineage from `(kafka:topic1)` to `(hdfs:/data/tracking/PageViewEvent, hourly/2018/08/15/16)` where `hourly/2018/08/15/16` is a partition
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)