You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Zhixiong Chen (JIRA)" <ji...@apache.org> on 2018/08/16 03:37:00 UTC

[jira] [Created] (GOBBLIN-565) Implement partition level lineage event for job using TimePartitionedDataPublisher

Zhixiong Chen created GOBBLIN-565:
-------------------------------------

             Summary: Implement partition level lineage event for job using TimePartitionedDataPublisher
                 Key: GOBBLIN-565
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-565
             Project: Apache Gobblin
          Issue Type: Task
            Reporter: Zhixiong Chen
            Assignee: Zhixiong Chen


Currently Gobblin reports dataset level lineage, for example, it reports lineage from `(kafka:topic1)` to `(hdfs:/data/tracking/PageViewEvent)`. The task is to report lineage from `(kafka:topic1)` to `(hdfs:/data/tracking/PageViewEvent, hourly/2018/08/15/16)` where `hourly/2018/08/15/16` is a partition



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)