You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/03/10 12:17:00 UTC

[jira] [Commented] (NIFI-9764) Atlas reporting task should not send Hive database lineage

    [ https://issues.apache.org/jira/browse/NIFI-9764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504221#comment-17504221 ] 

ASF subversion and git services commented on NIFI-9764:
-------------------------------------------------------

Commit 92202a5b9502609c6d26f7b5ee299bfc36441fb1 in nifi's branch refs/heads/main from Peter Turcsanyi
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=92202a5 ]

NIFI-9764: Atlas reporting task sends 'unknown' hive_table when table is name not available

Signed-off-by: Pierre Villard <pi...@gmail.com>

This closes #5839.


> Atlas reporting task should not send Hive database lineage
> ----------------------------------------------------------
>
>                 Key: NIFI-9764
>                 URL: https://issues.apache.org/jira/browse/NIFI-9764
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Peter Turcsanyi
>            Assignee: Peter Turcsanyi
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Hive table name may not be available in the provenance repository in some cases (https://github.com/apache/nifi/blob/65dd62716a62164f44be85657283103885f0f3ae/nifi-nar-bundles/nifi-hive-bundle/nifi-hive3-processors/src/main/java/org/apache/nifi/processors/hive/PutHive3QL.java#L247-L252).
> In this case, the Atlas reporting task sends database lineage (hive_db entity without hive_table) to Atlas but hive_db is not a DataSet entity and therefore it cannot be used in a lineage directly.
> Send hive_table with name 'unknown' when table name info is not available.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)