You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/02/25 14:38:00 UTC
[jira] [Commented] (NIFI-8030) Improve Atlas lineage when using
PutHDFS to push data accessed through Hive
[ https://issues.apache.org/jira/browse/NIFI-8030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17290949#comment-17290949 ]
ASF subversion and git services commented on NIFI-8030:
-------------------------------------------------------
Commit 93b1a05dc3e98e2271ddc65af4b7ea969abd1462 in nifi's branch refs/heads/main from Peter Turcsanyi
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=93b1a05 ]
NIFI-8030: Added property to ReportLineageToAtlas to configure file/directory level logging of [hd]fs_path entities to Atlas
Signed-off-by: Pierre Villard <pi...@gmail.com>
This closes #4813.
> Improve Atlas lineage when using PutHDFS to push data accessed through Hive
> ---------------------------------------------------------------------------
>
> Key: NIFI-8030
> URL: https://issues.apache.org/jira/browse/NIFI-8030
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Extensions
> Reporter: Pierre Villard
> Assignee: Peter Turcsanyi
> Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> PutHDFS logs individual HDFS file entities to Atlas (not the containing directory), but Hive expects the directory. So it is not possible to join lineages in Atlas currently. This JIRA is about improving this situation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)