You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Madhan Neethiraj (JIRA)" <ji...@apache.org> on 2018/09/26 04:42:00 UTC
[jira] [Commented] (ATLAS-2885) Skip handling of INSERT
INTO...VALUES hive query messages
[ https://issues.apache.org/jira/browse/ATLAS-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16628254#comment-16628254 ]
Madhan Neethiraj commented on ATLAS-2885:
-----------------------------------------
Consider replacing:
{code}
// Fix for insert query
if (inputs.size() == 1) {
{code}
with:
{code}
// skip insert into tbl_x values() statements
if (!ret && CollectionUtils.isNotEmpty(inputs) && inputs.size() == 1) {
{code}
Rest of the changes look good.
+1
> Skip handling of INSERT INTO...VALUES hive query messages
> ---------------------------------------------------------
>
> Key: ATLAS-2885
> URL: https://issues.apache.org/jira/browse/ATLAS-2885
> Project: Atlas
> Issue Type: Task
> Components: atlas-core
> Affects Versions: 0.8.2
> Reporter: Sarath Subramanian
> Assignee: Apoorv Naik
> Priority: Major
> Fix For: 0.8.3
>
> Attachments: 0001-ATLAS-2885-Skip-handling-of-INSERT-INTO.VALUES-hive-.patch
>
>
> The INSERT INTO...VALUES() statement used by hive to insert data into hive tables generates lineage in atlas for every INSERT INTO..VALUES statement.
> The lineage generated is something like:
> *Temp_Table -> HiveTable*
> This is a transient table and is not persisted. Atlas should skip handling of this lineage.
>
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)