You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2019/09/09 19:54:00 UTC

[jira] [Commented] (IMPALA-8931) Fe not generating lineages when event hooks are configured

    [ https://issues.apache.org/jira/browse/IMPALA-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926060#comment-16926060 ] 

ASF subversion and git services commented on IMPALA-8931:
---------------------------------------------------------

Commit 4327cc351317878de51003c2dcf4a71c9183eb44 in impala's branch refs/heads/master from Bharath Vissapragada
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=4327cc3 ]

IMPALA-8931: Fix fe trigger for lineage events

Currently, fe generates lineage objects only when --lineage_event_log_dir
is configured. This is a legacy startup param. Lineages should also be
generated when event hooks are configured since they can potentially
consume them.

Added a test that confirms that the hook is invoked when a lineage is
created.

Change-Id: I2d8deb05883cc3ecab27fe4afd031a1e7ccb0829
Reviewed-on: http://gerrit.cloudera.org:8080/14194
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Fe not generating lineages when event hooks are configured
> ----------------------------------------------------------
>
>                 Key: IMPALA-8931
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8931
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>    Affects Versions: Impala 3.2.0
>            Reporter: bharath v
>            Assignee: bharath v
>            Priority: Major
>
> Frontend generates the lineage only when {{--lineage_event_log_dir}} is configured. That is a legacy param and the users are expected to use event hooks to consume lineages. It should also generate lineage events when hooks are configured.
> {noformat}
> public boolean getComputeLineage() {
> return !Strings.isNullOrEmpty(backendCfg_.lineage_event_log_dir);  
> } {noformat}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org