You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Péter Gergő Barna (JIRA)" <ji...@apache.org> on 2018/04/27 14:11:00 UTC
[jira] [Comment Edited] (ATLAS-2611) NPE in Hive hook
[ https://issues.apache.org/jira/browse/ATLAS-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456494#comment-16456494 ]
Péter Gergő Barna edited comment on ATLAS-2611 at 4/27/18 2:10 PM:
-------------------------------------------------------------------
patch #2 uses ColumnLineageUtils to call Dependency.getBaseCols with reflection
review https://reviews.apache.org/r/66851/diff/1#index_header
was (Author: bpgergo):
patch #2 uses ColumnLineageUtils to call Dependency.getBaseCols with reflection
> NPE in Hive hook
> ----------------
>
> Key: ATLAS-2611
> URL: https://issues.apache.org/jira/browse/ATLAS-2611
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Affects Versions: 0.8.2
> Reporter: Péter Gergő Barna
> Assignee: Péter Gergő Barna
> Priority: Major
> Fix For: 0.8.3
>
> Attachments: ATLAS-2611-2.patch, ATLAS-2611.patch
>
>
> NPE thrown from this line
> {code:java}
> for (BaseColumnInfo baseColumn : entry.getValue().getBaseCols()) {{code}
> Entry comes from
>
> {code:java}
> for (Map.Entry<DependencyKey, Dependency> entry : lineageInfo.entrySet()) {
> {code}
> Hive log
>
> {noformat}
> 2018-04-25T16:23:46,792 ERROR [HiveServer2-Background-Pool: Thread-1474] hook.HiveHook: HiveHook.run(): failed to process operation CREATEVIEW java.lang.NullPointerException: null at org.apache.atlas.hive.hook.events.CreateHiveProcess.processColumnLineage(CreateHiveProcess.java:140) ~[hive-bridge-0.8.0.2.6.5.0-270.jar:0.8.0.2.6.5.0-270] at org.apache.atlas.hive.hook.events.CreateHiveProcess.getEntities(CreateHiveProcess.java:110) ~[hive-bridge-0.8.0.2.6.5.0-270.jar:0.8.0.2.6.5.0-270] at org.apache.atlas.hive.hook.events.CreateHiveProcess.getNotificationMessages(CreateHiveProcess.java:56) ~[hive-bridge-0.8.0.2.6.5.0-270.jar:0.8.0.2.6.5.0-270] at org.apache.atlas.hive.hook.HiveHook.run(HiveHook.java:157) [hive-bridge-0.8.0.2.6.5.0-270.jar:0.8.0.2.6.5.0-270] at org.apache.atlas.hive.hook.HiveHook.run(HiveHook.java:52) [hive-bridge-shim-0.8.0.2.6.5.0-270.jar:0.8.0.2.6.5.0-270] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1775) [hive-exec-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1414) [hive-exec-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1211) [hive-exec-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1204) [hive-exec-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:242) [hive-service-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91) [hive-service-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:336) [hive-service-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at java.security.AccessController.doPrivileged(Native Method) [?:1.8.0_161] at javax.security.auth.Subject.doAs(Subject.java:422) [?:1.8.0_161] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) [hadoop-common-2.7.3.2.6.5.0-270.jar:?] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:350) [hive-service-2.1.0.2.6.5.0-270.jar:2.1.0.2.6.5.0-270] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_161] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_161] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
>
> {noformat}
>
> It may be important to note that Atlas was running with Hive2 when this NPE occured.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)