You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Ayub Khan (JIRA)" <ji...@apache.org> on 2016/12/06 11:53:58 UTC
[jira] [Updated] (ATLAS-1351) HiveHook fails with NPE when a sqoop
import job is executed
[ https://issues.apache.org/jira/browse/ATLAS-1351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ayub Khan updated ATLAS-1351:
-----------------------------
Description:
HiveHook fails with below stack trace whenever a sqoop import job to copy into hive table.
*Impact: No hive process info is captured in Atlas for sqoop import.*
{noformat}
2016-12-06 11:41:02,304 ERROR [Atlas Logger 0]: hook.HiveHook (HiveHook.java:run(197)) - Atlas hook failed due to error
java.lang.NullPointerException
at org.apache.atlas.hive.hook.HiveHook$EntityComparator.compare(HiveHook.java:1093)
at org.apache.atlas.hive.hook.HiveHook$EntityComparator.compare(HiveHook.java:1089)
at java.util.TreeMap.compare(TreeMap.java:1188)
at java.util.TreeMap.put(TreeMap.java:531)
at java.util.TreeSet.add(TreeSet.java:255)
at java.util.AbstractCollection.addAll(AbstractCollection.java:342)
at java.util.TreeSet.addAll(TreeSet.java:312)
at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:608)
at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:235)
at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:84)
at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{noformat}
Attaching hive.log for reference.
Sample sqoop import command:
{noformat}
/usr/hdp/current/sqoop-client/bin/sqoop import --connect jdbc:mysql://ctr-e64-1480733150053-3050-01-000002.hwx.site/sqoopTests --username sqoop --password sqoop --hive-import --warehouse-dir /user/hrt_qa --table SqoopTablejufuv3lh71 --hive-table hiveSqoopTablejufuv3lh71temp4 --m 1 --create-hive-table
{noformat}
was:
HiveHook fails with below stack trace whenever a sqoop import job to copy into hive table.
*Impact: No hive process info is captured in Atlas for sqoop import.*
{noformat}
2016-12-06 11:41:02,304 ERROR [Atlas Logger 0]: hook.HiveHook (HiveHook.java:run(197)) - Atlas hook failed due to error
java.lang.NullPointerException
at org.apache.atlas.hive.hook.HiveHook$EntityComparator.compare(HiveHook.java:1093)
at org.apache.atlas.hive.hook.HiveHook$EntityComparator.compare(HiveHook.java:1089)
at java.util.TreeMap.compare(TreeMap.java:1188)
at java.util.TreeMap.put(TreeMap.java:531)
at java.util.TreeSet.add(TreeSet.java:255)
at java.util.AbstractCollection.addAll(AbstractCollection.java:342)
at java.util.TreeSet.addAll(TreeSet.java:312)
at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:608)
at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:235)
at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:84)
at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{noformat}
Attaching hive.log for reference.
Sample sqoop import command:
{noformat}
/usr/hdp/current/sqoop-client/bin/sqoop import --connect jdbc:mysql://ctr-e64-1480733150053-3050-01-000002.hwx.site/sqoopTests --username sqoop --password sqoop --hive-import --warehouse-dir /user/hrt_qa --table SqoopTablejufuv3lh71 --hive-table hiveSqoopTablejufuv3lh71temp4 --m 1 --create-hive-table
{noformat}
CC [~mneethiraj] [~skoneru]
> HiveHook fails with NPE when a sqoop import job is executed
> -----------------------------------------------------------
>
> Key: ATLAS-1351
> URL: https://issues.apache.org/jira/browse/ATLAS-1351
> Project: Atlas
> Issue Type: Bug
> Affects Versions: 0.8-incubating
> Reporter: Ayub Khan
> Attachments: hive.log
>
>
> HiveHook fails with below stack trace whenever a sqoop import job to copy into hive table.
> *Impact: No hive process info is captured in Atlas for sqoop import.*
> {noformat}
> 2016-12-06 11:41:02,304 ERROR [Atlas Logger 0]: hook.HiveHook (HiveHook.java:run(197)) - Atlas hook failed due to error
> java.lang.NullPointerException
> at org.apache.atlas.hive.hook.HiveHook$EntityComparator.compare(HiveHook.java:1093)
> at org.apache.atlas.hive.hook.HiveHook$EntityComparator.compare(HiveHook.java:1089)
> at java.util.TreeMap.compare(TreeMap.java:1188)
> at java.util.TreeMap.put(TreeMap.java:531)
> at java.util.TreeSet.add(TreeSet.java:255)
> at java.util.AbstractCollection.addAll(AbstractCollection.java:342)
> at java.util.TreeSet.addAll(TreeSet.java:312)
> at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:608)
> at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:235)
> at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:84)
> at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:195)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
> Attaching hive.log for reference.
> Sample sqoop import command:
> {noformat}
> /usr/hdp/current/sqoop-client/bin/sqoop import --connect jdbc:mysql://ctr-e64-1480733150053-3050-01-000002.hwx.site/sqoopTests --username sqoop --password sqoop --hive-import --warehouse-dir /user/hrt_qa --table SqoopTablejufuv3lh71 --hive-table hiveSqoopTablejufuv3lh71temp4 --m 1 --create-hive-table
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)