You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by Arpit Shah <ar...@gmail.com> on 2021/05/12 07:45:45 UTC
Sqoop Hook Error

Preview attachment sqooperror.PNG
sqooperror.PNG
76 KB
<https://mail.google.com/mail/u/0?ui=2&ik=b0675f312f&attid=0.1&permmsgid=msg-f:1699537640391646795&th=1795f87ab9f31e4b&view=att&disp=safe>
Hi,

I am exploring the apache atlas. I have configured the hive hook
successfully and currently, I am trying to configure sqoop hook for Atlas
but facing the error.

I have configured Apache Atlas 2.1.0 with Hbase and elasticsearch.

I am using sqoop 1.4.7 with Hadoop version 3.3.0 and hive 3.1.2.

I have followed all the steps for configuring SqoopHook mentioned in the
atlas documentation.



I am facing the below error after the successful completion of the
map-reduce job.



org.apache.atlas.AtlasException: Failed to load application properties

        at
org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)

        at
org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)

        at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:80)

        at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:82)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:264)

        at
org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)

        at
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)

        at
org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)

        at
org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)

        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)

        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)

        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)

        at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean

        at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)

        at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)

        at
org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)

        at
org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)

        ... 17 more

Exception in thread "main" java.lang.ExceptionInInitializerError

        at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:82)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:264)

        at
org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)

        at
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)

        at
org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)

        at
org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)

        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)

        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)

        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)

        at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

Caused by: java.lang.NullPointerException

        at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:85)

        ... 15 more


Please help me with that.


If for running hooks specific version of
atlas,java,hadoop,kafka,hbase,elasticsearch,hive,sqoop required then please
let me know.


Thanks and regards,

Arpit Shah