You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Arpit Shah (Jira)" <ji...@apache.org> on 2021/04/28 10:46:00 UTC

[jira] [Created] (ATLAS-4264) SqoopHook throwing an error

Arpit Shah created ATLAS-4264:
---------------------------------

             Summary: SqoopHook throwing an error
                 Key: ATLAS-4264
                 URL: https://issues.apache.org/jira/browse/ATLAS-4264
             Project: Atlas
          Issue Type: Bug
          Components: sqoop-integration
    Affects Versions: 2.1.0
         Environment: Linux
            Reporter: Arpit Shah


Hi all,

I am exploring the apache atlas. I am trying to configure sqoop hook for Atlas but facing the error.

I have configured Apache Atlas 2.1.0 with Hbase and elasticsearch.

I am using sqoop 1.4.7 with Hadoop version 3.3.0.

I have followed all the steps for configuring SqoopHook mentioned in the atlas doc.

 

I am facing the below error after the successful completion of the map-reduce job.

 

 

org.apache.atlas.AtlasException: Failed to load application properties

        at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)

        at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)

        at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:80)

        at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:82)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:264)

        at org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)

        at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)

        at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)

        at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)

        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)

        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)

        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)

        at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

Caused by: org.apache.commons.configuration.ConversionException: 'atlas.graph.index.search.max-result-set-size' doesn't map to a List object: 500000, a java.lang.Integer

        at org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)

        at org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)

        at org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)

        at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)

        ... 17 more

Exception in thread "main" java.lang.ExceptionInInitializerError

        at org.apache.atlas.sqoop.hook.SqoopHook.<clinit>(SqoopHook.java:82)

        at java.lang.Class.forName0(Native Method)

        at java.lang.Class.forName(Class.java:264)

        at org.apache.sqoop.mapreduce.PublishJobData.publishJobData(PublishJobData.java:46)

        at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:284)

        at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692)

        at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127)

        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:520)

        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:628)

        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)

        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)

        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)

        at org.apache.sqoop.Sqoop.main(Sqoop.java:252)

Caused by: java.lang.NullPointerException

        at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:85)

        ... 15 more



--
This message was sent by Atlassian Jira
(v8.3.4#803005)