You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Tom Beerbower <tb...@hortonworks.com> on 2016/02/06 22:42:07 UTC
Review Request 43291: Atlas Integration : Support Atlas / Sqoop
integration
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43291/
-----------------------------------------------------------
Review request for Ambari, Alejandro Fernandez, John Speidel, and Robert Levas.
Bugs: AMBARI-14921
https://issues.apache.org/jira/browse/AMBARI-14921
Repository: ambari
Description
-------
Follow these instructions in your sqoop set-up to add sqoop hook for Atlas.
1 In sqoop-site.xml:
- Sqoop Job publisher class. Currently only one publishing class is supported
- sqoop.job.data.publish.class:org.apache.atlas.sqoop.hook.SqoopHook
- Atlas cluster name
- atlas.cluster.name:<clustername>
2 Copy <atlas-conf>/atlas-application.properties and <atlas-conf>/client.properties to to the sqoop conf directory <sqoop-conf>/
3 Link <atlas-home>/hook/sqoop/*.jar in sqoop lib
Also documented here: https://github.com/apache/incubator-atlas/blob/master/docs/src/site/twiki/Bridge-Sqoop.twiki
Diffs
-----
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/configuration/sqoop-site.xml PRE-CREATION
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/metainfo.xml b5db91b
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py 3a3f93e
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/sqoop.py 66a5ee4
ambari-server/src/test/python/stacks/2.0.6/SQOOP/test_sqoop.py 5a10305
ambari-server/src/test/python/stacks/2.0.6/configs/default.json cb34098
ambari-server/src/test/python/stacks/2.0.6/configs/secured.json d673973
ambari-server/src/test/python/stacks/2.3/configs/default.json a36455c
Diff: https://reviews.apache.org/r/43291/diff/
Testing
-------
Manual test install Atlas and Sqoop. Confirm configuration and dependencies.
mvn clean test
Thanks,
Tom Beerbower
Re: Review Request 43291: Atlas Integration : Support Atlas / Sqoop
integration
Posted by Robert Levas <rl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43291/#review118182
-----------------------------------------------------------
Ship it!
Ship It!
- Robert Levas
On Feb. 6, 2016, 4:42 p.m., Tom Beerbower wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43291/
> -----------------------------------------------------------
>
> (Updated Feb. 6, 2016, 4:42 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, John Speidel, and Robert Levas.
>
>
> Bugs: AMBARI-14921
> https://issues.apache.org/jira/browse/AMBARI-14921
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Follow these instructions in your sqoop set-up to add sqoop hook for Atlas.
>
> 1 In sqoop-site.xml:
> - Sqoop Job publisher class. Currently only one publishing class is supported
> - sqoop.job.data.publish.class:org.apache.atlas.sqoop.hook.SqoopHook
> - Atlas cluster name
> - atlas.cluster.name:<clustername>
>
> 2 Copy <atlas-conf>/atlas-application.properties and <atlas-conf>/client.properties to to the sqoop conf directory <sqoop-conf>/
> 3 Link <atlas-home>/hook/sqoop/*.jar in sqoop lib
>
> Also documented here: https://github.com/apache/incubator-atlas/blob/master/docs/src/site/twiki/Bridge-Sqoop.twiki
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/configuration/sqoop-site.xml PRE-CREATION
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/metainfo.xml b5db91b
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py 3a3f93e
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/sqoop.py 66a5ee4
> ambari-server/src/test/python/stacks/2.0.6/SQOOP/test_sqoop.py 5a10305
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json cb34098
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json d673973
> ambari-server/src/test/python/stacks/2.3/configs/default.json a36455c
>
> Diff: https://reviews.apache.org/r/43291/diff/
>
>
> Testing
> -------
>
> Manual test install Atlas and Sqoop. Confirm configuration and dependencies.
>
> mvn clean test
>
>
> Thanks,
>
> Tom Beerbower
>
>