You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@atlas.apache.org by kb...@apache.org on 2019/09/30 11:27:58 UTC
[atlas-website] branch asf-site updated: ATLAS-3430: Update Atlas
Website with new theme
This is an automated email from the ASF dual-hosted git repository.
kbhatt pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/atlas-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new b000f08 ATLAS-3430: Update Atlas Website with new theme
b000f08 is described below
commit b000f0836065f002721c666045a3a8f23ee6e45b
Author: kevalbhatt <ke...@gmail.com>
AuthorDate: Mon Sep 30 16:57:28 2019 +0530
ATLAS-3430: Update Atlas Website with new theme
---
Architecture.html | 166 -----
Atlas-Authentication.html | 225 ------
Atlas-Authorization-Model.html | 221 ------
Atlas-Authorization-Ranger-Authorizer.html | 175 -----
Atlas-Authorization-Simple-Authorizer.html | 260 -------
AtlasRepairIndex.html | 158 ----
AtlasServer.html | 267 -------
AtlasTechnicalUserGuide.pdf | Bin 1271926 -> 0 bytes
Bridge-Kafka.html | 165 -----
ClassificationPropagation.html | 187 -----
Configuration.html | 329 ---------
Downloads.html | 422 -----------
EclipseSetup.html | 220 ------
Export-API.html | 299 --------
Export-HDFS-API.html | 161 -----
ExportImportAudits.html | 263 -------
Glossary.html | 513 -------------
HighAvailability.html | 311 --------
Hook-Falcon.html | 193 -----
Hook-HBase.html | 208 ------
Hook-Hive.html | 284 --------
Hook-Sqoop.html | 204 ------
Hook-Storm.html | 203 ------
Import-API-Options.html | 261 -------
Import-API.html | 287 --------
Import-Export-API.html | 173 -----
ImportEntityTransforms.html | 312 --------
Incremental-Export.html | 162 -----
InstallationSteps.html | 452 ------------
Migration-0.8-to-1.0.html | 259 -------
Notifications.html | 193 -----
QuickStart.html | 153 ----
ReplicatedToFromAttributes.html | 137 ----
Search-Advanced.html | 499 -------------
Search-Basic.html | 285 --------
Security.html | 388 ----------
SoftReference.html | 158 ----
TypeSystem.html | 278 --------
WhatsNew-1.0.html | 238 -------
WhatsNew-1.1.html | 163 -----
WhatsNew-2.0.html | 195 -----
assets.json | 105 +++
css/apache-maven-fluido-1.7.min.css | 17 -
css/print.css | 23 -
css/site.css | 1 -
fonts/glyphicons-halflings-regular.eot | Bin 35283 -> 0 bytes
fonts/glyphicons-halflings-regular.svg | 229 ------
fonts/glyphicons-halflings-regular.ttf | Bin 55016 -> 0 bytes
fonts/glyphicons-halflings-regular.woff | Bin 41793 -> 0 bytes
images/add.gif | Bin 397 -> 0 bytes
images/apache-maven-project-2.png | Bin 43073 -> 0 bytes
images/atlas-logo.png | Bin 3115 -> 0 bytes
images/fix.gif | Bin 366 -> 0 bytes
images/icon_error_sml.gif | Bin 633 -> 0 bytes
images/icon_help_sml.gif | Bin 1072 -> 0 bytes
images/icon_info_sml.gif | Bin 638 -> 0 bytes
images/icon_success_sml.gif | Bin 604 -> 0 bytes
images/icon_warning_sml.gif | Bin 625 -> 0 bytes
images/logos/build-by-maven-black.png | Bin 2294 -> 0 bytes
images/logos/build-by-maven-white.png | Bin 2260 -> 0 bytes
images/profiles/pre-release.png | Bin 32607 -> 0 bytes
images/profiles/retired.png | Bin 22003 -> 0 bytes
images/profiles/sandbox.png | Bin 33010 -> 0 bytes
images/remove.gif | Bin 607 -> 0 bytes
images/rss.png | Bin 474 -> 0 bytes
images/update.gif | Bin 1090 -> 0 bytes
img/glyphicons-halflings-white.png | Bin 8777 -> 0 bytes
img/glyphicons-halflings.png | Bin 12799 -> 0 bytes
index.html | 229 +-----
issue-tracking.html | 137 ----
js/apache-maven-fluido-1.7.min.js | 25 -
license.html | 341 ---------
mail-lists.html | 158 ----
project-info.html | 157 ----
.../images}/accessories-text-editor.png | Bin
.../images}/application-certificate.png | Bin
public/images/atlas_logo.svg | 17 +
{images => public/images}/column_lineage_ex1.png | Bin
{images => public/images}/contact-new.png | Bin
{images => public/images}/document-properties.png | Bin
{images => public/images}/drive-harddisk.png | Bin
public/images/favicon.ico | Bin 0 -> 1708 bytes
{images => public/images}/image-x-generic.png | Bin
{images => public/images}/internet-web-browser.png | Bin
{images => public/images}/logos/maven-feather.png | Bin
.../markdown/atlas-server-exp-imp-audits.png | Bin
.../images}/markdown/atlas-server-properties.png | Bin
.../images}/markdown/category_add_term.png | Bin
.../images}/markdown/category_add_term_1.png | Bin
.../images}/markdown/category_add_term_2.png | Bin
.../markdown/category_details_with_terms.png | Bin
.../images}/markdown/category_view_1.png | Bin
.../images}/markdown/category_view_2.png | Bin
.../markdown/category_view_category_context.png | Bin
.../markdown/category_view_category_context_1.png | Bin
.../markdown/category_view_glossary_context.png | Bin
.../images}/markdown/entity_add_term_modal.png | Bin
.../markdown/entity_assigned_term_with_tag.png | Bin
.../images}/markdown/entity_details_add_term.png | Bin
.../images}/markdown/entity_search_add_term.png | Bin
.../images}/markdown/term_add_category.png | Bin
.../images}/markdown/term_add_classification_1.png | Bin
.../images}/markdown/term_add_classification_2.png | Bin
.../images}/markdown/term_delete_context.png | Bin
.../images}/markdown/term_details.png | Bin
.../markdown/term_details_with_classification.png | Bin
.../images}/markdown/term_related_term_1.png | Bin
{images => public/images}/markdown/term_search.png | Bin
.../images}/markdown/term_view_context.png | Bin
.../images}/markdown/term_with_classification.png | Bin
.../images}/markdown/terms_related_terms.png | Bin
{images => public/images}/markdown/terms_view.png | Bin
{images => public/images}/network-server.png | Bin
{images => public/images}/package-x-generic.png | Bin
{images => public/images}/twiki/architecture.png | Bin
.../images}/twiki/classification-propagation-1.png | Bin
.../images}/twiki/classification-propagation-2.png | Bin
.../images}/twiki/classification-propagation-3.png | Bin
.../images}/twiki/classification-propagation-4.png | Bin
.../images}/twiki/classification-propagation-5.png | Bin
.../images}/twiki/classification-propagation-6.png | Bin
.../images}/twiki/classification-propagation-7.png | Bin
.../images}/twiki/classification-propagation-8.png | Bin
.../classification-propagation-entity-delete-1.png | Bin
.../classification-propagation-entity-delete-2.png | Bin
.../classification-propagation-entity-delete-3.png | Bin
.../classification-propagation-entity-delete-4.png | Bin
.../images}/twiki/guide-class-diagram.png | Bin
.../images}/twiki/guide-instance-graph.png | Bin
{images => public/images}/twiki/ranger-audit.png | Bin
.../images}/twiki/ranger-policy-admin.png | Bin
.../images}/twiki/ranger-policy-entities.png | Bin
.../images}/twiki/ranger-policy-types.png | Bin
.../images}/twiki/search-basic-hive_column-PII.png | Bin
...arch-basic-hive_table-customers-or-provider.png | Bin
...ch-basic-hive_table-customers-owner_is_hive.png | Bin
.../twiki/search-basic-hive_table-customers.png | Bin
{images => public/images}/window-new.png | Bin
source-repository.html | 148 ----
static/js/app.1cc75c28407cd292bd9d.js | 793 +++++++++++++++++++++
static/js/app.1cc75c28407cd292bd9d.js.map | 1 +
...cuments-asf-asfinfo.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-asf-asfinfo.e025e641.js | 2 +
...ication-propagation.1cc75c28407cd292bd9d.js.map | 1 +
...ocuments-classification-propagation.f301b15f.js | 2 +
.../js/documents-downloads-downloads.14a53491.js | 2 +
...downloads-downloads.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-glossary.0be49754.js | 2 +
.../documents-glossary.1cc75c28407cd292bd9d.js.map | 1 +
...s-high-availability.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-high-availability.f7380931.js | 2 +
...-level-architecture.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-high-level-architecture.b025464c.js | 2 +
...ts-hook-hook-falcon.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-hook-hook-falcon.611f98ab.js | 2 +
...ts-hook-hook-h-base.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-hook-hook-h-base.897cc2f7.js | 2 +
...ents-hook-hook-hive.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-hook-hook-hive.87d857ba.js | 2 +
...nts-hook-hook-kafka.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-hook-hook-kafka.cc971e34.js | 2 +
...nts-hook-hook-sqoop.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-hook-hook-sqoop.54b42f0b.js | 2 +
...nts-hook-hook-storm.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-hook-hook-storm.30356dff.js | 2 +
...t-export-export-api.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-import-export-export-api.714966d4.js | 2 +
...port-export-hdfsapi.1cc75c28407cd292bd9d.js.map | 1 +
...uments-import-export-export-hdfsapi.bc4b39b6.js | 2 +
...xport-import-audits.1cc75c28407cd292bd9d.js.map | 1 +
...-import-export-export-import-audits.5850a954.js | 2 +
...-import-api-options.1cc75c28407cd292bd9d.js.map | 1 +
...ts-import-export-import-api-options.2d8bce6f.js | 2 +
...t-export-import-api.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-import-export-import-api.c14adfb1.js | 2 +
...t-entity-transforms.1cc75c28407cd292bd9d.js.map | 1 +
...ort-export-import-entity-transforms.4b135138.js | 2 +
...nts-import-export-import-export-api.04dda760.js | 2 +
...t-import-export-api.1cc75c28407cd292bd9d.js.map | 1 +
...-incremental-export.1cc75c28407cd292bd9d.js.map | 1 +
...ts-import-export-incremental-export.31c79cf4.js | 2 +
static/js/documents-introduction.04ddf74d.js | 2 +
...uments-introduction.1cc75c28407cd292bd9d.js.map | 1 +
...igration-0-8-to-1-0.1cc75c28407cd292bd9d.js.map | 1 +
...ents-migration-migration-0-8-to-1-0.9b52d566.js | 2 +
...s-misc-atlas-server.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-misc-atlas-server.2dad2659.js | 2 +
...plicated-attributes.1cc75c28407cd292bd9d.js.map | 1 +
...ocuments-misc-replicated-attributes.34a358f7.js | 2 +
...misc-soft-reference.1cc75c28407cd292bd9d.js.map | 1 +
.../js/documents-misc-soft-reference.80a9ee72.js | 2 +
...ments-notifications.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-notifications.eb1273a5.js | 2 +
...info-issue-tracking.1cc75c28407cd292bd9d.js.map | 1 +
...cuments-project-info-issue-tracking.ee828552.js | 2 +
...-info-mailing-lists.1cc75c28407cd292bd9d.js.map | 1 +
...ocuments-project-info-mailing-lists.8f857ccd.js | 2 +
...t-info-project-info.1cc75c28407cd292bd9d.js.map | 1 +
...documents-project-info-project-info.4ace0fef.js | 2 +
...nfo-project-license.1cc75c28407cd292bd9d.js.map | 1 +
...uments-project-info-project-license.c4fef4eb.js | 2 +
...o-source-repository.1cc75c28407cd292bd9d.js.map | 1 +
...ents-project-info-source-repository.d90f25e3.js | 2 +
...ject-info-team-list.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-project-info-team-list.ffeb47ff.js | 42 ++
.../documents-rest-api.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-rest-api.552dc4f7.js | 2 +
...rch-search-advanced.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-search-search-advanced.e178b08f.js | 2 +
...search-search-basic.1cc75c28407cd292bd9d.js.map | 1 +
.../js/documents-search-search-basic.5d003211.js | 2 +
...s-ranger-authorizer.1cc75c28407cd292bd9d.js.map | 1 +
...ts-security-atlas-ranger-authorizer.39e10b8c.js | 2 +
...s-simple-authorizer.1cc75c28407cd292bd9d.js.map | 1 +
...ts-security-atlas-simple-authorizer.3ad19619.js | 2 +
.../documents-security-authentication.0a86e3df.js | 2 +
...rity-authentication.1cc75c28407cd292bd9d.js.map | 1 +
...authorization-model.1cc75c28407cd292bd9d.js.map | 1 +
...uments-security-authorization-model.7ea94264.js | 2 +
...s-security-security.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-security-security.ce51a219.js | 2 +
.../documents-setup-build-instruction.11420a05.js | 2 +
...p-build-instruction.1cc75c28407cd292bd9d.js.map | 1 +
...setup-configuration.1cc75c28407cd292bd9d.js.map | 1 +
.../js/documents-setup-configuration.fc93338b.js | 2 +
...setup-eclipse-setup.1cc75c28407cd292bd9d.js.map | 1 +
.../js/documents-setup-eclipse-setup.44e7de32.js | 2 +
...llation-instruction.1cc75c28407cd292bd9d.js.map | 1 +
...ents-setup-installation-instruction.9420f00c.js | 2 +
...s-setup-quick-start.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-setup-quick-start.6e78f9ac.js | 2 +
...-atlas-repair-index.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-tools-atlas-repair-index.9a1b2ce1.js | 2 +
...cuments-type-system.1cc75c28407cd292bd9d.js.map | 1 +
static/js/documents-type-system.b02c96b2.js | 2 +
...s-new-whats-new-1-0.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-whats-new-whats-new-1-0.9317ffb3.js | 2 +
...s-new-whats-new-2-0.1cc75c28407cd292bd9d.js.map | 1 +
.../documents-whats-new-whats-new-2-0.727ff1b8.js | 2 +
static/js/vendors.1cc75c28407cd292bd9d.js.map | 1 +
static/js/vendors.30826081.js | 2 +
team-list.html | 515 -------------
242 files changed, 1107 insertions(+), 12006 deletions(-)
diff --git a/Architecture.html b/Architecture.html
deleted file mode 100644
index 01b9a8f..0000000
--- a/Architecture.html
+++ /dev/null
@@ -1,166 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Architecture.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Architecture</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Architecture</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Architecture"></a>Architecture</h2></div>
-<div class="section">
-<h3><a name="Introduction"></a>Introduction</h3></div>
-<div class="section">
-<h3><a name="Atlas_High_Level_Architecture_-_Overview"></a>Atlas High Level Architecture - Overview</h3>
-<p><img src="images/twiki/architecture.png" alt="" /></p>
-<p>The components of Atlas can be grouped under the following major categories:</p></div>
-<div class="section">
-<h4><a name="Core"></a>Core</h4>
-<p>Atlas core includes the following components:</p>
-<p><b>Type System</b>: Atlas allows users to define a model for the metadata objects they want to manage. The model is composed of definitions called ‘types’. Instances of ‘types’ called ‘entities’ represent the actual metadata objects that are managed. The Type System is a component that allows users to define and manage the types and entities. All metadata objects managed by Atlas out of the box (like Hive tables, for e.g.) are modelled using t [...]
-<p>One key point to note is that the generic nature of the modelling in Atlas allows data stewards and integrators to define both technical metadata and business metadata. It is also possible to define rich relationships between the two using features of Atlas.</p>
-<p><b>Graph Engine</b>: Internally, Atlas persists metadata objects it manages using a Graph model. This approach provides great flexibility and enables efficient handling of rich relationships between the metadata objects. Graph engine component is responsible for translating between types and entities of the Atlas type system, and the underlying graph persistence model. In addition to managing the graph objects, the graph engine also creates the appropriate indices for the metadata obj [...]
-<p><b>Ingest / Export</b>: The Ingest component allows metadata to be added to Atlas. Similarly, the Export component exposes metadata changes detected by Atlas to be raised as events. Consumers can consume these change events to react to metadata changes in real time.</p></div>
-<div class="section">
-<h4><a name="Integration"></a>Integration</h4>
-<p>Users can manage metadata in Atlas using two methods:</p>
-<p><b>API</b>: All functionality of Atlas is exposed to end users via a REST API that allows types and entities to be created, updated and deleted. It is also the primary mechanism to query and discover the types and entities managed by Atlas.</p>
-<p><b>Messaging</b>: In addition to the API, users can choose to integrate with Atlas using a messaging interface that is based on Kafka. This is useful both for communicating metadata objects to Atlas, and also to consume metadata change events from Atlas using which applications can be built. The messaging interface is particularly useful if one wishes to use a more loosely coupled integration with Atlas that could allow for better scalability, reliability etc. Atlas uses Apache Kafka [...]
-<div class="section">
-<h4><a name="Metadata_sources"></a>Metadata sources</h4>
-<p>Atlas supports integration with many sources of metadata out of the box. More integrations will be added in future as well. Currently, Atlas supports ingesting and managing metadata from the following sources:</p>
-<p></p>
-<ul>
-<li><a href="./Hook-HBase.html">HBase</a></li>
-<li><a href="./Hook-Hive.html">Hive</a></li>
-<li><a href="./Hook-Sqoop.html">Sqoop</a></li>
-<li><a href="./Hook-Storm.html">Storm</a></li>
-<li><a href="./Bridge-Kafka.html">Kafka</a></li></ul>
-<p>The integration implies two things: There are metadata models that Atlas defines natively to represent objects of these components. There are components Atlas provides to ingest metadata objects from these components (in real time or in batch mode in some cases).</p></div>
-<div class="section">
-<h4><a name="Applications"></a>Applications</h4>
-<p>The metadata managed by Atlas is consumed by a variety of applications for satisfying many governance use cases.</p>
-<p><b>Atlas Admin UI</b>: This component is a web based application that allows data stewards and scientists to discover and annotate metadata. Of primary importance here is a search interface and SQL like query language that can be used to query the metadata types and objects managed by Atlas. The Admin UI uses the REST API of Atlas for building its functionality.</p>
-<p><b>Tag Based Policies</b>: <a class="externalLink" href="http://ranger.apache.org/">Apache Ranger</a> is an advanced security management solution for the Hadoop ecosystem having wide integration with a variety of Hadoop components. By integrating with Atlas, Ranger allows security administrators to define metadata driven security policies for effective governance. Ranger is a consumer to the metadata change events notified by Atlas.</p></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Atlas-Authentication.html b/Atlas-Authentication.html
deleted file mode 100644
index 9b53474..0000000
--- a/Atlas-Authentication.html
+++ /dev/null
@@ -1,225 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Atlas-Authentication.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Authentication in Apache Atlas.</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Authentication in Apache Atlas.</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h3><a name="Authentication_in_Apache_Atlas."></a>Authentication in Apache Atlas.</h3></div>
-<div class="section">
-<h4><a name="Authentication"></a>Authentication</h4>
-<p>Atlas supports following authentication methods</p>
-<p></p>
-<ul>
-<li><b>File</b></li>
-<li><b>Kerberos</b></li>
-<li><b>LDAP</b></li></ul>
-<p>Following properties should be set true to enable the authentication of that type in <tt>atlas-application.properties</tt> file.</p>
-<div class="source"><pre class="prettyprint">
-atlas.authentication.method.kerberos=true|false
-atlas.authentication.method.ldap=true|false
-atlas.authentication.method.file=true|false
-
-</pre></div>
-<p>If two or more authentication methods are set to true, then the authentication falls back to the latter method if the earlier one fails. For example if Kerberos authentication is set to true and ldap authentication is also set to true then, if for a request without kerberos principal and keytab LDAP authentication will be used as a fallback scenario.</p></div>
-<div class="section">
-<h5><a name="FILE_method."></a>FILE method.</h5>
-<p>File authentication requires users' login details in users credentials file in the format specified below and the file path should set to property <tt>atlas.authentication.method.file.filename</tt> in <tt>atlas-application.properties</tt>.</p>
-<div class="source"><pre class="prettyprint">
-atlas.authentication.method.file=true
-atlas.authentication.method.file.filename=${sys:atlas.home}/conf/users-credentials.properties
-
-</pre></div>
-<p>The users credentials file should have below format</p>
-<div class="source"><pre class="prettyprint">
-username=group::sha256-password
-
-</pre></div>
-<p>For e.g.</p>
-<div class="source"><pre class="prettyprint">
-admin=ADMIN::e7cf3ef4f17c3999a94f2c6f612e8a888e5b1026878e4e19398b23bd38ec221a
-
-</pre></div>
-<p>Users group can be either <b>ADMIN</b>, <b>DATA_STEWARD</b> OR <b>DATA_SCIENTIST</b></p>
-<p><b>Note</b>:-password is encoded with sha256 encoding method and can be generated using unix tool.</p>
-<p>For e.g.</p>
-<div class="source"><pre class="prettyprint">
-echo -n "Password" | sha256sum
-e7cf3ef4f17c3999a94f2c6f612e8a888e5b1026878e4e19398b23bd38ec221a -
-
-</pre></div></div>
-<div class="section">
-<h5><a name="Kerberos_Method."></a>Kerberos Method.</h5>
-<p>To enable the authentication in Kerberos mode in Atlas, set the property <tt>atlas.authentication.method.kerberos</tt> to true in <tt>atlas-application.properties</tt></p>
-<div class="source"><pre class="prettyprint">
-atlas.authentication.method.kerberos = true
-
-</pre></div>
-<p>Also following properties should be set.</p>
-<div class="source"><pre class="prettyprint">
-atlas.authentication.method.kerberos.principal=<principal>/<fqdn>@EXAMPLE.COM
-atlas.authentication.method.kerberos.keytab = /<key tab filepath>.keytab
-atlas.authentication.method.kerberos.name.rules = RULE:[2:$1@$0](atlas@EXAMPLE.COM)s/.*/atlas/
-atlas.authentication.method.kerberos.token.validity = 3600 [ in Seconds (optional)]
-
-</pre></div></div>
-<div class="section">
-<h5><a name="LDAP_Method."></a>LDAP Method.</h5>
-<p>To enable the authentication in LDAP mode in Atlas, set the property <tt>atlas.authentication.method.ldap</tt> to true and also set Ldap type to property <tt>atlas.authentication.method.ldap.type</tt> to LDAP or AD in <tt>atlas-application.properties</tt>. Use AD if connecting to Active Directory.</p>
-<div class="source"><pre class="prettyprint">
-atlas.authentication.method.ldap=true
-atlas.authentication.method.ldap.type=ldap|ad
-
-</pre></div>
-<p>For LDAP or AD the following configuration needs to be set in atlas application properties.</p>
-<p><b>Active Directory</b></p>
-<div class="source"><pre class="prettyprint">
-atlas.authentication.method.ldap.ad.domain= example.com
-atlas.authentication.method.ldap.ad.url=ldap://<AD server ip>:389
-atlas.authentication.method.ldap.ad.base.dn=DC=example,DC=com
-atlas.authentication.method.ldap.ad.bind.dn=CN=Administrator,CN=Users,DC=example,DC=com
-atlas.authentication.method.ldap.ad.bind.password=<password>
-atlas.authentication.method.ldap.ad.referral=ignore
-atlas.authentication.method.ldap.ad.user.searchfilter=(sAMAccountName={0})
-atlas.authentication.method.ldap.ad.default.role=ROLE_USER
-
-</pre></div>
-<p><b>LDAP Directroy</b></p>
-<div class="source"><pre class="prettyprint">
-atlas.authentication.method.ldap.url=ldap://<Ldap server ip>:389
-atlas.authentication.method.ldap.userDNpattern=uid={0],ou=users,dc=example,dc=com
-atlas.authentication.method.ldap.groupSearchBase=dc=example,dc=com
-atlas.authentication.method.ldap.groupSearchFilter=(member=cn={0},ou=users,dc=example,dc=com
-atlas.authentication.method.ldap.groupRoleAttribute=cn
-atlas.authentication.method.ldap.base.dn=dc=example,dc=com
-atlas.authentication.method.ldap.bind.dn=cn=Manager,dc=example,dc=com
-atlas.authentication.method.ldap.bind.password=<password>
-atlas.authentication.method.ldap.referral=ignore
-atlas.authentication.method.ldap.user.searchfilter=(uid={0})
-atlas.authentication.method.ldap.default.role=ROLE_USER
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Atlas-Authorization-Model.html b/Atlas-Authorization-Model.html
deleted file mode 100644
index db8f0d6..0000000
--- a/Atlas-Authorization-Model.html
+++ /dev/null
@@ -1,221 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Atlas-Authorization-Model.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Atlas Authorization Model</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Atlas Authorization Model</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h3><a name="Atlas_Authorization_Model"></a>Atlas Authorization Model</h3></div>
-<div class="section">
-<h4><a name="Introduction"></a>Introduction</h4>
-<p>Atlas is a scalable and extensible set of core foundational governance services – enabling enterprises to effectively and efficiently meet their compliance requirements within Hadoop and allows integration with the whole enterprise data ecosystem. Apache Atlas provides open metadata management and governance capabilities for organizations to build a catalog of their data assets, classify and govern these assets and provide collaboration capabilities around these data assets for [...]
-<p>This document covers details of the authorization model supported by Apache Atlas to control access to metadata managed by Atlas.</p></div>
-<div class="section">
-<h4><a name="Authorization_of_access_to_Types"></a>Authorization of access to Types</h4>
-<p>Apache Atlas provides a type system that allows users to model the metadata objects they would like to manage. The model is composed of definitions called ‘types’. Apache Atlas type system supports following categories of types:</p>
-<ul>
-<li>Entity</li>
-<li>Classification</li>
-<li>Relationship</li>
-<li>Struct</li>
-<li>Enum</li></ul>
-<p>The authorization model enables control of which users, groups can perform the following operations on types, based on type names and type categories:</p>
-<ul>
-<li>create</li>
-<li>update</li>
-<li>delete</li></ul>
-<p>Here are few examples of access controls supported by the model:</p>
-<ul>
-<li>Admin users can create/update/delete types of all categories</li>
-<li>Data stewards can create/update/delete classification types</li>
-<li>Healthcare data stewards can create/update/delete types having names start with “hc”</li></ul></div>
-<div class="section">
-<h4><a name="Authorization_of_access_to_Entities"></a>Authorization of access to Entities</h4>
-<p>An entity is an instance of an entity-type and such instances represent objects in the real world – for example a table in Hive, a HDFS file, a Kafka topic. The authorization model enables control of which users, groups can perform the following operations on entities – based on entity-types, entity-classifications, entity-id:</p>
-<p></p>
-<ul>
-<li>read</li>
-<li>create</li>
-<li>update</li>
-<li>delete</li>
-<li>read classification</li>
-<li>add classification</li>
-<li>update classification</li>
-<li>remove classification</li></ul>
-<p>Here are few examples of access controls supported by the model:</p>
-<ul>
-<li>Admin users can perform all entity operations on entities of all types</li>
-<li>Data stewards can perform all entity operations, except delete, on entities of all types</li>
-<li>Data quality admins can add/update/remove DATA_QUALITY classification</li>
-<li>Users in specific groups can read/update entities with PII classification or its sub-classification</li>
-<li>Finance users can read/update entities whose ID start with ‘finance’</li></ul></div>
-<div class="section">
-<h4><a name="Authorization_of_Admin_operations"></a>Authorization of Admin operations</h4>
-<p>The authorization model enables control of which users, groups can perform the following administrative operations:</p>
-<ul>
-<li>import entities</li>
-<li>export entities</li></ul>
-<p>Users with above accesses can import/export entities without requiring them to be granted with fine-grained entity level accesses.</p></div>
-<div class="section">
-<h4><a name="Pluggable_Authorization"></a>Pluggable Authorization</h4>
-<p>Apache Atlas supports a pluggable authorization interface, as shown below, that enable alternate implementations to handle authorizations.</p>
-<p>The name of the class implementing the authorization interface can be registered with Apache Atlas using configuration <tt>atlas.authorizer.impl</tt>. When this property is not set, Apache Atlas will use its default implementation in <tt>org.apache.atlas.authorize.simple.AtlasSimpleAuthorizer</tt>.</p>
-<div class="source"><pre class="prettyprint">
-
-package org.apache.atlas.authorize;
-
-public interface AtlasAuthorizer {
- void init();
-
- void cleanUp();
-
- boolean isAccessAllowed(AtlasAdminAccessRequest request) throws AtlasAuthorizationException;
-
- boolean isAccessAllowed(AtlasEntityAccessRequest request) throws AtlasAuthorizationException;
-
- boolean isAccessAllowed(AtlasTypeAccessRequest request) throws AtlasAuthorizationException;
-}
-
-</pre></div></div>
-<div class="section">
-<h4><a name="Simple_Authorizer"></a>Simple Authorizer</h4>
-<p>Simple authorizer is the default authorizer implementation included in Apache Atlas. For details of setting up Apache Atlas to use simple authorizer, please see <a href="./Atlas-Authorization-Simple-Authorizer.html">Setting up Atlas to use Simple Authorizer</a></p></div>
-<div class="section">
-<h4><a name="Ranger_Authorizer"></a>Ranger Authorizer</h4>
-<p>To configure Apache Atlas to use authorization implementation provided by Apache Ranger, include the following property in application.properties config file:</p>
-<div class="source"><pre class="prettyprint">
-atlas.authorizer.impl=ranger
-
-</pre></div>
-<p>Apache Ranger Authorizer requires configuration files to be setup, for example to specify Apache Ranger admin server URL, name of the service containing authorization policies, etc. For more details please see, <a href="./Atlas-Authorization-Ranger-Authorizer.html">Setting up Atlas to use Ranger Authorizer</a>.</p></div>
-<div class="section">
-<h4><a name="None_authorizer"></a>None authorizer</h4>
-<p>In addition to the default authorizer, Apache Atlas includes an authorizer that permits all accesses to all users. This authorizer can be useful in test environments and unit tests. To use this authorizer, set the following configuration:</p>
-<div class="source"><pre class="prettyprint">
-atlas.authorizer.impl=NONE
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Atlas-Authorization-Ranger-Authorizer.html b/Atlas-Authorization-Ranger-Authorizer.html
deleted file mode 100644
index f155b6d..0000000
--- a/Atlas-Authorization-Ranger-Authorizer.html
+++ /dev/null
@@ -1,175 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Atlas-Authorization-Ranger-Authorizer.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Setting up Apache Atlas to use Apache Ranger Authorization</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Setting up Apache Atlas to use Apache Ranger Authorization</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h4><a name="Setting_up_Apache_Atlas_to_use_Apache_Ranger_Authorization"></a>Setting up Apache Atlas to use Apache Ranger Authorization</h4>
-<p>As detailed in <a href="./Atlas-Authorization-Model.html">Atlas Authorization Model</a>, Apache Atlas supports pluggable authorization model. Apache Ranger provides an authorizer implementation that uses Apache Ranger policies for authorization. In addition, the authorizer provided by Apache Ranger audits all authorizations into a central audit store.</p></div>
-<div class="section">
-<h5><a name="Configure_Apache_Atlas"></a>Configure Apache Atlas</h5>
-<p>To configure Apache Atlas to use Apache Ranger authorizer, please follow the instructions given below:</p>
-<p></p>
-<ul>
-<li>Include the following property in atlas-application.properties config file:</li></ul>
-<div class="source"><pre class="prettyprint">atlas.authorizer.impl=ranger
-</pre></div>
-<p>If you use Apache Ambari to deploy Apache Atlas and Apache Ranger, enable Atlas plugin in configuration pages for Apache Ranger.</p>
-<p></p>
-<ul>
-<li>Include libraries of Apache Ranger plugin in libext directory of Apache Atlas
-<ul>
-<li><tt><Atlas installation directory></tt>/libext/ranger-atlas-plugin-impl/</li>
-<li><tt><Atlas installation directory></tt>/libext/ranger-atlas-plugin-shim-<version>.jar</li>
-<li><tt><Atlas installation directory></tt>/libext/ranger-plugin-classloader-<version>.jar</li></ul></li></ul>
-<p></p>
-<ul>
-<li>Include configuration files for Apache Ranger plugin in configuration directory of Apache Atlas - typically under /etc/atlas/conf directory. For more details on configuration file contents, please refer to appropriate documentation in Apache Ranger.
-<ul>
-<li><tt><Atlas configuration directory></tt>/ranger-atlas-audit.xml</li>
-<li><tt><Atlas configuration directory></tt>/ranger-atlas-security.xml</li>
-<li><tt><Atlas configuration directory></tt>/ranger-policymgr-ssl.xml</li>
-<li><tt><Atlas configuration directory></tt>/ranger-security.xml</li></ul></li></ul></div>
-<div class="section">
-<h5><a name="Apache_Ranger_authorization_policy_model_for_Apache_Atlas"></a>Apache Ranger authorization policy model for Apache Atlas</h5>
-<p>Apache Ranger authorization policy model for Apache Atlas supports 3 resource hierarchies, to control access to: types, entities and admin operations. Following images show various details of each type of policy in Apache Ranger.</p>
-<p></p>
-<ul>
-<li><b>Types</b></li></ul>
-<p>Following authorization policy allows user 'admin' to create/update/delete any classification type. <p></p> <img alt="Apache Ranger policy for type operations" src="images/twiki/ranger-policy-types.png" width="800" style="border:1px solid black; margin-left:20px"></img></p><hr />
-<p></p>
-<ul>
-<li><b>Entity</b></li></ul>
-<p>Following authorization policy allows user 'admin' perform all operations on metadata entities of Hive database named "my_db". <p></p> <img alt="Apache Ranger policy for entity operations" src="images/twiki/ranger-policy-entities.png" width="800" style="border:1px solid black; margin-left:20px"></img></p><hr />
-<p></p>
-<ul>
-<li><b>Admin Operations</b></li></ul>Following authorization policy allows user 'admin' to perform export/import admin operations. <p></p> <img alt="Apache Ranger policy for admin operations" src="images/twiki/ranger-policy-admin.png" width="800" style="border:1px solid black; margin-left:20px"></img><hr /></div>
-<div class="section">
-<h5><a name="Apache_Ranger_access_audit_for_Apache_Atlas_authorizations"></a>Apache Ranger access audit for Apache Atlas authorizations</h5>
-<p>Apache Ranger authorization plugin generates audit logs with details of the access authorized by the plugin. The details include the object accessed (eg. hive_table with ID cost_savings.claim_savings@cl1), type of access performed (eg. entity-add-classification, entity-remove-classification), name of the user, time of access and the IP address the access request came from - as shown in the following image.</p>
-<p><img alt="Apache Ranger audit " src="images/twiki/ranger-audit.png" width="1000" style="border:1px solid black; margin-left:20px"></img></p></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Atlas-Authorization-Simple-Authorizer.html b/Atlas-Authorization-Simple-Authorizer.html
deleted file mode 100644
index 0014fc8..0000000
--- a/Atlas-Authorization-Simple-Authorizer.html
+++ /dev/null
@@ -1,260 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Atlas-Authorization-Simple-Authorizer.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Setting up Atlas to use Simple Authorizer</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Setting up Atlas to use Simple Authorizer</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h4><a name="Setting_up_Atlas_to_use_Simple_Authorizer"></a>Setting up Atlas to use Simple Authorizer</h4>
-<p>As detailed in <a href="./Atlas-Authorization-Model.html">Atlas Authorization Model</a>, Apache Atlas supports a pluggable authorization model. Simple authorizer is the default authorizer implementation included in Apache Atlas. Simple authorizer uses policies defined in a JSON file. This document provides details of steps to configure Apache Atlas to use the simple authorizer and details of the JSON file format containing authorization policies.</p></div>
-<div class="section">
-<h5><a name="Configure_Apache_Atlas"></a>Configure Apache Atlas</h5>
-<p>To configure Apache Atlas to use simple authorizer, include the following properties in application.properties config file:</p>
-<div class="source"><pre class="prettyprint">
-atlas.authorizer.impl=simple
-atlas.authorizer.simple.authz.policy.file=/etc/atlas/conf/atlas-simple-authz-policy.json
-
-</pre></div>
-<p>Please note that if the policy file location specified is not an absolute path, the file will be looked up in following paths:</p>
-<ul>
-<li>Apache Atlas configuration directory (specified by system property <tt>atlas.conf</tt>)</li>
-<li>Apache Atlas server's current directory</li>
-<li>CLASSPATH</li></ul></div>
-<div class="section">
-<h5><a name="Policy_file_format"></a>Policy file format</h5>
-<p>Simple authorizer uses <tt>roles</tt> to group permissions, which can then be assigned to users and user-groups. Following examples would help to understand the details of the policy file format:</p></div>
-<div class="section">
-<h6><a name="Roles"></a>Roles</h6>
-<p>Following policy file defines 3 roles:</p>
-<ul>
-<li>ROLE_ADMIN: has all permissions</li>
-<li>PROD_READ_ONLY: has access to read entities having qualifiedName ending with "@prod"</li>
-<li>TEST_ALL_ACCESS: has all access to entities having qualifiedName ending with "@test"</li></ul>
-<p>Simple authorizer supports Java reg-ex to specify values for privilege/entity-type/entity-id/classification/typeName/typeCategory.</p>
-<div class="source"><pre class="prettyprint">
-{
- "roles": {
- "ROLE_ADMIN": {
- "adminPermissions": [
- {
- "privileges": [ ".*" ]
- }
- ],
-
- "entityPermissions": [
- {
- "privileges": [ ".*" ],
- "entityTypes": [ ".*" ],
- "entityIds": [ ".*" ],
- "classifications": [ ".*" ]
- }
- ],
-
- "typePermissions": [
- {
- "privileges": [ ".*" ],
- "typeCategories": [ ".*" ],
- "typeNames": [ ".*" ]
- }
- ]
- },
-
- "PROD_READ_ONLY" : {
- "entityPermissions": [
- {
- "privileges": [ "entity-read", "entity-read-classification" ],
- "entityTypes": [ ".*" ],
- "entityIds": [ ".*@prod" ],
- "classifications": [ ".*" ]
- }
- }
-
- "TEST_ALL_ACCESS" : {
- "entityPermissions": [
- {
- "privileges": [ ".*" ],
- "entityTypes": [ ".*" ],
- "entityIds": [ ".*@test" ],
- "classifications": [ ".*" ]
- }
- }
- },
-
- "userRoles": {
- ...
- },
-
- "groupRoles": {
- ...
- }
-}
-
-
-</pre></div></div>
-<div class="section">
-<h6><a name="Assign_Roles_to_Users_and_User_Groups"></a>Assign Roles to Users and User Groups</h6>
-<p>Roles defined above can be assigned (granted) to users as shown below:</p>
-<div class="source"><pre class="prettyprint">
-{
- "roles": {
- ...
- },
-
- "userRoles": {
- "admin": [ "ROLE_ADMIN" ],
- "steward": [ "DATA_STEWARD" ],
- "user1": [ "PROD_READ_ONLY" ],
- "user2": [ "TEST_ALL_ACCESS" ],
- "user3": [ "PROD_READ_ONLY", "TEST_ALL_ACCESS" ],
- },
-
- "groupRoles": {
- ...
- }
-}
-
-</pre></div>
-<p>Roles can be assigned (granted) to user-groups as shown below. An user can belong to multiple groups; roles assigned to all groups the user belongs to will be used to authorize the access.</p>
-<div class="source"><pre class="prettyprint">
-{
- "roles": {
- ...
- },
-
- "userRoles": {
- ...
- },
-
- "groupRoles": {
- "admins": [ "ROLE_ADMIN" ],
- "dataStewards": [ "DATA_STEWARD" ],
- "testUsers": [ "TEST_ALL_ACCESS" ],
- "prodReadUsers": [ "PROD_READ_ONLY" ]
- }
-}
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/AtlasRepairIndex.html b/AtlasRepairIndex.html
deleted file mode 100644
index 745c0e4..0000000
--- a/AtlasRepairIndex.html
+++ /dev/null
@@ -1,158 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/AtlasRepairIndex.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – </title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active "></li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<!--
- ~ Licensed to the Apache Software Foundation (ASF) under one
- ~ or more contributor license agreements. See the NOTICE file
- ~ distributed with this work for additional information
- ~ regarding copyright ownership. The ASF licenses this file
- ~ to you under the Apache License, Version 2.0 (the
- ~ "License"); you may not use this file except in compliance
- ~ with the License. You may obtain a copy of the License at
- ~
- ~ http://www.apache.org/licenses/LICENSE-2.0
- ~
- ~ Unless required by applicable law or agreed to in writing, software
- ~ distributed under the License is distributed on an "AS IS" BASIS,
- ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- ~ See the License for the specific language governing permissions and
- ~ limitations under the License.
- -->
-<p>##Introduction</p>
-<p>The document describes the use of the Atlas Index Repair Utility for JanusGraph, with HBase as back-end data store and Solr as index store. ####Need for this Tool In rare, cases it is possible that during entity creation, the entity is stored in the data store, but the corresponding indexes are not created in Solr. Since Atlas relies heavily on Solr in the operation of its Basic Search, this will result in entity not being returned by a search. Note that Advanced Search is not affecte [...]
-<p>>atlas-index-repair/repair_index.py</p>
-<p>This will result in vertex_index, edge_index and fulltext_index to be re-built completely. It is recommended that existing contents of these indexes be deleted before executing this restore. ######Caveats Note that the full index repair is a time consuming process. Depending on the size of data the process may take days to complete. During the restore process the Basic Search functionality will not be available. Be sure to allocate sufficient time for this activity. #####Selective Res [...]
-<p>Example: > atlas-index-repair/repair_index.py -g 13d77457-2a45-4e92-ad53-a172c7cb70a5</p>
-<p>Note that Atlas will use REST APIs to fetch the entity, which will need correct authentication mechanism to be specified based on the installation.</p>
-<p>For an Atlas installation with username and password use: >atlas-index-repair/repair_index.py [-g <guid>] [-u <user>] [-p <password>] * guid: [optional] specify guid for which indexes are to be updated<br />
-* user: [optional] specify username for atlas instance * password: [optional] specify password for atlas instance</p>
-<p>Example: >atlas-index-repair/repair_index.py -u admin -p admin123 -g 13d77457-2a45-4e92-ad53-a172c7cb70a5</p>
-<p>For Atlas installation that uses kerberos as authentication mode, use: kinit -kt /etc/security/keytabs/atlas.service.keytab atlas/fqdn@DOMAIN</p>
-<p>Example: >kinit -kt /etc/security/keytabs/atlas.service.keytab <a class="externalLink" href="mailto:atlas/fqdn@EXAMPLE.com">atlas/fqdn@EXAMPLE.com</a> > >atlas-index-repair/repair_index.py -g 13d77457-2a45-4e92-ad53-a172c7cb70a5</p>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/AtlasServer.html b/AtlasServer.html
deleted file mode 100644
index 7f04f1a..0000000
--- a/AtlasServer.html
+++ /dev/null
@@ -1,267 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/AtlasServer.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Atlas Server Entity Type</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Atlas Server Entity Type</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<!--
- ~ Licensed to the Apache Software Foundation (ASF) under one
- ~ or more contributor license agreements. See the NOTICE file
- ~ distributed with this work for additional information
- ~ regarding copyright ownership. The ASF licenses this file
- ~ to you under the Apache License, Version 2.0 (the
- ~ "License"); you may not use this file except in compliance
- ~ with the License. You may obtain a copy of the License at
- ~
- ~ http://www.apache.org/licenses/LICENSE-2.0
- ~
- ~ Unless required by applicable law or agreed to in writing, software
- ~ distributed under the License is distributed on an "AS IS" BASIS,
- ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- ~ See the License for the specific language governing permissions and
- ~ limitations under the License.
- -->
-<h1>Atlas Server Entity Type</h1>
-<div class="section">
-<div class="section">
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>The <i>AtlasServer</i> entity type is special entity type in following ways:</p>
-<ul>
-
-<li>Gets created during Export or Import operation.</li>
-<li>It also has special property pages that display detailed audits for export and import operations.</li>
-<li>Entities are linked to it using the new option within entity’s attribute <i><a href="SoftReference">SoftReference</a></i>.</li>
-</ul>
-<p>The new type is available within the <i>Search By Type</i> dropdown in both <i>Basic</i> and <i>Advanced</i> search.</p></div>
-<div class="section">
-<h4><a name="Creation"></a>Creation</h4>
-<p>The entity of this type is created upon successful completion of every Export and Import operation. The entity is created with current cluster’s name.</p>
-<p>The entity is also created based on export and import requests’ <i>replicatedTo</i> and <i>replicatedFrom</i> parameters.</p></div>
-<div class="section">
-<h4><a name="Details_within_Property_Page"></a>Details within Property Page</h4>
-<p>The property page for <i>AtlasServer</i> entity has one additional tab ‘Export/Import Audits’. This has detailed audit record for each export and/or import operation performed on current Atlas instance.</p>
-<p>The <i>additionalInfo</i> attribute property is discussed in detail below.</p>
-<img src="images/markdown/atlas-server-properties.png" style="border:1px solid; margin-left:25px" alt="" />
-
-<div class="section">
-<div class="section">
-<h6><a name="Export.2FImport_Audits"></a>Export/Import Audits</h6>
-<p>The table has following columns:</p>
-<ul>
-
-<li><i>Operation</i>: EXPORT or IMPORT that denotes the operation performed on instance.</li>
-<li><i>Source Server</i>: For an export operation performed on this instance, the value in this column will always be the cluster name of the current Atlas instance. This is the value specified in <i>atlas-application.properties</i> by the key <i>atlas.cluster.name</i>. If not value is specified ‘default’ is used.</li>
-<li><i>Target Server</i>: If an export operation is performed with <i>replicatedTo</i> property specified in the request, that value appears here.</li>
-<li><i>Operation StartTime</i>: Time the operation was started.</li>
-<li><i>Operation EndTIme</i>: Time the operation completed.</li>
-<li><i>Tools</i>: Pop-up property page that contains details of the operation.</li>
-</ul>
-<img src="images/markdown/atlas-server-exp-imp-audits.png" style="border:1px solid; margin-left:25px" alt="" />
-</div>
-<div class="section">
-<h6><a name="Example"></a>Example</h6>
-<p>The following export request will end up creating <i>AtlasServer</i> entity with <i>clMain</i> as its name. The audit record of this operation will be displayed within the property page of this entity.</p>
-
-<div>
-<div>
-<pre class="source">{
- "itemsToExport": [
- { "typeName": "hive_db", "uniqueAttributes": { "qualifiedName": "stocks@cl1" }}
- ],
- "options": {
- "replicatedTo": "clMain"
- }
-}
-</pre></div></div>
-</div></div></div>
-<div class="section">
-<h4><a name="Support_for_Cluster.E2.80.99s_Full_Name"></a>Support for Cluster’s Full Name</h4>
-<p>Often times it is necessary to disambiguate the name of the cluster by specifying the location or the data center within which the Atlas instance resides.</p>
-<p>The name of the cluster can be specified by separating the location name and cluster name by ‘$’. For example, a clsuter name specified as ‘SFO$cl1’ can be a cluster in San Fancisco (SFO) data center with the name ‘cl1’.</p>
-<p>The <i>AtlasServer</i> will handle this and set its name as ‘cl1’ and <i>fullName</i> as ‘SFO@cl1’.</p></div>
-<div class="section">
-<h4><a name="Additional_Information"></a>Additional Information</h4>
-<p>This property in <i>AtlasServer</i> is a map with key and value both as String. This can be used to store any information pertaining to this instance.</p>
-<p>Please see <a href="IncrementalExport">Incremental Export</a> for and example of how this property can be used.</p></div>
-<div class="section">
-<h4><a name="REST_APIs"></a>REST APIs</h4>
-<table border="0" class="table table-striped">
-<thead>
-
-<tr class="a">
-<th>Title </th>
-<th>Atlas Server API </th></tr>
-</thead><tbody>
-
-<tr class="b">
-<td>Example </td>
-<td> see below. </td></tr>
-<tr class="a">
-<td>URL </td>
-<td> api/atlas/admin/server/{serverName} </td></tr>
-<tr class="b">
-<td>Method </td>
-<td> GET </td></tr>
-<tr class="a">
-<td>URL Parameters </td>
-<td> name of the server </td></tr>
-<tr class="b">
-<td>Data Parameters </td>
-<td> None </td></tr>
-<tr class="a">
-<td>Success Response</td>
-<td> <i>AtlasServer</i> </td></tr>
-<tr class="b">
-<td>Error Response </td>
-<td> Errors Returned as AtlasBaseException </td></tr>
-</tbody>
-</table>
-<div class="section">
-<div class="section">
-<h6><a name="CURL"></a>CURL</h6>
-
-<div>
-<div>
-<pre class="source">curl -X GET -u admin:admin -H "Content-Type: application/json" -H "Cache-Control: no-cache" http://localhost:21000/api/atlas/admin/server/cl2
-</pre></div></div>
-
-<p>Output:</p>
-
-<div>
-<div>
-<pre class="source">{
- "guid": "f87e4fd1-bfb5-482d-9ab1-e735621b7d16",
- "name": "cl2",
- "qualifiedName": "cl2",
- "additionalInfo": {
- "nextModifiedTimestamp": "1533037289383",
- "replicationOperation": "EXPORT",
- "topLevelEntity": "stocks@cl1"
- }
-}
-</pre></div></div></div></div></div></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/AtlasTechnicalUserGuide.pdf b/AtlasTechnicalUserGuide.pdf
deleted file mode 100644
index 4d647a8..0000000
Binary files a/AtlasTechnicalUserGuide.pdf and /dev/null differ
diff --git a/Bridge-Kafka.html b/Bridge-Kafka.html
deleted file mode 100644
index c7a7f26..0000000
--- a/Bridge-Kafka.html
+++ /dev/null
@@ -1,165 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Bridge-Kafka.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Apache Atlas Hook for Apache Kafka</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Apache Atlas Hook for Apache Kafka</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Apache_Atlas_Hook_for_Apache_Kafka"></a>Apache Atlas Hook for Apache Kafka</h2></div>
-<div class="section">
-<h3><a name="Kafka_Model"></a>Kafka Model</h3>
-<p>Kafka model includes the following types:</p>
-<ul>
-<li>Entity types:
-<ul>
-<li>kafka_topic
-<ul>
-<li>super-types: DataSet</li>
-<li>attributes: qualifiedName, name, description, owner, topic, uri, partitionCount</li></ul></li></ul></li></ul>
-<p>Kafka entities are created and de-duped in Atlas using unique attribute qualifiedName, whose value should be formatted as detailed below. Note that qualifiedName will have topic name in lower case.</p>
-<div class="source"><pre class="prettyprint">
- topic.qualifiedName: <topic>@<clusterName>
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Setup"></a>Setup</h3>
-<p>Binary files are present in apache-atlas-<release-version>-kafka-hook.tar.gz</p>
-<p>Copy apache-atlas-kafka-hook-<release-version>/hook/kafka folder to <atlas package>/hook/ directory</p>
-<p>Copy apache-atlas-kafka-hook-<release-version>/hook-bin folder to <atlas package>/hook-bin directory</p></div>
-<div class="section">
-<h3><a name="Importing_Kafka_Metadata"></a>Importing Kafka Metadata</h3>
-<p>Apache Atlas provides a command-line utility, import-kafka.sh, to import metadata of Apache Kafka topics into Apache Atlas. This utility can be used to initialize Apache Atlas with topics present in Apache Kafka. This utility supports importing metadata of a specific topic or all topics.</p>
-<div class="source"><pre class="prettyprint">
-Usage 1: <atlas package>/hook-bin/import-kafka.sh
-Usage 2: <atlas package>/hook-bin/import-kafka.sh [-t <topic prefix> OR --topic <topic prefix>]
-Usage 3: <atlas package>/hook-bin/import-kafka.sh [-f <filename>]
- File Format:
- topic1
- topic2
- topic3
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/ClassificationPropagation.html b/ClassificationPropagation.html
deleted file mode 100644
index f7a7897..0000000
--- a/ClassificationPropagation.html
+++ /dev/null
@@ -1,187 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/ClassificationPropagation.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Classification Propagation</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Classification Propagation</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Classification_Propagation"></a>Classification Propagation</h2>
-<p>Classification propagation enables classifications associated to an entity to be automatically associated with other related entities of the entity. This is very useful in dealing with scenarios where a dataset derives it data from other datasets - like a table loaded with data in a file, a report generated from a table/view, etc. For example, when a table is classified as <b>"PII"</b>, tables or views that derive data from this table (via CTAS or ‘create view’ [...]
-<div class="section">
-<h3><a name="Use_Cases"></a>Use Cases</h3>
-<p>Consider the following lineage where data from a 'hdfs_path' entity is loaded into a table, which is further made available through views. We will go through various scenarios to understand the classification propagation feature.</p>
-<p><img src="images/twiki/classification-propagation-1.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Add_classification_to_an_entity"></a>Add classification to an entity</h3>
-<p>When classification ‘PII’ is added to 'hdfs_path' entity, the classification is propagated to all impacted entities in the lineage path, including 'employees' table, views 'us_employees' and 'uk_employees' - as shown below.</p>
-<p><img src="images/twiki/classification-propagation-2.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Update_classification_associated_with_an_entity"></a>Update classification associated with an entity</h3>
-<p>Any updates to classifications associated with an entity will be seen in all entities the classification is propagated to as well.</p>
-<p><img src="images/twiki/classification-propagation-3.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Remove_classification_associated_with_an_entity"></a>Remove classification associated with an entity</h3>
-<p>When a classification is deleted from an entity, the classification will be removed from all entities the classification is propagated to as well.</p>
-<p><img src="images/twiki/classification-propagation-4.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Add_lineage_between_entities"></a>Add lineage between entities</h3>
-<p>When lineage is added between entities, for example to capture loading of data in a file to a table, the classifications associated with the source entity are propagated to all impacted entities as well.</p>
-<p>For example, when a view is created from a table, classifications associated with the table are propagated to the newly created view as well.</p>
-<p><img src="images/twiki/classification-propagation-5.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Delete_an_entity"></a>Delete an entity</h3>
-<p><b>Case 1:</b> When an entity is deleted, classifications associated with this entity will be removed from all entities the classifications are propagated to.</p>
-<p>For example. when <i>employees</i> table is deleted, classifications associated with this table are removed from 'employees_view' view.</p>
-<p><img src="images/twiki/classification-propagation-6.png" width="800" style="margin-left:20px"></img></p>
-<p><b>Case 2:</b> When an entity is deleted in the middle of a lineage path, the propagation link is broken and previously propagated classifications will be removed from all derived entities of the deleted entity.</p>
-<p>For example. when 'us_employees' table is deleted, classifications propagating through this table (<b>PII</b>) are removed from 'ca_employees' table, since the only path of propagation is broken by entity deletion.</p>
-<p><img src="images/twiki/classification-propagation-entity-delete-1.png" width="800" style="margin-left:20px"></img></p>
-<p><img src="images/twiki/classification-propagation-entity-delete-2.png" width="800" style="margin-left:20px"></img></p>
-<p><b>Case 3:</b> When an entity is deleted in the middle of a lineage path and if there exists alternate path for propagation, previously propagated classifications will be retained.</p>
-<p>For example. when 'us_employees' table is deleted, classifications propagating (<b>PII</b>) through this table are retained in 'ca_employees' table, since there are two propagation paths available and only one of them is broken by entity deletion.</p>
-<p><img src="images/twiki/classification-propagation-entity-delete-3.png" width="800" style="margin-left:20px"></img></p>
-<p><img src="images/twiki/classification-propagation-entity-delete-4.png" width="800" style="margin-left:20px"></img></p></div>
-<div class="section">
-<h3><a name="Control_Propagation"></a>Control Propagation</h3>
-<p>Apache Atlas provides few options to control whether/where a classification is propagated. This section details available options.</p></div>
-<div class="section">
-<h3><a name="Propagate_flag_in_classification"></a>Propagate flag in classification</h3>
-<p>Each association of classification to an entity has a boolean flag that controls whether the classification is propagated or not. When a classification is associated with an entity, this flag is set to ‘true’ i.e. the classification will be propagated to all impacted entities. This flag can be updated to desired value during initial association or later.</p>
-<p><img src="images/twiki/classification-propagation-7.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Propagate_flag_in_lineage_edge"></a>Propagate flag in lineage edge</h3>
-<p>Apache Atlas supports a flag at lineage edge to enable/disable propagation of classifications through the edge. By default, the propagation is enabled for lineage edges. When the flag is turned off, no classification will be propagated through this edge; and propagation of currently propagated classifications through the edge will be reevaluated, so that they can be removed from impacted entities. When the flag is turned on, propagation of classifications of the source entity will be [...]
-<div class="section">
-<h3><a name="Block_propagation_of_specific_classifications_in_lineage_edge"></a>Block propagation of specific classifications in lineage edge</h3>
-<p>Apache Atlas supports blocking propagation of specific classifications in at lineage edges. This can be useful, for example, to handle scenarios like: a column classified as PII is masked when creating a view; in such scenario, if corresponding column in the created view might not have PII, hence the propagation of PII classification should be blocked. This can be done by updating the lineage edge to add the PII classification in <i>‘blocked propagated classifications’</ [...]
-<p><img src="images/twiki/classification-propagation-8.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Notifications_and_Audit"></a>Notifications and Audit</h3>
-<p>When propagated classifications are added/update/deleted, Apache Atlas sends notifications to 'ATLAS_ENTITIES' topic for each entity affected by the propagation.</p></div>
-<div class="section">
-<h3><a name="Glossary"></a>Glossary</h3>
-<p>When a classification is associated with a glossary term, the classification is automatically propagated to all entities associated with the term.</p></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Configuration.html b/Configuration.html
deleted file mode 100644
index a7451c3..0000000
--- a/Configuration.html
+++ /dev/null
@@ -1,329 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Configuration.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Configuring Apache Atlas - Application Properties</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Configuring Apache Atlas - Application Properties</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Configuring_Apache_Atlas_-_Application_Properties"></a>Configuring Apache Atlas - Application Properties</h2>
-<p>All configuration in Atlas uses java properties style configuration. The main configuration file is atlas-application.properties which is in the <b>conf</b> dir at the deployed location. It consists of the following sections:</p></div>
-<div class="section">
-<h3><a name="Graph_Configs"></a>Graph Configs</h3></div>
-<div class="section">
-<h4><a name="Graph_Persistence_engine_-_HBase"></a>Graph Persistence engine - HBase</h4>
-<p>Set the following properties to configure <a href="./JanusGraph.html">JanusGraph</a> to use HBase as the persistence engine. Please refer to <a href="http://docs.janusgraph.org/0.2.0/configuration.html#_hbase_caching">link</a> for more details.</p>
-<div class="source"><pre class="prettyprint">
-atlas.graph.storage.backend=hbase
-atlas.graph.storage.hostname=<ZooKeeper Quorum>
-atlas.graph.storage.hbase.table=atlas
-
-</pre></div>
-<p>If any further <a href="./JanusGraph.html">JanusGraph</a> configuration needs to be setup, please prefix the property name with "atlas.graph.".</p>
-<p>In addition to setting up configurations, please ensure that environment variable HBASE_CONF_DIR is setup to point to the directory containing HBase configuration file hbase-site.xml.</p></div>
-<div class="section">
-<h4><a name="Graph_Index_Search_Engine"></a>Graph Index Search Engine</h4>
-<p>An index search engine is required for ATLAS. This search engine runs separately from the ATLAS server and from the storage backend. Only two search engines are currently supported: Solr and Elasticsearch. Pick the search engine best suited for your environment and follow the configuration instructions below.</p></div>
-<div class="section">
-<h5><a name="Graph_Search_Index_-_Solr"></a>Graph Search Index - Solr</h5>
-<p>Solr installation in Cloud mode is a prerequisite for Apache Atlas use. Set the following properties to configure <a href="./JanusGraph.html">JanusGraph</a> to use Solr as the index search engine.</p>
-<div class="source"><pre class="prettyprint">
-atlas.graph.index.search.backend=solr5
-atlas.graph.index.search.solr.mode=cloud
-atlas.graph.index.search.solr.wait-searcher=true
-
-# ZK quorum setup for solr as comma separated value. Example: 10.1.6.4:2181,10.1.6.5:2181
-atlas.graph.index.search.solr.zookeeper-url=
-
-# SolrCloud Zookeeper Connection Timeout. Default value is 60000 ms
-atlas.graph.index.search.solr.zookeeper-connect-timeout=60000
-
-# SolrCloud Zookeeper Session Timeout. Default value is 60000 ms
-atlas.graph.index.search.solr.zookeeper-session-timeout=60000
-
-</pre></div></div>
-<div class="section">
-<h5><a name="Graph_Search_Index_-_Elasticsearch_.28Tech_Preview.29"></a>Graph Search Index - Elasticsearch (Tech Preview)</h5>
-<p>Elasticsearch is a prerequisite for Apache Atlas use. Set the following properties to configure <a href="./JanusGraph.html">JanusGraph</a> to use Elasticsearch as the index search engine.</p>
-<div class="source"><pre class="prettyprint">
-atlas.graph.index.search.backend=elasticsearch
-atlas.graph.index.search.hostname=<hostname(s) of the Elasticsearch master nodes comma separated>
-atlas.graph.index.search.elasticsearch.client-only=true
-</pre></div></div>
-<div class="section">
-<h3><a name="Search_Configs"></a>Search Configs</h3>
-<p>Search APIs (DSL, basic search, full-text search) support pagination and have optional limit and offset arguments. Following configs are related to search pagination</p>
-<div class="source"><pre class="prettyprint">
-# Default limit used when limit is not specified in API
-atlas.search.defaultlimit=100
-
-# Maximum limit allowed in API. Limits maximum results that can be fetched to make sure the atlas server doesn't run out of memory
-atlas.search.maxlimit=10000
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Notification_Configs"></a>Notification Configs</h3>
-<p>Refer <a class="externalLink" href="http://kafka.apache.org/documentation.html#configuration">http://kafka.apache.org/documentation.html#configuration</a> for Kafka configuration. All Kafka configs should be prefixed with 'atlas.kafka.'</p>
-<div class="source"><pre class="prettyprint">
-atlas.kafka.auto.commit.enable=false
-
-# Kafka servers. Example: localhost:6667
-atlas.kafka.bootstrap.servers=
-
-atlas.kafka.hook.group.id=atlas
-
-# Zookeeper connect URL for Kafka. Example: localhost:2181
-atlas.kafka.zookeeper.connect=
-
-atlas.kafka.zookeeper.connection.timeout.ms=30000
-atlas.kafka.zookeeper.session.timeout.ms=60000
-atlas.kafka.zookeeper.sync.time.ms=20
-
-# Setup the following configurations only in test deployments where Kafka is started within Atlas in embedded mode
-# atlas.notification.embedded=true
-# atlas.kafka.data=${sys:atlas.home}/data/kafka
-
-# Setup the following two properties if Kafka is running in Kerberized mode.
-# atlas.notification.kafka.service.principal=kafka/_HOST@EXAMPLE.COM
-# atlas.notification.kafka.keytab.location=/etc/security/keytabs/kafka.service.keytab
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Client_Configs"></a>Client Configs</h3>
-<div class="source"><pre class="prettyprint">
-atlas.client.readTimeoutMSecs=60000
-atlas.client.connectTimeoutMSecs=60000
-
-# URL to access Atlas server. For example: http://localhost:21000
-atlas.rest.address=
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Security_Properties"></a>Security Properties</h3></div>
-<div class="section">
-<h4><a name="SSL_config"></a>SSL config</h4>
-<p>The following property is used to toggle the SSL feature.</p>
-<div class="source"><pre class="prettyprint">
-atlas.enableTLS=false
-
-</pre></div></div>
-<div class="section">
-<h3><a name="High_Availability_Properties"></a>High Availability Properties</h3>
-<p>The following properties describe High Availability related configuration options:</p>
-<div class="source"><pre class="prettyprint">
-# Set the following property to true, to enable High Availability. Default = false.
-atlas.server.ha.enabled=true
-
-# Specify the list of Atlas instances
-atlas.server.ids=id1,id2
-# For each instance defined above, define the host and port on which Atlas server listens.
-atlas.server.address.id1=host1.company.com:21000
-atlas.server.address.id2=host2.company.com:31000
-
-# Specify Zookeeper properties needed for HA.
-# Specify the list of services running Zookeeper servers as a comma separated list.
-atlas.server.ha.zookeeper.connect=zk1.company.com:2181,zk2.company.com:2181,zk3.company.com:2181
-
-# Specify how many times should connection try to be established with a Zookeeper cluster, in case of any connection issues.
-atlas.server.ha.zookeeper.num.retries=3
-
-# Specify how much time should the server wait before attempting connections to Zookeeper, in case of any connection issues.
-atlas.server.ha.zookeeper.retry.sleeptime.ms=1000
-
-# Specify how long a session to Zookeeper should last without inactiviy to be deemed as unreachable.
-atlas.server.ha.zookeeper.session.timeout.ms=20000
-
-# Specify the scheme and the identity to be used for setting up ACLs on nodes created in Zookeeper for HA.
-# The format of these options is <scheme>:<identity>. For more information refer to http://zookeeper.apache.org/doc/r3.2.2/zookeeperProgrammers.html#sc_ZooKeeperAccessControl.
-# The 'acl' option allows to specify a scheme, identity pair to setup an ACL for.
-atlas.server.ha.zookeeper.acl=sasl:client@comany.com
-
-# The 'auth' option specifies the authentication that should be used for connecting to Zookeeper.
-atlas.server.ha.zookeeper.auth=sasl:client@company.com
-
-# Since Zookeeper is a shared service that is typically used by many components,
-# it is preferable for each component to set its znodes under a namespace.
-# Specify the namespace under which the znodes should be written. Default = /apache_atlas
-atlas.server.ha.zookeeper.zkroot=/apache_atlas
-
-# Specify number of times a client should retry with an instance before selecting another active instance, or failing an operation.
-atlas.client.ha.retries=4
-# Specify interval between retries for a client.
-atlas.client.ha.sleep.interval.ms=5000
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Server_Properties"></a>Server Properties</h3>
-<div class="source"><pre class="prettyprint">
-# Set the following property to true, to enable the setup steps to run on each server start. Default = false.
-atlas.server.run.setup.on.start=false
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Performance_configuration_items"></a>Performance configuration items</h3>
-<p>The following properties can be used to tune performance of Atlas under specific circumstances:</p>
-<div class="source"><pre class="prettyprint">
-# The number of times Atlas code tries to acquire a lock (to ensure consistency) while committing a transaction.
-# This should be related to the amount of concurrency expected to be supported by the server. For e.g. with retries set to 10, upto 100 threads can concurrently create types in the Atlas system.
-# If this is set to a low value (default is 3), concurrent operations might fail with a PermanentLockingException.
-atlas.graph.storage.lock.retries=10
-
-# Milliseconds to wait before evicting a cached entry. This should be > atlas.graph.storage.lock.wait-time x atlas.graph.storage.lock.retries
-# If this is set to a low value (default is 10000), warnings on transactions taking too long will occur in the Atlas application log.
-atlas.graph.storage.cache.db-cache-time=120000
-
-# Minimum number of threads in the atlas web server
-atlas.webserver.minthreads=10
-
-# Maximum number of threads in the atlas web server
-atlas.webserver.maxthreads=100
-
-# Keepalive time in secs for the thread pool of the atlas web server
-atlas.webserver.keepalivetimesecs=60
-
-# Queue size for the requests(when max threads are busy) for the atlas web server
-atlas.webserver.queuesize=100
-
-</pre></div></div>
-<div class="section">
-<h4><a name="Recording_performance_metrics"></a>Recording performance metrics</h4>
-<p>To enable performance logs for various Atlas operations (like REST API calls, notification processing), setup the following in atlas-log4j.xml:</p>
-<div class="source"><pre class="prettyprint">
- <appender name="perf_appender" class="org.apache.log4j.DailyRollingFileAppender">
- <param name="File" value="/var/log/atlas/atlas_perf.log"/>
- <param name="datePattern" value="'.'yyyy-MM-dd"/>
- <param name="append" value="true"/>
- <layout class="org.apache.log4j.PatternLayout">
- <param name="ConversionPattern" value="%d|%t|%m%n"/>
- </layout>
- </appender>
-
- <logger name="org.apache.atlas.perf" additivity="false">
- <level value="debug"/>
- <appender-ref ref="perf_appender"/>
- </logger>
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Downloads.html b/Downloads.html
deleted file mode 100644
index 18a07b9..0000000
--- a/Downloads.html
+++ /dev/null
@@ -1,422 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Downloads.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Downloads</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Downloads</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Downloads"></a>Downloads</h2>
-<p>Apache Atlas release artifacts are distributed via mirror sites and should be checked for tampering using GPG or SHA-256.</p>
-<p>The table below lists release artifacts and their associated signatures and hashes. The keys used to sign the release artifacts can be found in our published <a class="externalLink" href="https://www.apache.org/dist/atlas/KEYS">KEYS file</a>.</p>
-<p></p>
-<table border="0" class="table table-striped">
-<tr class="a">
-<th>Version</th>
-<th>Release Date</th>
-<th>Tarball</th>
-<th>GPG</th>
-<th>Hash</th></tr>
-<tr class="b">
-<td>0.8.4</td>
-<td>2019-06-21</td>
-<td><a class="externalLink" href="https://www.apache.org/dyn/closer.cgi/atlas/0.8.4/apache-atlas-0.8.4-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/0.8.4/apache-atlas-0.8.4-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/0.8.4/apache-atlas-0.8.4-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="a">
-<td>1.2.0</td>
-<td>2019-06-06</td>
-<td><a class="externalLink" href="https://www.apache.org/dyn/closer.cgi/atlas/1.2.0/apache-atlas-1.2.0-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/1.2.0/apache-atlas-1.2.0-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/1.2.0/apache-atlas-1.2.0-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="b">
-<td>2.0.0</td>
-<td>2019-05-14</td>
-<td><a class="externalLink" href="https://www.apache.org/dyn/closer.cgi/atlas/2.0.0/apache-atlas-2.0.0-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/2.0.0/apache-atlas-2.0.0-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/2.0.0/apache-atlas-2.0.0-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="a">
-<td>0.8.3</td>
-<td>2018-11-01</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/atlas/0.8.3/apache-atlas-0.8.3-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/0.8.3/apache-atlas-0.8.3-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/0.8.3/apache-atlas-0.8.3-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="b">
-<td>1.1.0</td>
-<td>2018-09-17</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/atlas/1.1.0/apache-atlas-1.1.0-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/1.1.0/apache-atlas-1.1.0-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/1.1.0/apache-atlas-1.1.0-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="a">
-<td>1.0.0</td>
-<td>2018-06-02</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/atlas/1.0.0/apache-atlas-1.0.0-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/1.0.0/apache-atlas-1.0.0-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/1.0.0/apache-atlas-1.0.0-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="b">
-<td>0.8.2</td>
-<td>2018-02-05</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/atlas/0.8.2/apache-atlas-0.8.2-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/0.8.2/apache-atlas-0.8.2-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://www.apache.org/dist/atlas/0.8.2/apache-atlas-0.8.2-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="a">
-<td>0.8.1</td>
-<td>2017-08-29</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/atlas/0.8.1/apache-atlas-0.8.1-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/atlas/0.8.1/apache-atlas-0.8.1-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/atlas/0.8.1/apache-atlas-0.8.1-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="b">
-<td>0.8.0-incubating</td>
-<td>2017-03-16</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.8.0-incubating/apache-atlas-0.8-incubating-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.8.0-incubating/apache-atlas-0.8-incubating-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.8.0-incubating/apache-atlas-0.8-incubating-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="a">
-<td>0.7.1-incubating</td>
-<td>2017-01-29</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/apache-atlas-0.7.1-incubating-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/apache-atlas-0.7.1-incubating-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/apache-atlas-0.7.1-incubating-sources.tar.gz.mds">checksum</a></td></tr>
-<tr class="b">
-<td>0.7.0-incubating</td>
-<td>2016-07-09</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/apache-atlas-0.7-incubating-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/apache-atlas-0.7-incubating-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/apache-atlas-0.7-incubating-sources.tar.gz.sha512">SHA512</a></td></tr>
-<tr class="a">
-<td>0.6.0-incubating</td>
-<td>2015-12-31</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/apache-atlas-0.6-incubating-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/apache-atlas-0.6-incubating-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/apache-atlas-0.6-incubating-sources.tar.gz.sha">SHA</a></td></tr>
-<tr class="b">
-<td>0.5.0-incubating</td>
-<td>2015-06-22</td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/apache-atlas-0.5-incubating-sources.tar.gz">source</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/apache-atlas-0.5-incubating-sources.tar.gz.asc">signature</a></td>
-<td><a class="externalLink" href="https://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/apache-atlas-0.5-incubating-sources.tar.gz.sha">SHA</a></td></tr></table></div>
-<div class="section">
-<h3><a name="Verify_the_integrity_of_the_files"></a>Verify the integrity of the files</h3>
-<p>It is essential that you verify the integrity of the downloaded file using the PGP signature (.asc file) or a hash (.md5 or .sha* file). Please read <a class="externalLink" href="https://www.apache.org/info/verification.html">Verifying Apache Software Foundation Releases</a> for more information on why you should verify our releases.</p>
-<p>The PGP signature can be verified using PGP or GPG, with the following steps:</p>
-<ul>
-<li>Download the release artifact from the link in the table above</li>
-<li>Download the signature file for the release from the link in the table above</li>
-<li>Download <a class="externalLink" href="https://www.apache.org/dist/atlas/KEYS">Apache Atlas KEYS file</a></li>
-<li>Verify the signatures using one of the following:</li></ul>
-<div class="source"><pre class="prettyprint">
-% gpg --import KEYS
-% gpg --verify downloaded_file.asc downloaded_file
-</pre></div>
-<p>or</p>
-<div class="source"><pre class="prettyprint">
-% pgpk -a KEYS
-% pgpv downloaded_file.asc
-</pre></div>
-<p>or</p>
-<div class="source"><pre class="prettyprint">
-% pgp -ka KEYS
-% pgp downloaded_file.asc
-</pre></div></div>
-<div class="section">
-<h3><a name="Release_Notes"></a>Release Notes</h3>
-<p><b><a href="./../0.8.4/index.html">Atlas 0.8.4</a> (Released on 2018/06/21)</b></p>
-<p></p>
-<ul>
-<li>Entity specific icons updated</li>
-<li>Improve <a href="./FullTextMapper.html">FullTextMapper</a> performance during entity retrieval</li>
-<li>Option to ignore/prune metadata for temporary/staging Hive tables</li>
-<li>Add instrumentation to enable troubleshooting and optimization of ingest</li>
-<li>Name of Kafka topics used by Atlas should be configurable</li>
-<li>Atlas authentication to support proxy-user</li>
-<li>IE-10 Issue fixed</li>
-<li>Lineage UI Improvements
-<ul>
-<li>Show hide tooltip</li>
-<li>Show Path when user hovers on node</li>
-<li>Entity detail popup improvments</li>
-<li>Export Lineage in PNG format</li>
-<li>Search for the node</li>
-<li>Drag and Drop node</li>
-<li>Reset button</li>
-<li>Full Screen support</li></ul></li>
-<li>BugFixes, Optimizations & UI Improvements</li>
-<li><a class="externalLink" href="https://issues.apache.org/jira/issues/?jql=project%3DATLAS%20AND%20resolution%3DFixed%20AND%20fixVersion%3D0.8.4%20ORDER%20BY%20key%20DESC">List of JIRAs resolved in Apache Atlas 0.8.4 release</a></li></ul>
-<p><b><a href="./../1.2.0/index.html">Atlas 1.2.0</a> (Released on 2019/06/06)</b></p>
-<p></p>
-<ul>
-<li>Lineage UI Improvements and changes.</li>
-<li>Show entity specific icon for the lineage node.</li>
-<li>Atlas authentication to support proxy-user.</li>
-<li>Update model files to include service-type for each entityDef.</li>
-<li>Update JanusGraph version to 0.3.1</li>
-<li>New Transform Framework</li>
-<li>Atlas Import Transform Handler Implementation.</li>
-<li>BugFixes, Optimizations & UI Improvements.</li>
-<li><a class="externalLink" href="https://issues.apache.org/jira/issues/?jql=project%3DATLAS%20AND%20resolution%3DFixed%20AND%20fixVersion%3D1.2.0%20ORDER%20BY%20key%20DESC">List of JIRAs resolved in Apache Atlas 1.2.0 release</a></li></ul>
-<p><b><a href="./../2.0.0/index.html">Atlas 2.0.0</a> (Released on 2019/05/14)</b></p>
-<ul>
-<li>Soft-reference attribute implementation.</li>
-<li>Unique-attributes constraints at graph store-level</li>
-<li>Atlas Index Repair tool for Janusgraph</li>
-<li>Relationship notifications when new relationships are created in atlas</li>
-<li>Atlas Import Transform handler implementation</li>
-<li>Updated component versions to use Hadoop 3.1, Hive 3.1, HBase 2.0, Solr 7.5 and Kafka 2.0</li>
-<li>Updated <a href="./JanusGraph.html">JanusGraph</a> version to 0.3.1</li>
-<li>Updated authentication to support trusted proxy</li>
-<li>Updated patch framework to persist typedef patches applied to atlas and handle data patches.</li>
-<li>Updated metrics module to collect notification metrics</li>
-<li>Updated Atlas Export to support incremental export of metadata.</li>
-<li>Notification Processing Improvements:
-<ul>
-<li>Notification processing to support batch-commits</li>
-<li>New option in notification processing to ignore potentially incorrect hive_column_lineage</li>
-<li>Updated Hive hook to avoid duplicate column-lineage entities; also updated Atlas server to skip duplicate column-lineage entities</li>
-<li>Improved batch processing in notificaiton handler to avoid processing of an entity multiple times</li>
-<li>Add option to ignore/prune metadata for temporary/staging hive tables</li>
-<li>Avoid unnecessary lookup when creating new relationships</li></ul></li>
-<li>UI Improvements:
-<ul>
-<li>UI: Display counts besides the Type and Classification dropdown list in basic search</li>
-<li>UI: Display lineage information for process entities</li>
-<li>UI: Display entity specific icon for the lineage graph</li>
-<li>UI: Add relationships table inside relationships view in entity details page.</li>
-<li>UI: Add service-type dropdown in basic search to filter entitydef type.</li></ul></li>
-<li>Various Bug-fixes and optimizations</li>
-<li><a class="externalLink" href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20ATLAS%20AND%20status%20%3D%20Resolved%20AND%20fixVersion%20%3D%202.0.0%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC">List of JIRAs resolved in Apache Atlas 2.0.0 release</a></li></ul>
-<p><b><a href="./../0.8.3/index.html">Atlas 0.8.3</a> (Released on 2018/11/01)</b></p>
-<p></p>
-<ul>
-<li>Utility to detect incorrect entity state</li>
-<li>Export & Import improvements</li>
-<li>Implement clear attribute value transformer for Atlas Entity Transformer</li>
-<li>Rename <a href="./AtlasCluster.html">AtlasCluster</a> to <a href="./AtlasServer.html">AtlasServer</a></li>
-<li>Upgrade commons-fileupload to 1.3.3</li>
-<li>Updated node/NPM version and add package-lock.json</li>
-<li>Enhance <a href="./AtlasClient.html">AtlasClient</a> to use UGI's authentication method to initialize URL connection handler</li>
-<li>UI enhancement for Avro schemas and other JSON-valued attributes</li>
-<li>Updated frontend-maven-plugin to 1.4</li>
-<li>Remove Powermock Usage</li>
-<li>BugFixes, Optimizations & UI Improvements.</li>
-<li><a class="externalLink" href="https://issues.apache.org/jira/issues/?jql=project%3DATLAS%20AND%20resolution%3DFixed%20AND%20fixVersion%3D0.8.3%20ORDER%20BY%20key%20DESC">List of JIRAs resolved in Apache Atlas 0.8.3 release</a></li></ul>
-<p><b><a href="./../1.1.0/index.html">Atlas 1.1.0</a> (Released on 2018/09/17)</b></p>
-<ul>
-<li>Updated authorization model to support access control on relationship operations</li>
-<li>Added support for AWS S3 datatypes, in Atlas server and Hive hook</li>
-<li>Updated <a class="externalLink" href="http://atlas.apache.org/JanusGraph.html">JanusGraph</a> version from 0.2.0 to 0.3.0</li>
-<li>Updated hooks to send Kafka notifications asynchronously</li>
-<li>Enhanced classification-propagation with options to handle entity-deletes</li>
-<li><a href="./BugFixes.html">BugFixes</a> and Optimizations</li></ul>
-<p><b><a href="./../1.0.0/index.html">Atlas 1.0.0</a> (Released on 2018/06/02)</b></p>
-<p></p>
-<ul>
-<li>Core model enhancement to support Relationship as first-class construct</li>
-<li>Support for <a href="./JanusGraph.html">JanusGraph</a> graph database</li>
-<li>New DSL implementation, using ANTLR instead of Scala</li>
-<li>Removal of older type system implementation in atlas-typesystem library</li>
-<li>Metadata security - fine grained authorization</li>
-<li>Notification enhancements to support V2 style data structures</li>
-<li>Jackson library update from 1.9.13 to 2.9.2</li>
-<li>Classification propagation via entity relationships</li>
-<li>Glossary terms, categories</li>
-<li>HBase Hook</li>
-<li>UI updates to show entity relationships</li>
-<li><a class="externalLink" href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20Atlas%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%201.0.0%20ORDER%20BY%20key%20DESC">List of JIRAs resolved in Apache Atlas 1.0.0 release</a></li></ul>
-<p><b><a href="./../0.8.2/index.html">Atlas 0.8.2</a> (Released on 2018/02/05)</b></p>
-<p></p>
-<ul>
-<li>Search improvements:
-<ul>
-<li>Basic search enhancement to optionally exclude sub-type entities and sub-classification-types</li>
-<li>Basic search to return classification attributes</li>
-<li>Support for saving searches</li>
-<li>UI support to reorder columns in search results page</li></ul></li>
-<li>UI - updates for classification rendering – tree/flat view</li>
-<li>UI – minification of js, css; cache busting for static content (css, js)</li>
-<li>notification updates to handle large messages</li>
-<li>fix type initialization issues in HA deployment</li>
-<li>In HA, the passive node redirects the request with wrong URL encoding</li>
-<li>tool kit to recover from lost/bad index data</li>
-<li><a class="externalLink" href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20Atlas%20AND%20fixVersion%20%3D%200.8.2%20ORDER%20BY%20key%20ASC">List of JIRAs resolved in Apache Atlas 0.8.2 release</a></li></ul>
-<p><b><a href="./../0.8.1/index.html">Atlas 0.8.1</a> (Released on 2017/08/29)</b></p>
-<p></p>
-<ul>
-<li>Basic-search improvement in use of index for attribute filtering</li>
-<li>DSL query enhancement to support 'like' operator</li>
-<li>REST API and UI enhancements to update classification attributes</li>
-<li>Export/import support to copy data between Apache Atlas instances</li>
-<li>Ability to delete a tag from UI (and API)</li>
-<li>UI enhancements: lineage, attribute search filter, ability to search historical data</li>
-<li>Knox SSO for Atlas REST APIs</li>
-<li>Moved from use of Guice + Spring framework for dependency-injection to use only Spring framework</li></ul>
-<p><b><a href="./../0.8.0-incubating/index.html">Atlas 0.8-incubating</a> (Released on 2017/03/16)</b></p>
-<p></p>
-<ul>
-<li>API revamp - new, structured REST API</li>
-<li>Simplified search UI</li>
-<li>UI to create/update entities - HDFS/HBase/Kafka</li>
-<li>Performance and scalability improvements</li>
-<li>Knox SSO for Atlas UI</li></ul>
-<p><b><a href="./../0.7.1-incubating/index.html">Atlas 0.7.1-incubating</a> (Released on 2017/01/29)</b></p>
-<p></p>
-<ul>
-<li>Performance and scalability improvements (ATLAS-1403, ATLAS-1404)</li>
-<li>Bug fixes</li></ul>
-<p><b><a href="./../0.7.0-incubating/index.html">Atlas 0.7-incubating</a> (Released on 2016/07/09)</b></p>
-<p></p>
-<ul>
-<li>High Availability (ATLAS-510)</li>
-<li>Business Catalog / Taxonomy (ATLAS-491)</li>
-<li>Improved Hive Integration (ATLAS-492)</li>
-<li>Improved Sqoop Integration</li>
-<li>Improved Falcon Integration</li>
-<li>Improved Storm Integration</li>
-<li>Improved Ambari Deployment & Management Support</li>
-<li>Entity Versioning / Audit (ATLAS-493)</li>
-<li>Performance Improvements</li>
-<li>Authorization (ATLAS-497)</li>
-<li>Atlas / Ranger Authorization Integration (ATLAS-495)</li>
-<li>Standalone HBase Support (ATLAS-498)</li>
-<li>Upgrade Support (ATLAS-631)</li></ul>
-<p><b><a href="./../0.6.0-incubating/index.html">Atlas 0.6-incubating</a> (Released on 2015/12/30)</b></p>
-<ul>
-<li>Improved Hive Server 2 Integration</li>
-<li>Sqoop Integration</li>
-<li>Falcon Integration</li>
-<li>Storm Integration</li>
-<li>Various Bug Fixes</li>
-<li>Atlas / Ranger Integration</li></ul>
-<p><b><a href="./../0.5.0-incubating/index.html">Atlas 0.5-incubating</a> (Released on 2015/07/09)</b></p>
-<ul>
-<li>Hive Server 2 Integration</li>
-<li>Basic Hive Lineage</li>
-<li>Basic Ambari Integration</li>
-<li>Kerberos Support</li>
-<li>DSL for query of datastore</li>
-<li>Basic Storage of Metadata</li>
-<li>Support for BerkleyDB</li>
-<li>Support for Titan 0.5</li>
-<li>Support</li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/EclipseSetup.html b/EclipseSetup.html
deleted file mode 100644
index c955a16..0000000
--- a/EclipseSetup.html
+++ /dev/null
@@ -1,220 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/EclipseSetup.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Tools required to build and run Apache Atlas on Eclipse</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Tools required to build and run Apache Atlas on Eclipse</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Tools_required_to_build_and_run_Apache_Atlas_on_Eclipse"></a>Tools required to build and run Apache Atlas on Eclipse</h2>
-<p>These instructions are provided as-is. They worked at a point in time; other variants of software may work. These instructions may become stale if the build dependencies change.</p>
-<p>They have been shown to work on 19th of December 2016.</p>
-<p>To build, run tests, and debug Apache Atlas, the following software is required:</p>
-<p><b>Java</b></p>
-<ul>
-<li>Download and install a 1.8 Java SDK</li>
-<li>Set JAVA_HOME system environment variable to the installed JDK home directory</li>
-<li>Add JAVA_HOME/bin directory to system PATH</li></ul><b>Python</b>
-<p>Atlas command line tools are written in Python.</p>
-<ul>
-<li>Download and install Python version 2.7.7</li>
-<li>For Mac, we used 2.7.11</li>
-<li>Add Python home directory to system PATH</li></ul><b>Maven</b>
-<ul>
-<li>Download and install Maven 3.3.9</li>
-<li>Set the environment variable M2_HOME to point to the maven install directory</li>
-<li>Add M2_HOME/bin directory to system PATH e.g. C:\Users\IBM_ADMIN\Documents\Software\apache-maven-3.3.9\bin</li></ul><b>Git</b>
-<ul>
-<li>Install Git</li>
-<li>Add git bin directory to the system PATH e.g. C:\Program Files (x86)\Git\bin</li></ul><b>Eclipse</b>
-<ul>
-<li>Install Eclipse Neon (4.6)</li>
-<li>The non-EE Neon for iOS from eclipse.org has been proven to work here.</li>
-<li>Install the Scala IDE, TestNG, and m2eclipse-scala features/plugins as described below.</li></ul><b>Scala IDE Eclipse feature</b>
-<p>Some of the Atlas source code is written in the Scala programming language. The Scala IDE feature is required to compile Scala source code in Eclipse.</p>
-<ul>
-<li>In Eclipse, choose Help - Install New Software..</li>
-<li>Click Add... to add an update site, and set Location to <a class="externalLink" href="http://download.scala-ide.org/sdk/lithium/e44/scala211/stable/site">http://download.scala-ide.org/sdk/lithium/e44/scala211/stable/site</a></li>
-<li>Select Scala IDE for Eclipse from the list of available features</li>
-<li>Restart Eclipse after install</li>
-<li>Set the Scala compiler to target the 1.7 JVM: Window - Preferences - Scala - Compiler, change target to 1.7</li></ul><b>TestNG Eclipse plug-in</b>
-<p>Atlas tests use the <a class="externalLink" href="http://testng.org/doc/documentation-main.html">TestNG framework</a>, which is similar to JUnit. The TestNG plug-in is required to run TestNG tests from Eclipse.</p>
-<ul>
-<li>In Eclipse, choose Help - Install New Software..</li>
-<li>Click Add... to add an update site, and set Location to <a class="externalLink" href="http://beust.com/eclipse-old/eclipse_6.9.9.201510270734">http://beust.com/eclipse-old/eclipse_6.9.9.201510270734</a>
-<ul>
-<li>Choose TestNG and continue with install</li>
-<li>Restart Eclipse after installing the plugin</li>
-<li>In Window - Preferences - TestNG, <b>un</b>check "Use project TestNG jar"</li></ul></li></ul><b>m2eclipse-scala Eclipse plugin</b>
-<ul>
-<li>In Eclipse, choose Help - Install New Software..</li>
-<li>Click Add... to add an update site, and set Location to <a class="externalLink" href="http://alchim31.free.fr/m2e-scala/update-site/">http://alchim31.free.fr/m2e-scala/update-site/</a></li>
-<li>Choose Maven Integration for Scala IDE, and continue with install</li>
-<li>Restart Eclipse after install</li>
-<li>In Window - Preferences -Maven - Errors/Warnings, set Plugin execution not covered by lifecycle configuration to Warning</li></ul><b>Import Atlas maven projects into Eclipse:</b>
-<p>a. File - Import - Maven - Existing Maven Projects b. Browse to your Atlas folder c. Uncheck the root project and non-Java projects such as dashboardv2, docs and distro, then click Finish</p>
-<p>On the Mac, the Maven import fails with message</p>
-<div class="source"><pre class="prettyprint">
-"Cannot complete the install because one or more required items could not be found. Software being installed: Maven Integration for AJDT (Optional) 0.14.0.201506231302 (org.maven.ide.eclipse.ajdt.feature.feature.group 0.14.0.201506231302) Missing requirement: Maven Integration for AJDT (Optional) 0.14.0.201506231302 (org.maven.ide.eclipse.ajdt.feature.feature.group 0.14.0.201506231302) requires 'org.eclipse.ajdt.core 1.5.0' but it could not be found".
-
-</pre></div>
-<p>Install <a class="externalLink" href="http://download.eclipse.org/tools/ajdt/46/dev/update">http://download.eclipse.org/tools/ajdt/46/dev/update</a> and rerun. The Maven AspectJ should plugin install - allowing the references to Aspects in Maven to be resolved.</p>
-<p>d. In the atlas-typesystem, atlas-repository, hdfs-model, and storm-bridge projects, add the src/main/scala and src/test/scala (if available) directories as source folders. Note: the hdfs-model and storm-bridge projects do not have the src/test/scala folder.</p>
-<p>Right-click on the project, and choose <b>Properties</b>.</p>
-<p>Click the <b>Java Build Path</b> in the left-hand panel, and choose the <b>Source</b> tab.</p>
-<p>Click <b>Add Folder</b>, and select the src/main/scala and src/test/scala directories.</p>
-<p>Only the atlas-repository and atlas-type system projects have Scala source folders to update.</p>
-<p>e. Select atlas-typesystem, atlas-repository, hdfs-model, and storm-bridge projects, right-click, go to the Scala menu, and choose ‘Set the Scala Installation’.</p>
-<p>f. Choose Fixed Scala Installation: 2.11.8 (bundled) , and click OK.</p>
-<p>g. Restart Eclipse</p>
-<p>h. Choose Project - Clean, select Clean all projects, and click OK.</p>
-<p>Some projects may not pick up the Scala library – if this occurs, quick fix on those projects to add in the Scala library – projects atlas-typesystem, atlas-repository, hdfs-model, storm-bridge and altas-webapp.</p>
-<p>You should now have a clean workspace.</p>
-<p><b>Sample Bash scripts to help mac users</b></p>
-<p>You will need to change some of these scripts to point to your installation targets.</p>
-<ul>
-<li>Run this script to setup your command line build environment</li></ul>
-<div class="source"><pre class="prettyprint">
-#!/bin/bash # export JAVA_HOME=/Library/Java/JavaVirtualMachines/macosxx6480sr3fp10hybrid-20160719_01-sdk
-export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_101.jdk/Contents/Home
-export M2_HOME=/Applications/apache-maven-3.3.9 # Git is installed in the system path
-export PYTHON_HOME='/Applications/Python 2.7'
-export PATH=$PYTHON_HOME:$M2_HOME/bin:$JAVA_HOME/bin:$PATH
-export MAVEN_OPTS="-Xmx1536m -Drat.numUnapprovedLicenses=100"
-
-</pre></div>
-<p></p>
-<ul>
-<li>If you do not want to set Java 8 as your system java, you can use this bash script to setup the environment and run Eclipse (which you can drop in Applications and rename to neon).</li></ul>
-<div class="source"><pre class="prettyprint">
-#!/bin/bash
-export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_101.jdk/Contents/Home
-export M2_HOME=/Applications/apache-maven-3.3.9
-# Git is installed in the system path
-export PYTHON_HOME='/Applications/Python 2.7'
-export PATH=$PYTHON_HOME:$M2_HOME/bin:$JAVA_HOME/bin:$PATH/Applications/neon.app/Contents/MacOS/eclipse
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Export-API.html b/Export-API.html
deleted file mode 100644
index f1886fc..0000000
--- a/Export-API.html
+++ /dev/null
@@ -1,299 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Export-API.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Export API</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Export API</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Export_API"></a>Export API</h2>
-<p>The general approach is:</p>
-<ul>
-<li>Consumer specifies the scope of data to be exported (details below).</li>
-<li>The API if successful, will return the stream in the format specified.</li>
-<li>Error will be returned on failure of the call.</li></ul>
-<p>See <a href="./Export-HDFS-API.html">here</a> for details on exporting <b>hdfs_path</b> entities.</p>
-<p></p>
-<table border="0" class="table table-striped">
-<tr class="a">
-<th>Title</th>
-<th>Export API</th></tr>
-<tr class="b">
-<td><i>Example</i></td>
-<td>See Examples sections below.</td></tr>
-<tr class="a">
-<td><i>URL</i></td>
-<td><i>api/atlas/admin/export</i></td></tr>
-<tr class="b">
-<td><i>Method</i></td>
-<td><i>POST</i></td></tr>
-<tr class="a">
-<td><i>URL Parameters</i></td>
-<td><i>None</i></td></tr>
-<tr class="b">
-<td><i>Data Parameters</i></td>
-<td>The class <i>AtlasExportRequest</i> is used to specify the items to export. The list of <i>AtlasObjectId</i>(s) allow for specifying the multiple items to export in a session. The <i>AtlasObjectId</i> is a tuple of entity type, name of unique attribute, value of unique attribute. Several items can be specified. See examples below.</td></tr>
-<tr class="a">
-<td><i>Success Response</i></td>
-<td>File stream as <i>application/zip</i>.</td></tr>
-<tr class="b">
-<td><i>Error Response</i></td>
-<td>Errors that are handled within the system will be returned as <i>AtlasBaseException</i>.</td></tr>
-<tr class="a">
-<td><i>Notes</i></td>
-<td>Consumer could choose to consume the output of the API by programmatically using <i>java.io.ByteOutputStream</i> or by manually, save the contents of the stream to a file on the disk.</td></tr></table><b><i>Method Signature</i></b>
-<div class="source"><pre class="prettyprint">
-@POST
-@Path("/export")
-@Consumes("application/json;charset=UTF-8")
-
-</pre></div></div>
-<div class="section">
-<h4><a name="Additional_Options"></a>Additional Options</h4>
-<p>It is possible to specify additional parameters for the <i>Export</i> operation.</p>
-<p>Current implementation has 2 options. Both are optional:</p>
-<ul>
-<li><i>matchType</i> This option configures the approach used for fetching the starting entity. It has follow values:
-<ul>
-<li><i>startsWith</i> Search for an entity that is prefixed with the specified criteria.</li>
-<li><i>endsWith</i> Search for an entity that is suffixed with the specified criteria.</li>
-<li><i>contains</i> Search for an entity that has the specified criteria as a sub-string.</li>
-<li><i>matches</i> Search for an entity that is a regular expression match with the specified criteria.</li></ul></li></ul>
-<p></p>
-<ul>
-<li><i>fetchType</i> This option configures the approach used for fetching entities. It has following values:
-<ul>
-<li><i>FULL</i>: This fetches all the entities that are connected directly and indirectly to the starting entity. E.g. If a starting entity specified is a table, then this option will fetch the table, database and all the other tables within the database.</li>
-<li><i>CONNECTED</i>: This fetches all the etnties that are connected directly to the starting entity. E.g. If a starting entity specified is a table, then this option will fetch the table and the database entity only.</li>
-<li><i>INCREMENTAL</i>: See <a href="./Incremental-Export.html">here</a> for details.</li></ul></li></ul>
-<p>If no <i>matchType</i> is specified, exact match is used. Which means, that the entire string is used in the search criteria.</p>
-<p>Searching using <i>matchType</i> applies for all types of entities. It is particularly useful for matching entities of type hdfs_path (see <a href="./Export-HDFS-API.html">here</a>).</p>
-<p>The <i>fetchType</i> option defaults to <i>FULL</i>.</p>
-<p>For complete example see section below.</p></div>
-<div class="section">
-<h4><a name="Contents_of_Exported_ZIP_File"></a>Contents of Exported ZIP File</h4>
-<p>The exported ZIP file has the following entries within it:</p>
-<ul>
-<li><i>atlas-export-result.json</i>:
-<ul>
-<li>Input filters: The scope of export.</li>
-<li>File format: The format chosen for the export operation.</li>
-<li>Metrics: The number of entity definitions, classifications and entities exported.</li></ul></li>
-<li><i>atlas-typesdef.json</i>: Type definitions for the entities exported.</li>
-<li><i>atlas-export-order.json</i>: Order in which entities should be exported.</li>
-<li><i>{guid}.json</i>: Individual entities are exported with file names that correspond to their id.</li></ul></div>
-<div class="section">
-<h4><a name="Examples"></a>Examples</h4>
-<p>The <i>AtlasExportRequest</i> below shows filters that attempt to export 2 databases in cluster cl1:</p>
-<div class="source"><pre class="prettyprint">
-{
- "itemsToExport": [
- { "typeName": "hive_db", "uniqueAttributes": { "qualifiedName": "accounts@cl1" } },
- { "typeName": "hive_db", "uniqueAttributes": { "qualifiedName": "hr@cl1" } }
- ]
-}
-
-</pre></div>
-<p>The <i>AtlasExportRequest</i> below specifies the <i>fetchType</i> as <i>FULL</i>. The <i>matchType</i> option will fetch <i>accounts@cl1</i>.</p>
-<div class="source"><pre class="prettyprint">
-{
- "itemsToExport": [
- { "typeName": "hive_db", "uniqueAttributes": { "qualifiedName": "accounts@" } },
- ],
- "options" {
- "fetchType": "FULL",
- "matchType": "startsWith"
- }
-}
-
-</pre></div>
-<p>The <i>AtlasExportRequest</i> below specifies the <i>fetchType</i> as <i>connected</i>. The <i>matchType</i> option will fetch <i>accountsReceivable</i>, <i>accountsPayable</i>, etc present in the database.</p>
-<div class="source"><pre class="prettyprint">
-{
- "itemsToExport": [
- { "typeName": "hive_db", "uniqueAttributes": { "name": "accounts" } },
- ],
- "options" {
- "fetchType": "CONNECTED",
- "matchType": "startsWith"
- }
-}
-
-</pre></div>
-<p>Below is the <i>AtlasExportResult</i> JSON for the export of the <i>Sales</i> DB present in the <i>QuickStart</i>.</p>
-<p>The <i>metrics</i> contains the number of types and entities exported as part of the operation.</p>
-<div class="source"><pre class="prettyprint">
-{
- "clientIpAddress": "10.0.2.15",
- "hostName": "10.0.2.2",
- "metrics": {
- "duration": 1415,
- "entitiesWithExtInfo": 12,
- "entity:DB_v1": 2,
- "entity:LoadProcess_v1": 2,
- "entity:Table_v1": 6,
- "entity:View_v1": 2,
- "typedef:Column_v1": 1,
- "typedef:DB_v1": 1,
- "typedef:LoadProcess_v1": 1,
- "typedef:StorageDesc_v1": 1,
- "typedef:Table_v1": 1,
- "typedef:View_v1": 1,
- "typedef:classification": 6
- },
- "operationStatus": "SUCCESS",
- "request": {
- "itemsToExport": [
- {
- "typeName": "DB_v1",
- "uniqueAttributes": {
- "name": "Sales"
- }
- }
- ],
- "options": {
- "fetchType": "full"
- }
- },
- "userName": "admin"
-}
-
-</pre></div></div>
-<div class="section">
-<h4><a name="CURL_Calls"></a>CURL Calls</h4>
-<p>Below are sample CURL calls that demonstrate Export of <i>QuickStart</i> database.</p>
-<div class="source"><pre class="prettyprint">
-curl -X POST -u adminuser:password -H "Content-Type: application/json" -H "Cache-Control: no-cache" -d '{
- "itemsToExport": [
- { "typeName": "DB", "uniqueAttributes": { "name": "Sales" }
- { "typeName": "DB", "uniqueAttributes": { "name": "Reporting" }
- { "typeName": "DB", "uniqueAttributes": { "name": "Logging" }
- }
- ],
- "options": { "full" }
- }' "http://localhost:21000/api/atlas/admin/export" > quickStartDB.zip
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Export-HDFS-API.html b/Export-HDFS-API.html
deleted file mode 100644
index 67f0c84..0000000
--- a/Export-HDFS-API.html
+++ /dev/null
@@ -1,161 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Export-HDFS-API.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Export & Import APIs for HDFS Path</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Export & Import APIs for HDFS Path</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Export_.26_Import_APIs_for_HDFS_Path"></a>Export & Import APIs for HDFS Path</h2></div>
-<div class="section">
-<h4><a name="Introduction"></a>Introduction</h4>
-<p>The general approach for using the Import-Export APIs for HDFS Paths remain the same. There are minor variations caused how HDFS paths are handled within Atlas.</p>
-<p>Unlike HIVE entities, HDFS entities within Atlas are created manually using the <i>Create Entity</i> link within the Atlas Web UI.</p>
-<p>Also, HDFS paths tend to be hierarchical, in the sense that users tend to model the same HDFS storage structure within Atlas.</p>
-<p><b><i>Sample HDFS Setup</i></b></p>
-<p><table border="1" cellpadding="pixels" cellspacing="pixels"> <tr> <th><strong>HDFS Path</strong></th> <th><strong>Atlas Entity</strong></th> </tr> <tr> <td style="padding:0 15px 0 15px;"> <em>/apps/warehouse/finance</em> </td> <td style="padding:0 15px 0 15px;"> <strong>Entity type: </strong><em>hdfs_path</em> <br/> <strong>Name: </strong><em>Finance</em> <br/> <strong>QualifiedName: </strong><em>FinanceAll</em> </td> </tr> [...]
-<div class="section">
-<h4><a name="Export_API_Using_matchType"></a>Export API Using matchType</h4>
-<p>To export entities that represent HDFS path, use the Export API using the <i>matchType</i> option. Details can be found <a href="./Export-API.html">here</a>.</p></div>
-<div class="section">
-<h4><a name="Example_Using_CURL_Calls"></a>Example Using CURL Calls</h4>
-<p>Below are sample CURL calls that performs export operation on the <i>Sample HDFS Setup</i> shown above.</p>
-<div class="source"><pre class="prettyprint">
-curl -X POST -u adminuser:password -H "Content-Type: application/json" -H "Cache-Control: no-cache" -d '{
- "itemsToExport": [
- { "typeName": "hdfs_path", "uniqueAttributes": { "name": "FinanceAll" }
- }
- ],
- "options": {
- "fetchType": "full",
- "matchType": "startsWith"
- }
-}' "http://localhost:21000/api/atlas/admin/export" > financeAll.zip
-
-</pre></div></div>
-<div class="section">
-<h4><a name="Automatic_Creation_of_HDFS_entities"></a>Automatic Creation of HDFS entities</h4>
-<p>Given that HDFS entity creation is a manual process. The Export API offers a mechanism for creation of requested HDFS entities.</p></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/ExportImportAudits.html b/ExportImportAudits.html
deleted file mode 100644
index d644332..0000000
--- a/ExportImportAudits.html
+++ /dev/null
@@ -1,263 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/ExportImportAudits.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Export & Import Audits</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Export & Import Audits</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<!--
- ~ Licensed to the Apache Software Foundation (ASF) under one
- ~ or more contributor license agreements. See the NOTICE file
- ~ distributed with this work for additional information
- ~ regarding copyright ownership. The ASF licenses this file
- ~ to you under the Apache License, Version 2.0 (the
- ~ "License"); you may not use this file except in compliance
- ~ with the License. You may obtain a copy of the License at
- ~
- ~ http://www.apache.org/licenses/LICENSE-2.0
- ~
- ~ Unless required by applicable law or agreed to in writing, software
- ~ distributed under the License is distributed on an "AS IS" BASIS,
- ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- ~ See the License for the specific language governing permissions and
- ~ limitations under the License.
- -->
-<h1>Export & Import Audits</h1>
-<div class="section">
-<div class="section">
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>The new audits for Export and Import operations also have corresponding REST APIs to programatically fetch the audit entries.</p></div>
-<div class="section">
-<h4><a name="REST_APIs"></a>REST APIs</h4>
-<table border="0" class="table table-striped">
-<thead>
-
-<tr class="a">
-<th>Title </th>
-<th> Replication Audits for a Cluster </th></tr>
-</thead><tbody>
-
-<tr class="b">
-<td>Example </td>
-<td> See below. </td></tr>
-<tr class="a">
-<td>URL </td>
-<td> api/atlas/admin/expimp/audit </td></tr>
-<tr class="b">
-<td>Method </td>
-<td> GET </td></tr>
-<tr class="a">
-<td>URL Parameters </td>
-<td> <i>sourceClusterName</i>: Name of source cluster. </td></tr>
-<tr class="b">
-<td> </td>
-<td> <i>targetClusterName</i>: Name of target cluster. </td></tr>
-<tr class="a">
-<td> </td>
-<td> <i>userName</i>: Name of the user who initiated the operation. </td></tr>
-<tr class="b">
-<td> </td>
-<td> <i>operation</i>: EXPORT or IMPORT operation type. </td></tr>
-<tr class="a">
-<td> </td>
-<td> <i>startTime</i>: Time, in milliseconds, when operation was started. </td></tr>
-<tr class="b">
-<td> </td>
-<td> <i>endTime</i>: Time, in milliseconds, when operation ended. </td></tr>
-<tr class="a">
-<td> </td>
-<td> <i>limit</i>: Number of results to be returned </td></tr>
-<tr class="b">
-<td> </td>
-<td> <i>offset</i>: Offset </td></tr>
-<tr class="a">
-<td>Data Parameters </td>
-<td> None </td></tr>
-<tr class="b">
-<td>Success Response</td>
-<td> List of <i>ExportImportAuditEntry</i> </td></tr>
-<tr class="a">
-<td>Error Response </td>
-<td> Errors Returned as AtlasBaseException </td></tr>
-<tr class="b">
-<td>Notes </td>
-<td> None </td></tr>
-</tbody>
-</table>
-<div class="section">
-<div class="section">
-<h6><a name="CURL"></a>CURL</h6>
-<p>curl -X GET -u admin:admin -H “Content-Type: application/json” -H “Cache-Control: no-cache” ‘<a class="externalLink" href="http://localhost:21000/api/atlas/admin/expimp/audit?sourceClusterName=cl2">http://localhost:21000/api/atlas/admin/expimp/audit?sourceClusterName=cl2</a>’</p>
-
-<div>
-<div>
-<pre class="source">{
- "queryType": "BASIC",
- "searchParameters": {
- "typeName": "ReplicationAuditEntry",
- "excludeDeletedEntities": false,
- "includeClassificationAttributes": false,
- "includeSubTypes": true,
- "includeSubClassifications": true,
- "limit": 100,
- "offset": 0,
- "entityFilters": {
- "attributeName": "name",
- "operator": "eq",
- "attributeValue": "cl2",
- "criterion": []
- }
- },
- "entities": [{
- "typeName": "ReplicationAuditEntry",
- "attributes": {
- "owner": null,
- "uniqueName": "cl2:EXPORT:1533037289411",
- "createTime": null,
- "name": "cl2",
- "description": null
- },
- "guid": "04844141-af72-498a-9d26-f70f91e8adf8",
- "status": "ACTIVE",
- "displayText": "cl2",
- "classificationNames": []
- }, {
- "typeName": "ReplicationAuditEntry",
- "attributes": {
- "owner": null,
- "uniqueName": "cl2:EXPORT:1533037368407",
- "createTime": null,
- "name": "cl2",
- "description": null
- },
- "guid": "837abe66-20c8-4296-8678-e715498bf8fb",
- "status": "ACTIVE",
- "displayText": "cl2",
- "classificationNames": []
- }]
-}
-</pre></div></div></div></div></div></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Glossary.html b/Glossary.html
deleted file mode 100644
index 2a72f94..0000000
--- a/Glossary.html
+++ /dev/null
@@ -1,513 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/Glossary.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Glossary</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Glossary</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<!--
- ~ Licensed to the Apache Software Foundation (ASF) under one
- ~ or more contributor license agreements. See the NOTICE file
- ~ distributed with this work for additional information
- ~ regarding copyright ownership. The ASF licenses this file
- ~ to you under the Apache License, Version 2.0 (the
- ~ "License"); you may not use this file except in compliance
- ~ with the License. You may obtain a copy of the License at
- ~
- ~ http://www.apache.org/licenses/LICENSE-2.0
- ~
- ~ Unless required by applicable law or agreed to in writing, software
- ~ distributed under the License is distributed on an "AS IS" BASIS,
- ~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- ~ See the License for the specific language governing permissions and
- ~ limitations under the License.
- -->
-<h1>Glossary</h1>
-<p>A Glossary provides appropriate vocabularies for business users and it allows the terms (words) to be related to each other and categorized so that they can be understood in different contexts. These terms can be then mapped to assets like a Database, tables, columns etc. This helps abstract the technical jargon associated with the repositories and allows the user to discover/work with data in the vocabulary that is more familiar to them.</p>
-<div class="section">
-<div class="section">
-<h3><a name="Use_cases"></a>Use cases</h3>
-<ul>
-
-<li>Ability to define rich glossary vocabularies using the natural terminology (technical terms and/or business terms).</li>
-<li>Ability to semantically relate the term(s) to each other.</li>
-<li>Ability to map assets to glossary terms(s).</li>
-<li>Ability to organize these terms by categories. This adds more context to the term(s).</li>
-<li>Allow categories to be arranged in hierarchy - to express broader and finer scopes.</li>
-<li>Separate management of glossary term(s) from the metadata.</li>
-</ul></div>
-<div class="section">
-<h3><a name="What_is_a_Glossary_term_.3F"></a>What is a Glossary term ?</h3>
-<p>A term is a useful word for an enterprise. For the term(s) to be useful and meaningful, they need to grouped around their use and context. A term in Apache Atlas must have a unique qualifiedName, there can be term(s) with same name but they cannot belong to the same glossary. Term(s) with same name can exist only across different glossaries. A term name can contain spaces, underscores and dashes (as natural ways of referring to words) but no “.” or “@”, as [...]
-<p>A term can only belong to single glossary and it’s lifecycle is bound to the same i.e. if the Glossary is deleted then the term gets deleted as well. A term can belong to zero or more categories, which allows scoping them into narrower or wider contexts. A term can be assigned/linked to zero or more entities in Apache Atlas. A term can be classified using classifications (tags) and the same classification gets applied to the entities that the term is assigned to.</p></div>
-<div class="section">
-<h3><a name="What_is_a_Glossary_category_.3F"></a>What is a Glossary category ?</h3>
-<p>A category is a way of organizing the term(s) so that the term’s context can be enriched. A category may or may not have contained hierarchies i.e. child category hierarchy. A category’s qualifiedName is derived using it’s hierarchical location within the glossary e.g. <tt>Category name</tt>.<tt>parent category qualifiedName</tt>. This qualified name gets updated when any hierarchical change happens, e.g. addition of a parent category, removal of parent category o [...]
-<div class="section">
-<h3><a name="UI_interactions"></a>UI interactions</h3>
-<p>Apache Atlas UI has been updated to provide user-friendly interface to work with various aspects of glossary, including:</p>
-<ul>
-
-<li>create glossaries, terms and categories</li>
-<li>create various relationships between terms - like synonymns, antonymns, seeAlso</li>
-<li>organize categories in hierarchies</li>
-<li>assign terms to entities</li>
-<li>search for entities using associated terms</li>
-</ul>
-<p>Most of glossary related UI can be found under a new tab named GLOSSARY, which is present right next to existing familiar tabs SEARCH and CLASSIFICATION.</p>
-<div class="section">
-<h4><a name="Glossary_tab"></a><b>Glossary tab</b></h4>
-<p>Apache Atlas UI provides two ways to work with a glossary - term view and category view.</p>
-<p>Term view allows an user to perform the following operations:</p>
-<ul>
-
-<li>create, update and delete terms</li>
-<li>add, remove and update classifications associated with a term</li>
-<li>add, remove and update categorization of a term</li>
-<li>create various relationships between terms</li>
-<li>view entities associated with a term</li>
-</ul>
-<p>Category view allows an user to perform the following operations:</p>
-<ul>
-
-<li>create, update and delete categories and sub-categories</li>
-<li>associate terms to categories</li>
-</ul>
-<p>Users can switch between term view and category view using toggle provided in GLOSSARY tab.</p>
-<img src="images/markdown/terms_view.png" width="250" style="border:2px solid black; margin-left:50px" alt="" />
-
-<p></p>
-<img src="images/markdown/category_view_1.png" width="250" style="border:2px solid black; margin-left:50px" alt="" />
-
-<div class="section">
-<h5><a name="Term_context_menu"></a>Term context menu</h5>
-<ul>
-
-<li>Create a new term<br />
-Clicking on the <b>ellipsis (…)</b> next to a glossary name shows a pop-over menu that allows users to create a term in the glossary or delete the glossary - as shown below.</li>
-</ul>
-<img src="images/markdown/term_view_context.png" width="400" style="border:2px solid black; margin-left:50px" alt="" />
-
-<ul>
-
-<li>To delete a term<br />
-Clicking on the <b>ellipsis (…)</b> next to a term name shows a pop-over menu that allows users to delete the term - as shown below.</li>
-</ul>
-<img src="images/markdown/term_delete_context.png" width="600" style="border:2px solid black; margin-left:50px" alt="" />
-</div>
-<div class="section">
-<h5><a name="Term_detail_page"></a>Term detail page</h5>
-<p>Various details of a term can be viewed by clicking on the term name in the glossary UI. Each tabs under the details page provides different details of the term.</p>
-<ul>
-
-<li>Entities tab shows the entities that are assigned to the selected term</li>
-<li>Classifications tab shows the classification(s) associated with the selected term</li>
-<li>Related terms tab shows the terms that are related to the selected term</li>
-</ul>
-<img src="images/markdown/term_details.png" width="600" style="border:2px solid black; margin-left:50px" alt="" />
-</div>
-<div class="section">
-<h5><a name="Add_classification_to_Term"></a>Add classification to Term</h5>
-<p>Clicking on <b>+</b> next to classification label to add a classification to the term.</p>
-<img src="images/markdown/term_add_classification_1.png" width="400" style="border:2px solid black; margin-left:50px" alt="Add classification" />
-
-<p></p>
-<img src="images/markdown/term_add_classification_2.png" width="400" style="border:2px solid black; margin-left:50px" alt="Add classification - details" />
-
-<p></p>
-<img src="images/markdown/term_with_classification.png" width="400" style="border:2px solid black; margin-left:50px" alt="Classifications associated with term" />
-</div>
-<div class="section">
-<h5><a name="Create_term_relationship_with_other_term"></a>Create term relationship with other term</h5>
-<p>Click on “Related Terms” tab when viewing term details. Clicking on <b>+</b> will allow linking a term with the current term.</p>
-<img src="images/markdown/terms_related_terms.png" width="600" style="border:2px solid black; margin-left:50px" alt="" />
-</div>
-<div class="section">
-<h5><a name="Categorize_a_term"></a>Categorize a term</h5>
-<p>Click on <b>+</b> next to categories label to categorize a term. A modal dialog will be presented for choosing a category.</p>
-<img src="images/markdown/term_add_category.png" width="500" style="border:2px solid black; margin-left:50px" alt="" />
-</div></div>
-<div class="section">
-<h4><a name="Category_view"></a><b>Category view</b></h4>
-<p>When the toggle switch is on category, the panel will list down all glossaries along-with the category hierarchy. Here’s a list of possible interactions under this view.</p>
-<ul>
-
-<li>Expanded view</li>
-</ul>
-<img src="images/markdown/category_view_2.png" width="250" style="border:2px solid black; margin-left:50px" alt="" />
-
-<div class="section">
-<h5><a name="Category_context_menu"></a>Category context menu</h5>
-<p>Clicking on <b>ellipsis (…)</b> next to the category name will present a category context menu.</p>
-<ul>
-
-<li>To create a new category</li>
-</ul>
-<img src="images/markdown/category_view_glossary_context.png" width="600" style="border:2px solid black; margin-left:50px" alt="" />
-
-<ul>
-
-<li>To create a sub-category or delete a category</li>
-</ul>
-<img src="images/markdown/category_view_category_context_1.png" width="600" style="border:2px solid black; margin-left:50px" alt="" />
-</div>
-<div class="section">
-<h5><a name="Category_detail_page"></a>Category detail page</h5>
-<p>Once a category is selected, the details will be presented in the right pane.</p>
-<img src="images/markdown/category_details_with_terms.png" width="600" style="border:2px solid black; margin-left:50px" alt="" />
-</div>
-<div class="section">
-<h5><a name="Categorize_term"></a>Categorize term</h5>
-<p>Click on <b>+</b> next to the terms label to link a term under selected category.</p>
-<img src="images/markdown/category_add_term.png" width="600" style="border:2px solid black; margin-left:50px" alt="" />
-
-<p></p>
-<img src="images/markdown/category_add_term_1.png" width="500" style="border:2px solid black; margin-left:50px" alt="" />
-
-<p></p>
-<img src="images/markdown/category_add_term_2.png" width="500" style="border:2px solid black; margin-left:50px" alt="" />
-</div></div>
-<div class="section">
-<h4><a name="Term_assignment_flow"></a><b>Term assignment flow</b></h4>
-<p>Terms can be assigned to an entity either from the results page or entity details page.</p>
-<div class="section">
-<h5><a name="Assign_term"></a>Assign term</h5>
-<p>Click on <b>+</b> under “terms” column (if associating term from search page)</p>
-<img src="images/markdown/entity_search_add_term.png" width="" style="border:2px solid black; margin-left:50px" alt="" />
-
-<p>Click on <b>+</b> next to “terms” label (if viewing a specific entity details)</p>
-<img src="images/markdown/entity_details_add_term.png" width="" style="border:2px solid black; margin-left:50px" alt="" />
-
-<p>Both the actions will present the following modal, follow prompts on screen to complete term assignment.</p>
-<img src="images/markdown/entity_add_term_modal.png" width="500" style="border:2px solid black; margin-left:50px" alt="" />
-</div>
-<div class="section">
-<h5><a name="Propagated_classification"></a>Propagated classification</h5>
-<p>If a term has classification then the entity is has been assigned inherits the same.</p>
-<img src="images/markdown/term_details_with_classification.png" width="" style="border:2px solid black; margin-left:50px" alt="" />
-
-<p></p>
-<img src="images/markdown/entity_assigned_term_with_tag.png" width="500" style="border:2px solid black; margin-left:50px" alt="" />
-</div></div>
-<div class="section">
-<h4><a name="Search_using_a_term"></a><b>Search using a term</b></h4>
-<p>Apache Atlas basic-search API and UI have been updated to support term as a search criteria. This allows users to find entities associated with a given term. Basic search UI now includes a new input drop-down for term based searches.</p>
-<img src="images/markdown/term_search.png" width="250" style="border:2px solid black; margin-left:50px" alt="" />
-<hr /></div>
-<div class="section">
-<h4><a name="Summary_of_REST_interactions"></a>Summary of REST interactions</h4>
-<p>Following operations are supported by Atlas, the details of REST interface can be found <a href="api/v2/index.html">here</a></p>
-<div class="section">
-<h5><a name="JSON_structure"></a>JSON structure</h5>
-<ul>
-
-<li>Glossary</li>
-</ul>
-
-<div>
-<div>
-<pre class="source">{
- "guid": "2f341934-f18c-48b3-aa12-eaa0a2bfce85",
- "qualifiedName": "SampleBank",
- "displayName": "Banking",
- "shortDescription": "Glossary of bank",
- "longDescription": "Glossary of bank - long description",
- "language": "English",
- "usage": "N/A",
- "terms": [
- {
- "termGuid": "502d34f1-b85f-4ad9-9d9f-fe7020ff0acb",
- "relationGuid": "6bb803e4-3af6-4924-aad6-6ad9f95ecd14",
- "displayText": "A savings account"
- }, {
- "termGuid": "e441a540-ee55-4fc8-8eaf-4b9943d8929c",
- "relationGuid": "dbc46795-76ff-4f68-9043-be0eff0bc0f3",
- "displayText": "15-30 yr mortgage"
- }, {
- "termGuid": "998e3692-51a8-47fe-b3a0-0d9f794437eb",
- "relationGuid": "0dcd31b9-a81c-4185-ad4b-9209a97c305b",
- "displayText": "A checking account"
- }, {
- "termGuid": "c4e2b956-2589-4648-8596-240d3bea5e44",
- "relationGuid": "e71c4a5d-694b-47a5-a41e-126ade857279",
- "displayText": "ARM loans"
- }],
- "categories": [{
- "categoryGuid": "dd94859e-7453-4bc9-b634-a17fc14590f8",
- "parentCategoryGuid": "e6a3df1f-5670-4f9e-84da-91f77d008ce3",
- "relationGuid": "a0b7da02-1ccd-4415-bc54-3d0cdb8857e7",
- "displayText": "Accounts"
- }, {
- "categoryGuid": "e6a3df1f-5670-4f9e-84da-91f77d008ce3",
- "relationGuid": "0e84a358-a4aa-4bd3-b806-497a6962ae1d",
- "displayText": "Customer"
- }, {
- "categoryGuid": "7f041401-de8c-443f-a3b7-7bf5a910ff6f",
- "parentCategoryGuid": "e6a3df1f-5670-4f9e-84da-91f77d008ce3",
- "relationGuid": "7757b031-4e25-43a8-bf77-946f7f06c67a",
- "displayText": "Loans"
- }]
-}
-</pre></div></div>
-
-<ul>
-
-<li>Term</li>
-</ul>
-
-<div>
-<div>
-<pre class="source">{
- "guid": "e441a540-ee55-4fc8-8eaf-4b9943d8929c",
- "qualifiedName": "fixed_mtg@SampleBank",
- "displayName": "15-30 yr mortgage",
- "shortDescription": "Short description",
- "longDescription": "Long description",
- "examples": ["N/A"],
- "abbreviation": "FMTG",
- "anchor": {
- "glossaryGuid": "2f341934-f18c-48b3-aa12-eaa0a2bfce85",
- "relationGuid": "dbc46795-76ff-4f68-9043-be0eff0bc0f3"
- },
- "categories": [{
- "categoryGuid": "7f041401-de8c-443f-a3b7-7bf5a910ff6f",
- "relationGuid": "b4cddd33-7b0c-41e2-9324-afe549ec6ada",
- "displayText": "Loans"
- }],
- "seeAlso" : [],
- "synonyms" : [],
- "antonyms" : [],
- "replacedBy" : [],
- "replacementTerms" : [],
- "translationTerms" : [],
- "translatedTerms" : [],
- "isA" : [],
- "classifies" : [],
- "preferredTerms" : [],
- "preferredToTerms": [ {
- "termGuid" : "c4e2b956-2589-4648-8596-240d3bea5e44",
- "displayText": "ARM Loans"
- }]
-}
-</pre></div></div>
-
-<ul>
-
-<li>Category</li>
-</ul>
-
-<div>
-<div>
-<pre class="source">{
- "guid": "7f041401-de8c-443f-a3b7-7bf5a910ff6f",
- "qualifiedName": "Loans.Customer@HortoniaBank",
- "displayName": "Loans",
- "shortDescription": "Loan categorization",
- "anchor": {
- "glossaryGuid": "2f341934-f18c-48b3-aa12-eaa0a2bfce85",
- "relationGuid": "7757b031-4e25-43a8-bf77-946f7f06c67a"
- },
- "parentCategory": {
- "categoryGuid": "e6a3df1f-5670-4f9e-84da-91f77d008ce3",
- "relationGuid": "8a0a8e11-0bb5-483b-b7d6-cfe0b1d55ef6"
- },
- "childrenCategories" : [],
- "terms": [{
- "termGuid": "e441a540-ee55-4fc8-8eaf-4b9943d8929c",
- "relationGuid": "b4cddd33-7b0c-41e2-9324-afe549ec6ada",
- "displayText": "15-30 yr mortgage"
- }, {
- "termGuid": "c4e2b956-2589-4648-8596-240d3bea5e44",
- "relationGuid": "8db1e784-4f04-4eda-9a58-6c9535a95451",
- "displayText": "ARM loans"
- }]
-}
-</pre></div></div>
-</div>
-<div class="section">
-<h5><a name="CREATE_operations"></a>CREATE operations</h5>
-<ol style="list-style-type: decimal">
-
-<li>Create a glossary</li>
-<li>Create a term</li>
-<li>Create a categorized term</li>
-<li>Create term with relations</li>
-<li>Create a category</li>
-<li>Create a category with hierarchy</li>
-<li>Create category and categorize term(s)</li>
-<li>Assign term to entities</li>
-</ol>
-<p><b>NOTE:</b></p>
-<ul>
-
-<li>During create operations glossary, term and category get an auto assigned GUID and qualifiedName.</li>
-<li>To create a category with children, the children MUST be created beforehand.</li>
-<li>To create a term belonging to a category, the category MUST be created beforehand.</li>
-<li>To create term with relations, related term(s) MUST be created beforehand.</li>
-</ul><hr /></div>
-<div class="section">
-<h5><a name="READ_operations"></a>READ operations</h5>
-<ol style="list-style-type: decimal">
-
-<li>Get glossary by GUID - Gives all terms and categories (headers) belonging to the glossary.</li>
-<li>Get all Glossaries - Gives all glossaries with terms and categories (headers) belonging to the respective glossary.</li>
-<li>Get a term by GUID - Gives details about the term, categories it belongs to (if any) and any related term(s).</li>
-<li>Get a category by GUID - Gives details about the category, category hierarchy (if any) and term(s) belonging to the category.</li>
-<li>Get all terms of a given glossary - Gives all terms (with details as mentioned in #3) belonging to given glossary.</li>
-<li>Get all categories of a given glossary - Gives all categories (with details as mentioned in #4) belonging to given glossary.</li>
-<li>Get all terms related to given term - Gives all terms related/linked to the given term.</li>
-<li>Get all categories related to a given category (parent and children)</li>
-<li>Get all terms for a given category</li>
-</ol><hr /></div>
-<div class="section">
-<h5><a name="UPDATE_operations"></a>UPDATE operations</h5>
-<ol style="list-style-type: decimal">
-
-<li>Partial update of glossary</li>
-<li>Partial update of term</li>
-<li>Partial update of category</li>
-<li>Update a given glossary</li>
-<li>Update a given term</li>
-<li>Update a given category</li>
-</ol>
-<p><b>NOTE:</b></p>
-<ul>
-
-<li>Partial update only deals with the <b><i>primitive attributes</i></b> defined in the Glossary model file.</li>
-<li>GUID and qualifiedName can’t be changed once assigned. Only way to this is to delete and recreate the required object.</li>
-<li>Anchors <b>can’t</b> be removed in any updates</li>
-<li>Update APIs expect the JSON to be modified <b>in-place</b> after the <b>GET</b> call. Any <b><i>missing</i></b> attributes/relations will be <b><i>deleted</i></b>.</li>
-<li>Any update to category’s hierarchy leads to a cascaded update of the hierarchy under it e.g. anchor change would affect all children, parent change would affect the qualifiedName of self and children.</li>
-</ul><hr /></div>
-<div class="section">
-<h5><a name="DELETE_operations"></a>DELETE operations</h5>
-<ol style="list-style-type: decimal">
-
-<li>Delete glossary - Also deletes all categories and terms anchored to given glossary. This delete is <b><i>blocked</i></b> if any term has been <b><i>assigned</i></b> to an entity.</li>
-<li>Delete term - Only deletes the term <b><i>if</i></b> it’s not associated/assigned to any entity.</li>
-<li>Delete category - <b><i>Only</i></b> deletes the given category, all children become top-level categories.</li>
-<li>Remove term assignment from entity</li>
-</ol></div></div></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/HighAvailability.html b/HighAvailability.html
deleted file mode 100644
index d08ff18..0000000
--- a/HighAvailability.html
+++ /dev/null
@@ -1,311 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/HighAvailability.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Fault Tolerance and High Availability Options</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Fault Tolerance and High Availability Options</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Fault_Tolerance_and_High_Availability_Options"></a>Fault Tolerance and High Availability Options</h2></div>
-<div class="section">
-<h3><a name="Introduction"></a>Introduction</h3>
-<p>Apache Atlas uses and interacts with a variety of systems to provide metadata management and data lineage to data administrators. By choosing and configuring these dependencies appropriately, it is possible to achieve a high degree of service availability with Atlas. This document describes the state of high availability support in Atlas, including its capabilities and current limitations, and also the configuration required for achieving this level of high availability.</p>
-<p><a href="./Architecture.html">The architecture page</a> in the wiki gives an overview of the various components that make up Atlas. The options mentioned below for various components derive context from the above page, and would be worthwhile to review before proceeding to read this page.</p></div>
-<div class="section">
-<h3><a name="Atlas_Web_Service"></a>Atlas Web Service</h3>
-<p>Currently, the Atlas Web Service has a limitation that it can only have one active instance at a time. In earlier releases of Atlas, a backup instance could be provisioned and kept available. However, a manual failover was required to make this backup instance active.</p>
-<p>From this release, Atlas will support multiple instances of the Atlas Web service in an active/passive configuration with automated failover. This means that users can deploy and start multiple instances of the Atlas Web Service on different physical hosts at the same time. One of these instances will be automatically selected as an 'active' instance to service user requests. The others will automatically be deemed 'passive'. If the 'active' instance becomes unavailable either because [...]
-<p>An 'active' instance is the only instance that can respond to user requests correctly. It can create, delete, modify or respond to queries on metadata objects. A 'passive' instance will accept user requests, but will redirect them using HTTP redirect to the currently known 'active' instance. Specifically, a passive instance will not itself respond to any queries on metadata objects. However, all instances (both active and passive), will respond to admin requests that return informatio [...]
-<p>When configured in a High Availability mode, users can get the following operational benefits:</p>
-<p></p>
-<ul>
-<li><b>Uninterrupted service during maintenance intervals</b>: If an active instance of the Atlas Web Service needs to be brought down for maintenance, another instance would automatically become active and can service requests.</li>
-<li><b>Uninterrupted service in event of unexpected failures</b>: If an active instance of the Atlas Web Service fails due to software or hardware errors, another instance would automatically become active and can service requests.</li></ul>
-<p>In the following sub-sections, we describe the steps required to setup High Availability for the Atlas Web Service. We also describe how the deployment and client can be designed to take advantage of this capability. Finally, we describe a few details of the underlying implementation.</p></div>
-<div class="section">
-<h4><a name="Setting_up_the_High_Availability_feature_in_Atlas"></a>Setting up the High Availability feature in Atlas</h4>
-<p>The following pre-requisites must be met for setting up the High Availability feature.</p>
-<p></p>
-<ul>
-<li>Ensure that you install Apache Zookeeper on a cluster of machines (a minimum of 3 servers is recommended for production).</li>
-<li>Select 2 or more physical machines to run the Atlas Web Service instances on. These machines define what we refer to as a 'server ensemble' for Atlas.</li></ul>
-<p>To setup High Availability in Atlas, a few configuration options must be defined in the <tt>atlas-application.properties</tt> file. While the complete list of configuration items are defined in the <a href="./Configuration.html">Configuration Page</a>, this section lists a few of the main options.</p>
-<p></p>
-<ul>
-<li>High Availability is an optional feature in Atlas. Hence, it must be enabled by setting the configuration option <tt>atlas.server.ha.enabled</tt> to true.</li>
-<li>Next, define a list of identifiers, one for each physical machine you have selected for the Atlas Web Service instance. These identifiers can be simple strings like <tt>id1</tt>, <tt>id2</tt> etc. They should be unique and should not contain a comma.</li>
-<li>Define a comma separated list of these identifiers as the value of the option <tt>atlas.server.ids</tt>.</li>
-<li>For each physical machine, list the IP Address/hostname and port as the value of the configuration <tt>atlas.server.address.id</tt>, where <tt>id</tt> refers to the identifier string for this physical machine.
-<ul>
-<li>For e.g., if you have selected 2 machines with hostnames <tt>host1.company.com</tt> and <tt>host2.company.com</tt>, you can define the configuration options as below:</li></ul></li></ul>
-<div class="source"><pre class="prettyprint">
- atlas.server.ids=id1,id2
- atlas.server.address.id1=host1.company.com:21000
- atlas.server.address.id2=host2.company.com:21000
-
-</pre></div>
-<p></p>
-<ul>
-<li>Define the Zookeeper quorum which will be used by the Atlas High Availability feature.</li></ul>
-<div class="source"><pre class="prettyprint">
- atlas.server.ha.zookeeper.connect=zk1.company.com:2181,zk2.company.com:2181,zk3.company.com:2181
-
-</pre></div>
-<p></p>
-<ul>
-<li>You can review other configuration options that are defined for the High Availability feature, and set them up as desired in the <tt>atlas-application.properties</tt> file.</li>
-<li>For production environments, the components that Atlas depends on must also be set up in High Availability mode. This is described in detail in the following sections. Follow those instructions to setup and configure them.</li>
-<li>Install the Atlas software on the selected physical machines.</li>
-<li>Copy the <tt>atlas-application.properties</tt> file created using the steps above to the configuration directory of all the machines.</li>
-<li>Start the dependent components.</li>
-<li>Start each instance of the Atlas Web Service.</li></ul>
-<p>To verify that High Availability is working, run the following script on each of the instances where Atlas Web Service is installed.</p>
-<div class="source"><pre class="prettyprint">
-$ATLAS_HOME/bin/atlas_admin.py -status
-
-</pre></div>
-<p>This script can print one of the values below as response:</p>
-<p></p>
-<ul>
-<li><b>ACTIVE</b>: This instance is active and can respond to user requests.</li>
-<li><b>PASSIVE</b>: This instance is PASSIVE. It will redirect any user requests it receives to the current active instance.</li>
-<li><b>BECOMING_ACTIVE</b>: This would be printed if the server is transitioning to become an ACTIVE instance. The server cannot service any metadata user requests in this state.</li>
-<li><b>BECOMING_PASSIVE</b>: This would be printed if the server is transitioning to become a PASSIVE instance. The server cannot service any metadata user requests in this state.</li></ul>
-<p>Under normal operating circumstances, only one of these instances should print the value <b>ACTIVE</b> as response to the script, and the others would print <b>PASSIVE</b>.</p></div>
-<div class="section">
-<h4><a name="Configuring_clients_to_use_the_High_Availability_feature"></a>Configuring clients to use the High Availability feature</h4>
-<p>The Atlas Web Service can be accessed in two ways:</p>
-<p></p>
-<ul>
-<li><b>Using the Atlas Web UI</b>: This is a browser based client that can be used to query the metadata stored in Atlas.</li>
-<li><b>Using the Atlas REST API</b>: As Atlas exposes a RESTful API, one can use any standard REST client including libraries in other applications. In fact, Atlas ships with a client called AtlasClient that can be used as an example to build REST client access.</li></ul>
-<p>In order to take advantage of the High Availability feature in the clients, there are two options possible.</p></div>
-<div class="section">
-<h5><a name="Using_an_intermediate_proxy"></a>Using an intermediate proxy</h5>
-<p>The simplest solution to enable highly available access to Atlas is to install and configure some intermediate proxy that has a capability to transparently switch services based on status. One such proxy solution is <a class="externalLink" href="http://www.haproxy.org/">HAProxy</a>.</p>
-<p>Here is an example HAProxy configuration that can be used. Note this is provided for illustration only, and not as a recommended production configuration. For that, please refer to the HAProxy documentation for appropriate instructions.</p>
-<div class="source"><pre class="prettyprint">
-frontend atlas_fe
- bind *:41000
- default_backend atlas_be
-
-backend atlas_be
- mode http
- option httpchk get /api/atlas/admin/status
- http-check expect string ACTIVE
- balance roundrobin
- server host1_21000 host1:21000 check
- server host2_21000 host2:21000 check backup
-
-listen atlas
- bind localhost:42000
-
-</pre></div>
-<p>The above configuration binds HAProxy to listen on port 41000 for incoming client connections. It then routes the connections to either of the hosts host1 or host2 depending on a HTTP status check. The status check is done using a HTTP GET on the REST URL <tt>/api/atlas/admin/status</tt>, and is deemed successful only if the HTTP response contains the string ACTIVE.</p></div>
-<div class="section">
-<h5><a name="Using_automatic_detection_of_active_instance"></a>Using automatic detection of active instance</h5>
-<p>If one does not want to setup and manage a separate proxy, then the other option to use the High Availability feature is to build a client application that is capable of detecting status and retrying operations. In such a setting, the client application can be launched with the URLs of all Atlas Web Service instances that form the ensemble. The client should then call the REST URL <tt>/api/atlas/admin/status</tt> on each of these to determine which is the active instance. The response [...]
-<p>The AtlasClient class that ships with Atlas can be used as an example client library that implements the logic for working with an ensemble and selecting the right Active server instance.</p>
-<p>Utilities in Atlas, like <tt>quick_start.py</tt> and <tt>import-hive.sh</tt> can be configured to run with multiple server URLs. When launched in this mode, the AtlasClient automatically selects and works with the current active instance. If a proxy is set up in between, then its address can be used when running quick_start.py or import-hive.sh.</p></div>
-<div class="section">
-<h4><a name="Implementation_Details_of_Atlas_High_Availability"></a>Implementation Details of Atlas High Availability</h4>
-<p>The Atlas High Availability work is tracked under the master JIRA <a class="externalLink" href="https://issues.apache.org/jira/browse/ATLAS-510">ATLAS-510</a>. The JIRAs filed under it have detailed information about how the High Availability feature has been implemented. At a high level the following points can be called out:</p>
-<p></p>
-<ul>
-<li>The automatic selection of an Active instance, as well as automatic failover to a new Active instance happen through a leader election algorithm.</li>
-<li>For leader election, we use the <a class="externalLink" href="http://curator.apache.org/curator-recipes/leader-latch.html">Leader Latch Recipe</a> of <a class="externalLink" href="http://curator.apache.org">Apache Curator</a>.</li>
-<li>The Active instance is the only one which initializes, modifies or reads state in the backend stores to keep them consistent.</li>
-<li>Also, when an instance is elected as Active, it refreshes any cached information from the backend stores to get up to date.</li>
-<li>A servlet filter ensures that only the active instance services user requests. If a passive instance receives these requests, it automatically redirects them to the current active instance.</li></ul></div>
-<div class="section">
-<h3><a name="Metadata_Store"></a>Metadata Store</h3>
-<p>As described above, Atlas uses <a href="./JanusGraph.html">JanusGraph</a> to store the metadata it manages. By default, Atlas uses a standalone HBase instance as the backing store for <a href="./JanusGraph.html">JanusGraph</a>. In order to provide HA for the metadata store, we recommend that Atlas be configured to use distributed HBase as the backing store for <a href="./JanusGraph.html">JanusGraph</a>. Doing this implies that you could benefit from the HA guarantees HBase provides. [...]
-<p></p>
-<ul>
-<li>Choose an existing HBase cluster that is set up in HA mode to configure in Atlas (OR) Set up a new HBase cluster in <a class="externalLink" href="http://hbase.apache.org/book.html#quickstart_fully_distributed">HA mode</a>.
-<ul>
-<li>If setting up HBase for Atlas, please following instructions listed for setting up HBase in the <a href="./InstallationSteps.html">Installation Steps</a>.</li></ul></li>
-<li>We recommend using more than one HBase masters (at least 2) in the cluster on different physical hosts that use Zookeeper for coordination to provide redundancy and high availability of HBase.
-<ul>
-<li>Refer to the <a href="./Configuration.html">Configuration page</a> for the options to configure in atlas.properties to setup Atlas with HBase.</li></ul></li></ul></div>
-<div class="section">
-<h3><a name="Index_Store"></a>Index Store</h3>
-<p>As described above, Atlas indexes metadata through <a href="./JanusGraph.html">JanusGraph</a> to support full text search queries. In order to provide HA for the index store, we recommend that Atlas be configured to use Solr or Elasticsearch as the backing index store for <a href="./JanusGraph.html">JanusGraph</a>.</p></div>
-<div class="section">
-<h4><a name="Solr"></a>Solr</h4>
-<p>In order to configure Atlas to use Solr in HA mode, do the following:</p>
-<p></p>
-<ul>
-<li>Choose an existing SolrCloud cluster setup in HA mode to configure in Atlas (OR) Set up a new <a class="externalLink" href="https://cwiki.apache.org/confluence/display/solr/SolrCloud">SolrCloud cluster</a>.
-<ul>
-<li>Ensure Solr is brought up on at least 2 physical hosts for redundancy, and each host runs a Solr node.</li>
-<li>We recommend the number of replicas to be set to at least 2 for redundancy.</li></ul></li>
-<li>Create the SolrCloud collections required by Atlas, as described in <a href="./InstallationSteps.html">Installation Steps</a></li>
-<li>Refer to the <a href="./Configuration.html">Configuration page</a> for the options to configure in atlas.properties to setup Atlas with Solr.</li></ul></div>
-<div class="section">
-<h4><a name="Elasticsearch__.28Tech_Preview.29"></a>Elasticsearch (Tech Preview)</h4>
-<p>In order to configure Atlas to use Elasticsearch in HA mode, do the following:</p>
-<p></p>
-<ul>
-<li>Choose an existing Elasticsearch cluster setup, (OR) setup a new cluster <a class="externalLink" href="https://www.elastic.co/guide/en/elasticsearch/reference/5.6/setup.html">Elasticsearch cluster</a>.
-<ul>
-<li>Ensure that Elasticsearch is brought up on at least five physical hosts for redundancy.</li>
-<li>A replica count of 3 is recommended</li></ul></li>
-<li>Refer to the <a href="./Configuration.html">Configuration page</a> for the options to configure in atlas.properties to setup Atlas with Elasticsearch.</li></ul></div>
-<div class="section">
-<h3><a name="Notification_Server"></a>Notification Server</h3>
-<p>Metadata notification events from Hooks are sent to Atlas by writing them to a Kafka topic called <b>ATLAS_HOOK</b>. Similarly, events from Atlas to other integrating components like Ranger, are written to a Kafka topic called <b>ATLAS_ENTITIES</b>. Since Kafka persists these messages, the events will not be lost even if the consumers are down as the events are being sent. In addition, we recommend Kafka is also setup for fault tolerance so that it has higher availability guarantees. [...]
-<p></p>
-<ul>
-<li>Choose an existing Kafka cluster set up in HA mode to configure in Atlas (OR) Set up a new Kafka cluster.</li>
-<li>We recommend that there are more than one Kafka brokers in the cluster on different physical hosts that use Zookeeper for coordination to provide redundancy and high availability of Kafka.
-<ul>
-<li>Setup at least 2 physical hosts for redundancy, each hosting a Kafka broker.</li></ul></li>
-<li>Set up Kafka topics for Atlas usage:
-<ul>
-<li>The number of partitions for the ATLAS topics should be set to 1 (numPartitions)</li>
-<li>Decide number of replicas for Kafka topic: Set this to at least 2 for redundancy.</li>
-<li>Run the following commands:</li></ul></li></ul>
-<div class="source"><pre class="prettyprint">
- $KAFKA_HOME/bin/kafka-topics.sh --create --zookeeper <list of zookeeper host:port entries> --topic ATLAS_HOOK --replication-factor <numReplicas> --partitions 1
- $KAFKA_HOME/bin/kafka-topics.sh --create --zookeeper <list of zookeeper host:port entries> --topic ATLAS_ENTITIES --replication-factor <numReplicas> --partitions 1
- Here KAFKA_HOME points to the Kafka installation directory.
-
-</pre></div>
-<p></p>
-<ul>
-<li>In atlas-application.properties, set the following configuration:</li></ul>
-<div class="source"><pre class="prettyprint">
- atlas.notification.embedded=false
- atlas.kafka.zookeeper.connect=<comma separated list of servers forming Zookeeper quorum used by Kafka>
- atlas.kafka.bootstrap.servers=<comma separated list of Kafka broker endpoints in host:port form> - Give at least 2 for redundancy.
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Known_Issues"></a>Known Issues</h3>
-<p></p>
-<ul>
-<li>If the HBase region servers hosting the Atlas table are down, Atlas would not be able to store or retrieve metadata from HBase until they are brought back online.</li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Hook-Falcon.html b/Hook-Falcon.html
deleted file mode 100644
index 5ce9e90..0000000
--- a/Hook-Falcon.html
+++ /dev/null
@@ -1,193 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Hook-Falcon.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Falcon Atlas Bridge</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Falcon Atlas Bridge</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Falcon_Atlas_Bridge"></a>Falcon Atlas Bridge</h2></div>
-<div class="section">
-<h3><a name="Falcon_Model"></a>Falcon Model</h3>
-<p>The default hive model includes the following types:</p>
-<ul>
-<li>Entity types:
-<ul>
-<li>falcon_cluster
-<ul>
-<li>super-types: Infrastructure</li>
-<li>attributes: timestamp, colo, owner, tags</li></ul></li>
-<li>falcon_feed
-<ul>
-<li>super-types: DataSet</li>
-<li>attributes: timestamp, stored-in, owner, groups, tags</li></ul></li>
-<li>falcon_feed_creation
-<ul>
-<li>super-types: Process</li>
-<li>attributes: timestamp, stored-in, owner</li></ul></li>
-<li>falcon_feed_replication
-<ul>
-<li>super-types: Process</li>
-<li>attributes: timestamp, owner</li></ul></li>
-<li>falcon_process
-<ul>
-<li>super-types: Process</li>
-<li>attributes: timestamp, runs-on, owner, tags, pipelines, workflow-properties</li></ul></li></ul></li></ul>
-<p>One falcon_process entity is created for every cluster that the falcon process is defined for.</p>
-<p>The entities are created and de-duped using unique qualifiedName attribute. They provide namespace and can be used for querying/lineage as well. The unique attributes are:</p>
-<ul>
-<li>falcon_process.qualifiedName - <process name>@<cluster name></li>
-<li>falcon_cluster.qualifiedName - <cluster name></li>
-<li>falcon_feed.qualifiedName - <feed name>@<cluster name></li>
-<li>falcon_feed_creation.qualifiedName - <feed name></li>
-<li>falcon_feed_replication.qualifiedName - <feed name></li></ul></div>
-<div class="section">
-<h3><a name="Falcon_Hook"></a>Falcon Hook</h3>
-<p>Falcon supports listeners on falcon entity submission. This is used to add entities in Atlas using the model detailed above. Follow the instructions below to setup Atlas hook in Falcon:</p>
-<ul>
-<li>Add 'org.apache.atlas.falcon.service.AtlasService' to application.services in <falcon-conf>/startup.properties</li>
-<li>untar apache-atlas-${project.version}-falcon-hook.tar.gz</li>
-<li>cd apache-atlas-falcon-hook-${project.version}</li>
-<li>Copy entire contents of folder apache-atlas-falcon-hook-${project.version}/hook/falcon to <atlas-home>/hook/falcon</li>
-<li>Link Atlas hook jars in Falcon classpath - 'ln -s <atlas-home>/hook/falcon/* <falcon-home>/server/webapp/falcon/WEB-INF/lib/'</li>
-<li>In <falcon_conf>/falcon-env.sh, set an environment variable as follows:</li></ul>
-<div class="source"><pre class="prettyprint">
- export FALCON_SERVER_OPTS="<atlas_home>/hook/falcon/*:$FALCON_SERVER_OPTS"
-</pre></div>
-<p>The following properties in <atlas-conf>/atlas-application.properties control the thread pool and notification details:</p>
-<ul>
-<li>atlas.hook.falcon.synchronous - boolean, true to run the hook synchronously. default false</li>
-<li>atlas.hook.falcon.numRetries - number of retries for notification failure. default 3</li>
-<li>atlas.hook.falcon.minThreads - core number of threads. default 5</li>
-<li>atlas.hook.falcon.maxThreads - maximum number of threads. default 5</li>
-<li>atlas.hook.falcon.keepAliveTime - keep alive time in msecs. default 10</li>
-<li>atlas.hook.falcon.queueSize - queue size for the threadpool. default 10000</li></ul>
-<p>Refer <a href="./Configuration.html">Configuration</a> for notification related configurations</p></div>
-<div class="section">
-<h3><a name="NOTES"></a>NOTES</h3>
-<p></p>
-<ul>
-<li>In falcon cluster entity, cluster name used should be uniform across components like hive, falcon, sqoop etc. If used with ambari, ambari cluster name should be used for cluster entity</li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Hook-HBase.html b/Hook-HBase.html
deleted file mode 100644
index 0cb4dc4..0000000
--- a/Hook-HBase.html
+++ /dev/null
@@ -1,208 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Hook-HBase.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Apache Atlas Hook & Bridge for Apache HBase</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Apache Atlas Hook & Bridge for Apache HBase</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Apache_Atlas_Hook_.26_Bridge_for_Apache_HBase"></a>Apache Atlas Hook & Bridge for Apache HBase</h2></div>
-<div class="section">
-<h3><a name="HBase_Model"></a>HBase Model</h3>
-<p>HBase model includes the following types:</p>
-<ul>
-<li>Entity types:
-<ul>
-<li>hbase_namespace
-<ul>
-<li>super-types: !Asset</li>
-<li>attributes: qualifiedName, name, description, owner, clusterName, parameters, createTime, modifiedTime</li></ul></li>
-<li>hbase_table
-<ul>
-<li>super-types: DataSet</li>
-<li>attributes: qualifiedName, name, description, owner, namespace, column_families, uri, parameters, createtime, modifiedtime, maxfilesize, isReadOnly, isCompactionEnabled, isNormalizationEnabled, ReplicaPerRegion, Durability</li></ul></li>
-<li>hbase_column_family
-<ul>
-<li>super-types: DataSet</li>
-<li>attributes: qualifiedName, name, description, owner, columns, createTime, bloomFilterType, compressionType, compactionCompressionType, encryptionType, inMemoryCompactionPolicy, keepDeletedCells, maxversions, minVersions, datablockEncoding, storagePolicy, ttl, blockCachedEnabled, cacheBloomsOnWrite, cacheDataOnWrite, evictBlocksOnClose, prefetchBlocksOnOpen, newVersionsBehavior, isMobEnabled, mobCompactPartitionPolicy</li></ul></li></ul></li></ul>
-<p>HBase entities are created and de-duped in Atlas using unique attribute qualifiedName, whose value should be formatted as detailed below. Note that namespaceName, tableName and columnFamilyName should be in lower case.</p>
-<div class="source"><pre class="prettyprint">
- hbase_namespace.qualifiedName: <namespaceName>@<clusterName>
- hbase_table.qualifiedName: <namespaceName>:<tableName>@<clusterName>
- hbase_column_family.qualifiedName: <namespaceName>:<tableName>.<columnFamilyName>@<clusterName>
-
-</pre></div></div>
-<div class="section">
-<h3><a name="HBase_Hook"></a>HBase Hook</h3>
-<p>Atlas HBase hook registers with HBase master as a co-processor. On detecting changes to HBase namespaces/tables/column-families, Atlas hook updates the metadata in Atlas via Kafka notifications. Follow the instructions below to setup Atlas hook in HBase:</p>
-<ul>
-<li>Register Atlas hook in hbase-site.xml by adding the following:</li></ul>
-<div class="source"><pre class="prettyprint">
- <property>
- <name>hbase.coprocessor.master.classes</name>
- <value>org.apache.atlas.hbase.hook.HBaseAtlasCoprocessor</value>
- </property>
-</pre></div>
-<p></p>
-<ul>
-<li>untar apache-atlas-${project.version}-hbase-hook.tar.gz</li>
-<li>cd apache-atlas-hbase-hook-${project.version}</li>
-<li>Copy entire contents of folder apache-atlas-hbase-hook-${project.version}/hook/hbase to <atlas package>/hook/hbase</li>
-<li>Link Atlas hook jars in HBase classpath - 'ln -s <atlas package>/hook/hbase/* <hbase-home>/lib/'</li>
-<li>Copy <atlas-conf>/atlas-application.properties to the HBase conf directory.</li></ul>
-<p>The following properties in atlas-application.properties control the thread pool and notification details:</p>
-<div class="source"><pre class="prettyprint">
-atlas.hook.hbase.synchronous=false # whether to run the hook synchronously. false recommended to avoid delays in HBase operations. Default: false
-atlas.hook.hbase.numRetries=3 # number of retries for notification failure. Default: 3
-atlas.hook.hbase.queueSize=10000 # queue size for the threadpool. Default: 10000
-
-atlas.cluster.name=primary # clusterName to use in qualifiedName of entities. Default: primary
-
-atlas.kafka.zookeeper.connect= # Zookeeper connect URL for Kafka. Example: localhost:2181
-atlas.kafka.zookeeper.connection.timeout.ms=30000 # Zookeeper connection timeout. Default: 30000
-atlas.kafka.zookeeper.session.timeout.ms=60000 # Zookeeper session timeout. Default: 60000
-atlas.kafka.zookeeper.sync.time.ms=20 # Zookeeper sync time. Default: 20
-
-</pre></div>
-<p>Other configurations for Kafka notification producer can be specified by prefixing the configuration name with "atlas.kafka.". For list of configuration supported by Kafka producer, please refer to <a class="externalLink" href="http://kafka.apache.org/documentation/#producerconfigs">Kafka Producer Configs</a></p></div>
-<div class="section">
-<h3><a name="NOTES"></a>NOTES</h3>
-<p></p>
-<ul>
-<li>Only the namespace, table and column-family create/update/ delete operations are captured by Atlas HBase hook. Changes to columns are be captured.</li></ul></div>
-<div class="section">
-<h3><a name="Importing_HBase_Metadata"></a>Importing HBase Metadata</h3>
-<p>Apache Atlas provides a command-line utility, import-hbase.sh, to import metadata of Apache HBase namespaces and tables into Apache Atlas. This utility can be used to initialize Apache Atlas with namespaces/tables present in a Apache HBase cluster. This utility supports importing metadata of a specific table, tables in a specific namespace or all tables.</p>
-<div class="source"><pre class="prettyprint">
-Usage 1: <atlas package>/hook-bin/import-hbase.sh
-Usage 2: <atlas package>/hook-bin/import-hbase.sh [-n <namespace regex> OR --namespace <namespace regex>] [-t <table regex> OR --table <table regex>]
-Usage 3: <atlas package>/hook-bin/import-hbase.sh [-f <filename>]
- File Format:
- namespace1:tbl1
- namespace1:tbl2
- namespace2:tbl1
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Hook-Hive.html b/Hook-Hive.html
deleted file mode 100644
index 0f45634..0000000
--- a/Hook-Hive.html
+++ /dev/null
@@ -1,284 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Hook-Hive.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Apache Atlas Hook & Bridge for Apache Hive</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Apache Atlas Hook & Bridge for Apache Hive</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Apache_Atlas_Hook_.26_Bridge_for_Apache_Hive"></a>Apache Atlas Hook & Bridge for Apache Hive</h2></div>
-<div class="section">
-<h3><a name="Hive_Model"></a>Hive Model</h3>
-<p>Hive model includes the following types:</p>
-<ul>
-<li>Entity types:
-<ul>
-<li>hive_db
-<ul>
-<li>super-types: !Asset</li>
-<li>attributes: qualifiedName, name, description, owner, clusterName, location, parameters, ownerName</li></ul></li>
-<li>hive_table
-<ul>
-<li>super-types: DataSet</li>
-<li>attributes: qualifiedName, name, description, owner, db, createTime, lastAccessTime, comment, retention, sd, partitionKeys, columns, aliases, parameters, viewOriginalText, viewExpandedText, tableType, temporary</li></ul></li>
-<li>hive_column
-<ul>
-<li>super-types: DataSet</li>
-<li>attributes: qualifiedName, name, description, owner, type, comment, table</li></ul></li>
-<li>hive_storagedesc
-<ul>
-<li>super-types: Referenceable</li>
-<li>attributes: qualifiedName, table, location, inputFormat, outputFormat, compressed, numBuckets, serdeInfo, bucketCols, sortCols, parameters, storedAsSubDirectories</li></ul></li>
-<li>hive_process
-<ul>
-<li>super-types: Process</li>
-<li>attributes: qualifiedName, name, description, owner, inputs, outputs, startTime, endTime, userName, operationType, queryText, queryPlan, queryId, clusterName</li></ul></li>
-<li>hive_column_lineage
-<ul>
-<li>super-types: Process</li>
-<li>attributes: qualifiedName, name, description, owner, inputs, outputs, query, depenendencyType, expression</li></ul></li></ul></li></ul>
-<p></p>
-<ul>
-<li>Enum types:
-<ul>
-<li>hive_principal_type
-<ul>
-<li>values: USER, ROLE, GROUP</li></ul></li></ul></li></ul>
-<p></p>
-<ul>
-<li>Struct types:
-<ul>
-<li>hive_order
-<ul>
-<li>attributes: col, order</li></ul></li>
-<li>hive_serde
-<ul>
-<li>attributes: name, serializationLib, parameters</li></ul></li></ul></li></ul>
-<p>Hive entities are created and de-duped in Atlas using unique attribute qualifiedName, whose value should be formatted as detailed below. Note that dbName, tableName and columnName should be in lower case.</p>
-<div class="source"><pre class="prettyprint">
- hive_db.qualifiedName: <dbName>@<clusterName>
- hive_table.qualifiedName: <dbName>.<tableName>@<clusterName>
- hive_column.qualifiedName: <dbName>.<tableName>.<columnName>@<clusterName>
- hive_process.queryString: trimmed query string in lower case
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Hive_Hook"></a>Hive Hook</h3>
-<p>Atlas Hive hook registers with Hive to listen for create/update/delete operations and updates the metadata in Atlas, via Kafka notifications, for the changes in Hive. Follow the instructions below to setup Atlas hook in Hive:</p>
-<ul>
-<li>Set-up Atlas hook in hive-site.xml by adding the following:</li></ul>
-<div class="source"><pre class="prettyprint">
- <property>
- <name>hive.exec.post.hooks</name>
- <value>org.apache.atlas.hive.hook.HiveHook</value>
- </property>
-</pre></div>
-<p></p>
-<ul>
-<li>untar apache-atlas-${project.version}-hive-hook.tar.gz</li>
-<li>cd apache-atlas-hive-hook-${project.version}</li>
-<li>Copy entire contents of folder apache-atlas-hive-hook-${project.version}/hook/hive to <atlas package>/hook/hive</li>
-<li>Add 'export HIVE_AUX_JARS_PATH=<atlas package>/hook/hive' in hive-env.sh of your hive configuration</li>
-<li>Copy <atlas-conf>/atlas-application.properties to the hive conf directory.</li></ul>
-<p>The following properties in atlas-application.properties control the thread pool and notification details:</p>
-<div class="source"><pre class="prettyprint">
-atlas.hook.hive.synchronous=false # whether to run the hook synchronously. false recommended to avoid delays in Hive query completion. Default: false
-atlas.hook.hive.numRetries=3 # number of retries for notification failure. Default: 3
-atlas.hook.hive.queueSize=10000 # queue size for the threadpool. Default: 10000
-
-atlas.cluster.name=primary # clusterName to use in qualifiedName of entities. Default: primary
-
-atlas.kafka.zookeeper.connect= # Zookeeper connect URL for Kafka. Example: localhost:2181
-atlas.kafka.zookeeper.connection.timeout.ms=30000 # Zookeeper connection timeout. Default: 30000
-atlas.kafka.zookeeper.session.timeout.ms=60000 # Zookeeper session timeout. Default: 60000
-atlas.kafka.zookeeper.sync.time.ms=20 # Zookeeper sync time. Default: 20
-
-</pre></div>
-<p>Other configurations for Kafka notification producer can be specified by prefixing the configuration name with "atlas.kafka.". For list of configuration supported by Kafka producer, please refer to <a class="externalLink" href="http://kafka.apache.org/documentation/#producerconfigs">Kafka Producer Configs</a></p></div>
-<div class="section">
-<h3><a name="Column_Level_Lineage"></a>Column Level Lineage</h3>
-<p>Starting from 0.8-incubating version of Atlas, Column level lineage is captured in Atlas. Below are the details</p></div>
-<div class="section">
-<h4><a name="Model"></a>Model</h4>
-<p></p>
-<ul>
-<li>ColumnLineageProcess type is a subtype of Process</li></ul>
-<p></p>
-<ul>
-<li>This relates an output Column to a set of input Columns or the Input Table</li></ul>
-<p></p>
-<ul>
-<li>The lineage also captures the kind of dependency, as listed below:
-<ul>
-<li>SIMPLE: output column has the same value as the input</li>
-<li>EXPRESSION: output column is transformed by some expression at runtime (for e.g. a Hive SQL expression) on the Input Columns.</li>
-<li>SCRIPT: output column is transformed by a user provided script.</li></ul></li></ul>
-<p></p>
-<ul>
-<li>In case of EXPRESSION dependency the expression attribute contains the expression in string form</li></ul>
-<p></p>
-<ul>
-<li>Since Process links input and output DataSets, Column is a subtype of DataSet</li></ul></div>
-<div class="section">
-<h4><a name="Examples"></a>Examples</h4>
-<p>For a simple CTAS below:</p>
-<div class="source"><pre class="prettyprint">
-create table t2 as select id, name from T1
-</pre></div>
-<p>The lineage is captured as</p>
-<p><img src="images/column_lineage_ex1.png" alt="" /></p></div>
-<div class="section">
-<h4><a name="Extracting_Lineage_from_Hive_commands"></a>Extracting Lineage from Hive commands</h4>
-<p>* The HiveHook maps the LineageInfo in the HookContext to Column lineage instances</p>
-<p>* The LineageInfo in Hive provides column-level lineage for the final FileSinkOperator, linking them to the input columns in the Hive Query</p></div>
-<div class="section">
-<h3><a name="NOTES"></a>NOTES</h3>
-<p></p>
-<ul>
-<li>Column level lineage works with Hive version 1.2.1 after the patch for <a href="https://issues.apache.org/jira/browse/HIVE-13112">HIVE-13112</a> is applied to Hive source</li>
-<li>Since database name, table name and column names are case insensitive in hive, the corresponding names in entities are lowercase. So, any search APIs should use lowercase while querying on the entity names</li>
-<li>The following hive operations are captured by hive hook currently
-<ul>
-<li>create database</li>
-<li>create table/view, create table as select</li>
-<li>load, import, export</li>
-<li>DMLs (insert)</li>
-<li>alter database</li>
-<li>alter table (skewed table information, stored as, protection is not supported)</li>
-<li>alter view</li></ul></li></ul></div>
-<div class="section">
-<h3><a name="Importing_Hive_Metadata"></a>Importing Hive Metadata</h3>
-<p>Apache Atlas provides a command-line utility, import-hive.sh, to import metadata of Apache Hive databases and tables into Apache Atlas. This utility can be used to initialize Apache Atlas with databases/tables present in Apache Hive. This utility supports importing metadata of a specific table, tables in a specific database or all databases and tables.</p>
-<div class="source"><pre class="prettyprint">
-Usage 1: <atlas package>/hook-bin/import-hive.sh
-Usage 2: <atlas package>/hook-bin/import-hive.sh [-d <database regex> OR --database <database regex>] [-t <table regex> OR --table <table regex>]
-Usage 3: <atlas package>/hook-bin/import-hive.sh [-f <filename>]
- File Format:
- database1:tbl1
- database1:tbl2
- database2:tbl1
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Hook-Sqoop.html b/Hook-Sqoop.html
deleted file mode 100644
index c870e9f..0000000
--- a/Hook-Sqoop.html
+++ /dev/null
@@ -1,204 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Hook-Sqoop.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Apache Atlas Hook for Apache Sqoop</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Apache Atlas Hook for Apache Sqoop</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Apache_Atlas_Hook_for_Apache_Sqoop"></a>Apache Atlas Hook for Apache Sqoop</h2></div>
-<div class="section">
-<h3><a name="Sqoop_Model"></a>Sqoop Model</h3>
-<p>Sqoop model includes the following types:</p>
-<ul>
-<li>Entity types:
-<ul>
-<li>sqoop_process
-<ul>
-<li>super-types: Process</li>
-<li>attributes: qualifiedName, name, description, owner, inputs, outputs, operation, commandlineOpts, startTime, endTime, userName</li></ul></li>
-<li>sqoop_dbdatastore
-<ul>
-<li>super-types: DataSet</li>
-<li>attributes: qualifiedName, name, description, owner, dbStoreType, storeUse, storeUri, source</li></ul></li></ul></li></ul>
-<p></p>
-<ul>
-<li>Enum types:
-<ul>
-<li>sqoop_operation_type
-<ul>
-<li>values: IMPORT, EXPORT, EVAL</li></ul></li>
-<li>sqoop_dbstore_usage
-<ul>
-<li>values: TABLE, QUERY, PROCEDURE, OTHER</li></ul></li></ul></li></ul>
-<p>Sqoop entities are created and de-duped in Atlas using unique attribute qualifiedName, whose value should be formatted as detailed below.</p>
-<div class="source"><pre class="prettyprint">
- sqoop_process.qualifiedName: sqoop <operation> --connect <url> {[--table <tableName>] || [--database <databaseName>]} [--query <storeQuery>]
- sqoop_dbdatastore.qualifiedName: <storeType> --url <storeUri> {[--table <tableName>] || [--database <databaseName>]} [--query <storeQuery>] --hive-<operation> --hive-database <databaseName> [--hive-table <tableName>] --hive-cluster <clusterName>
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Sqoop_Hook"></a>Sqoop Hook</h3>
-<p>Sqoop added a SqoopJobDataPublisher that publishes data to Atlas after completion of import Job. Today, only hiveImport is supported in SqoopHook. This is used to add entities in Atlas using the model detailed above.</p>
-<p>Follow the instructions below to setup Atlas hook in Hive:</p>
-<p>Add the following properties to to enable Atlas hook in Sqoop:</p>
-<ul>
-<li>Set-up Atlas hook in <sqoop-conf>/sqoop-site.xml by adding the following:</li></ul>
-<div class="source"><pre class="prettyprint">
- <property>
- <name>sqoop.job.data.publish.class</name>
- <value>org.apache.atlas.sqoop.hook.SqoopHook</value>
- </property>
-</pre></div>
-<p></p>
-<ul>
-<li>untar apache-atlas-${project.version}-sqoop-hook.tar.gz</li>
-<li>cd apache-atlas-sqoop-hook-${project.version}</li>
-<li>Copy entire contents of folder apache-atlas-sqoop-hook-${project.version}/hook/sqoop to <atlas package>/hook/sqoop</li>
-<li>Copy <atlas-conf>/atlas-application.properties to to the sqoop conf directory <sqoop-conf>/</li>
-<li>Link <atlas package>/hook/sqoop/*.jar in sqoop lib</li></ul>
-<p>The following properties in atlas-application.properties control the thread pool and notification details:</p>
-<div class="source"><pre class="prettyprint">
-atlas.hook.sqoop.synchronous=false # whether to run the hook synchronously. false recommended to avoid delays in Sqoop operation completion. Default: false
-atlas.hook.sqoop.numRetries=3 # number of retries for notification failure. Default: 3
-atlas.hook.sqoop.queueSize=10000 # queue size for the threadpool. Default: 10000
-
-atlas.cluster.name=primary # clusterName to use in qualifiedName of entities. Default: primary
-
-atlas.kafka.zookeeper.connect= # Zookeeper connect URL for Kafka. Example: localhost:2181
-atlas.kafka.zookeeper.connection.timeout.ms=30000 # Zookeeper connection timeout. Default: 30000
-atlas.kafka.zookeeper.session.timeout.ms=60000 # Zookeeper session timeout. Default: 60000
-atlas.kafka.zookeeper.sync.time.ms=20 # Zookeeper sync time. Default: 20
-
-</pre></div>
-<p>Other configurations for Kafka notification producer can be specified by prefixing the configuration name with "atlas.kafka.". For list of configuration supported by Kafka producer, please refer to <a class="externalLink" href="http://kafka.apache.org/documentation/#producerconfigs">Kafka Producer Configs</a></p></div>
-<div class="section">
-<h3><a name="NOTES"></a>NOTES</h3>
-<p></p>
-<ul>
-<li>Only the following sqoop operations are captured by sqoop hook currently
-<ul>
-<li>hiveImport</li></ul></li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Hook-Storm.html b/Hook-Storm.html
deleted file mode 100644
index 6ea1d42..0000000
--- a/Hook-Storm.html
+++ /dev/null
@@ -1,203 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Hook-Storm.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Apache Atlas Hook for Apache Storm</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Apache Atlas Hook for Apache Storm</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Apache_Atlas_Hook_for_Apache_Storm"></a>Apache Atlas Hook for Apache Storm</h2></div>
-<div class="section">
-<h3><a name="Introduction"></a>Introduction</h3>
-<p>Apache Storm is a distributed real-time computation system. Storm makes it easy to reliably process unbounded streams of data, doing for real-time processing what Hadoop did for batch processing. The process is essentially a DAG of nodes, which is called <b>topology</b>.</p>
-<p>Apache Atlas is a metadata repository that enables end-to-end data lineage, search and associate business classification.</p>
-<p>The goal of this integration is to push the operational topology metadata along with the underlying data source(s), target(s), derivation processes and any available business context so Atlas can capture the lineage for this topology.</p>
-<p>There are 2 parts in this process detailed below:</p>
-<ul>
-<li>Data model to represent the concepts in Storm</li>
-<li>Storm Atlas Hook to update metadata in Atlas</li></ul></div>
-<div class="section">
-<h3><a name="Storm_Data_Model"></a>Storm Data Model</h3>
-<p>A data model is represented as Types in Atlas. It contains the descriptions of various nodes in the topology graph, such as spouts and bolts and the corresponding producer and consumer types.</p>
-<p>The following types are added in Atlas.</p>
-<p></p>
-<ul>
-<li>storm_topology - represents the coarse-grained topology. A storm_topology derives from an Atlas Process type and hence can be used to inform Atlas about lineage.</li>
-<li>Following data sets are added - kafka_topic, jms_topic, hbase_table, hdfs_data_set. These all derive from an Atlas Dataset type and hence form the end points of a lineage graph.</li>
-<li>storm_spout - Data Producer having outputs, typically Kafka, JMS</li>
-<li>storm_bolt - Data Consumer having inputs and outputs, typically Hive, HBase, HDFS, etc.</li></ul>
-<p>The Storm Atlas hook auto registers dependent models like the Hive data model if it finds that these are not known to the Atlas server.</p>
-<p>The data model for each of the types is described in the class definition at org.apache.atlas.storm.model.StormDataModel.</p></div>
-<div class="section">
-<h3><a name="Storm_Atlas_Hook"></a>Storm Atlas Hook</h3>
-<p>Atlas is notified when a new topology is registered successfully in Storm. Storm provides a hook, backtype.storm.ISubmitterHook, at the Storm client used to submit a storm topology.</p>
-<p>The Storm Atlas hook intercepts the hook post execution and extracts the metadata from the topology and updates Atlas using the types defined. Atlas implements the Storm client hook interface in org.apache.atlas.storm.hook.StormAtlasHook.</p></div>
-<div class="section">
-<h3><a name="Limitations"></a>Limitations</h3>
-<p>The following apply for the first version of the integration.</p>
-<p></p>
-<ul>
-<li>Only new topology submissions are registered with Atlas, any lifecycle changes are not reflected in Atlas.</li>
-<li>The Atlas server needs to be online when a Storm topology is submitted for the metadata to be captured.</li>
-<li>The Hook currently does not support capturing lineage for custom spouts and bolts.</li></ul></div>
-<div class="section">
-<h3><a name="Installation"></a>Installation</h3>
-<p>The Storm Atlas Hook needs to be manually installed in Storm on the client side.</p>
-<ul>
-<li>untar apache-atlas-${project.version}-storm-hook.tar.gz</li>
-<li>cd apache-atlas-storm-hook-${project.version}</li>
-<li>Copy entire contents of folder apache-atlas-storm-hook-${project.version}/hook/storm to $ATLAS_PACKAGE/hook/storm</li></ul>
-<p>Storm Atlas hook jars in $ATLAS_PACKAGE/hook/storm need to be copied to $STORM_HOME/extlib. Replace STORM_HOME with storm installation path.</p>
-<p>Restart all daemons after you have installed the atlas hook into Storm.</p></div>
-<div class="section">
-<h3><a name="Configuration"></a>Configuration</h3></div>
-<div class="section">
-<h4><a name="Storm_Configuration"></a>Storm Configuration</h4>
-<p>The Storm Atlas Hook needs to be configured in Storm client config in <b>$STORM_HOME/conf/storm.yaml</b> as:</p>
-<div class="source"><pre class="prettyprint">
-storm.topology.submission.notifier.plugin.class: "org.apache.atlas.storm.hook.StormAtlasHook"
-
-</pre></div>
-<p>Also set a 'cluster name' that would be used as a namespace for objects registered in Atlas. This name would be used for namespacing the Storm topology, spouts and bolts.</p>
-<p>The other objects like data sets should ideally be identified with the cluster name of the components that generate them. For e.g. Hive tables and databases should be identified using the cluster name set in Hive. The Storm Atlas hook will pick this up if the Hive configuration is available in the Storm topology jar that is submitted on the client and the cluster name is defined there. This happens similarly for HBase data sets. In case this configuration is not available, the cluster [...]
-<div class="source"><pre class="prettyprint">
-atlas.cluster.name: "cluster_name"
-
-</pre></div>
-<p>In <b>$STORM_HOME/conf/storm_env.ini</b>, set an environment variable as follows:</p>
-<div class="source"><pre class="prettyprint">
-STORM_JAR_JVM_OPTS:"-Datlas.conf=$ATLAS_HOME/conf/"
-
-</pre></div>
-<p>where ATLAS_HOME is pointing to where ATLAS is installed.</p>
-<p>You could also set this up programatically in Storm Config as:</p>
-<div class="source"><pre class="prettyprint">
- Config stormConf = new Config();
- ...
- stormConf.put(Config.STORM_TOPOLOGY_SUBMISSION_NOTIFIER_PLUGIN,
- org.apache.atlas.storm.hook.StormAtlasHook.class.getName());
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Import-API-Options.html b/Import-API-Options.html
deleted file mode 100644
index 81dc909..0000000
--- a/Import-API-Options.html
+++ /dev/null
@@ -1,261 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Import-API-Options.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Import API Options</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Import API Options</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Import_API_Options"></a>Import API Options</h2>
-<p>Import API options are specified as <i>options</i> JSON. Since the API accepts multi-part form data, it is possible to sepecify multipls input streams within the CURL call.</p></div>
-<div class="section">
-<h4><a name="Examples_Using_CURL_Calls"></a>Examples Using CURL Calls</h4>
-<div class="source"><pre class="prettyprint">
-curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data"
- -H "Cache-Control: no-cache"
- -F request=@importOptions.json
- -F data=@quickStartDB.zip
- "http://localhost:21000/api/atlas/admin/import"
-
-</pre></div>
-<p>To use the defaults, set the contents of <i>importOptions.json</i> to:</p>
-<div class="source"><pre class="prettyprint">
-{
- "options": {
- }
-}
-
-</pre></div></div>
-<div class="section">
-<h4><a name="Options"></a>Options</h4>
-<p>Following options are supported for Import process:</p>
-<p></p>
-<ul>
-<li>Specify transforms during import operation.</li>
-<li>Resume import by specifying starting entity guid.</li>
-<li>Optionally import type definition.</li></ul></div>
-<div class="section">
-<h5><a name="Transforms"></a>Transforms</h5>
-<p>During the import process, the attribute value of the incoming entity can be changed.</p>
-<p>This is possible by specifying entity type and at attribute to be modified and then the manner in which it needs to be modified.</p>
-<p>Right now these are the transforms that can be applied:</p>
-<ul>
-<li><i>lowercase</i> Converts the attribute value to lower case.</li>
-<li><i>replace</i> This performs a string find and replace operation. It takes two parameters, the first is the string to search for and the next one is the string to replace it with.</li></ul>
-<p>Example:</p>
-<p>The example below applies couple of transforms to the the <i>qualifiedName</i> attribute of hive_table. It converts the value to lower case, then searches for 'cl1', if found, replaces it with 'cl2'.</p>
-<p>To use the option, set the contents of <i>importOptions.json</i> to:</p>
-<div class="source"><pre class="prettyprint">
-{
- "options": {
- "transforms": "{ \"hive_table\": { \"qualifiedName\": [ \"replace:@cl1:@cl2\" ] }, \"hive_db\": { \"qualifiedName\": [ \"replace:@cl1:@cl2\" ] } }"
- }
-}
-
-</pre></div>
-<p>Please refer to <a class="externalLink" href="https://issues.apache.org/jira/browse/ATLAS-1825">ATLAS-1825</a> for details scenarios when this option could be used.</p></div>
-<div class="section">
-<h5><a name="Start_Guid_or_Start_Index"></a>Start Guid or Start Index</h5>
-<p>When an import operation is in progress and the server goes down, it would be possible to resume import from the last successfully imported entity. This would allow the import to resume from where it left off.</p>
-<p>Server-side logging is improved to display the detail of the last successfully imported entity, this includes the index within the import list and the entity's guid. Either can be used specify the point to resume import.</p>
-<p>To use the option, set the contents of <i>importOptions.json</i> to:</p>
-<div class="source"><pre class="prettyprint">
-{
-
- "options": {
- "startGuid": "bd97c78e-3fa5-4f9c-9f48-3683ca3d1fb1"
- }
-}
-
-</pre></div>
-<p>To use <i>startPosition</i>, use the following in the <i>importOptions.json</i>:</p>
-<div class="source"><pre class="prettyprint">
-{
-
- "options": {
- "startPosition": "332"
- }
-}
-
-</pre></div>
-<p>Steps to use the behavior:</p>
-<ul>
-<li>Start an import (using the CURL) that is fairly long, say about 1000+ entities.</li>
-<li>While the import is in progress, stop atlas server (using atlas_stop.py).</li>
-<li>From the log file located at <i>/var/log/atlas/application.log</i> get the last successfully imported entity GUID or index position.</li>
-<li>Update the <i>importOptions.json</i> with the guid.</li>
-<li>Restart import.</li></ul></div>
-<div class="section">
-<h5><a name="Optional_Importing_Type_Definition"></a>Optional Importing Type Definition</h5>
-<p>The output of Export has <i>atlas-typedef.json</i> that contains the type definitions for the entities exported.</p>
-<p>By default (that is if no options is specified), the type definitions are imported and applied to the system being imported to. The entity import is performed after this.</p>
-<p>In some cases, you would not want to modify the type definitions. Import may be better off failing than the types be modified.</p>
-<p>This option allows for optionally importing of type definition. The option is set to <i>true</i> by default, which means that type definition is imported. With this option set to <i>false</i>, type definitions preseneraent in the source will not be imported. In case of mismatch between the entities being imported the types present in the system where the import is being performed, the operation will fail.</p>
-<p>Table below enumerates the conditions that get addressed as part of type definition import:</p>
-<p></p>
-<table border="0" class="table table-striped">
-<tr class="a">
-<th>Condition</th>
-<th>Action</th></tr>
-<tr class="b">
-<td>Incoming type does not exist in target system</td>
-<td>Type is created.</td></tr>
-<tr class="a">
-<td>Type to be imported and type in target system are same</td>
-<td>No change</td></tr>
-<tr class="b">
-<td>Type to be imported and type in target system differ by some attributes</td>
-<td>Target system type is updated to the attributes present in the source. It is possible that the target system will have attributes in addition to the one present in the source. In that case, the target system's type attributes will be an union of the attributes. Attributes in target system will not be deleted to match the source. If the type of the attribute differ, import process will be aborted and exception logged.</td></tr></table>To use the option, set the contents of <i>importOp [...]
-<div class="source"><pre class="prettyprint">
-{
-
- "options": {
- "updateTypeDefinition": true
- }
-}
-
-</pre></div></div>
-<div class="section">
-<h5><a name="Specifying_File_to_be_Imported_From_Server_Location"></a>Specifying File to be Imported From Server Location</h5>
-<p>In scenario where the file to be imported is present at a location on the server, the <i>importfile</i> API can be used. It behaves like the Import API.</p>
-<p>To use the option, set the contents of <i>importOptions.json</i> to:</p>
-<div class="source"><pre class="prettyprint">
-{
-
- "options": {
- "fileName": "/root/fileToBeImported.zip"
- }
-}
-
-</pre></div>
-<p><i>CURL</i></p>
-<div class="source"><pre class="prettyprint">
-curl -g -X POST -u adminuser:password -H "Content-Type: application/json"
- -H "Cache-Control: no-cache"
- -d r@importOptions.json
- "http://localhost:21000/api/atlas/admin/importfile"
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Import-API.html b/Import-API.html
deleted file mode 100644
index 350ef0c..0000000
--- a/Import-API.html
+++ /dev/null
@@ -1,287 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Import-API.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Import API</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Import API</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Import_API"></a>Import API</h2>
-<p>The general approach is:</p>
-<ul>
-<li>Consumer makes a ZIP file available for import operation. See details below for the 2 flavors of the API.</li>
-<li>The API if successful, will return the results of the operation.</li>
-<li>Error will be returned on failure of the call.</li></ul></div>
-<div class="section">
-<h4><a name="Import_ZIP_File_Using_POST"></a>Import ZIP File Using POST</h4>
-<p></p>
-<table border="0" class="table table-striped">
-<tr class="a">
-<th>Title</th>
-<th>Import API</th></tr>
-<tr class="b">
-<td><i>Example</i></td>
-<td>See Examples sections below.</td></tr>
-<tr class="a">
-<td><i>Description</i></td>
-<td>Provide the contents of the file to be imported in the request body.</td></tr>
-<tr class="b">
-<td><i>URL</i></td>
-<td><i>api/atlas/admin/import</i></td></tr>
-<tr class="a">
-<td><i>Method</i></td>
-<td><i>POST</i></td></tr>
-<tr class="b">
-<td><i>URL Parameters</i></td>
-<td><i>None</i></td></tr>
-<tr class="a">
-<td><i>Data Parameters</i></td>
-<td><i>None</i></td></tr>
-<tr class="b">
-<td><i>Success Response</i></td>
-<td><i>AtlasImporResult</i> is returned as JSON. See details below.</td></tr>
-<tr class="a">
-<td><i>Error Response</i></td>
-<td>Errors that are handled within the system will be returned as <i>AtlasBaseException</i>.</td></tr></table></div>
-<div class="section">
-<h4><a name="Import_ZIP_File_Available_on_Server"></a>Import ZIP File Available on Server</h4>
-<p></p>
-<table border="0" class="table table-striped">
-<tr class="a">
-<th>Title</th>
-<th>Import API</th></tr>
-<tr class="b">
-<td><i>Example</i></td>
-<td>See Examples sections below.</td></tr>
-<tr class="a">
-<td><i>Description</i></td>
-<td>Provide the path of the file to be imported.</td></tr>
-<tr class="b">
-<td><i>URL</i></td>
-<td><i>api/atlas/admin/importfile</i></td></tr>
-<tr class="a">
-<td><i>Method</i></td>
-<td><i>POST</i></td></tr>
-<tr class="b">
-<td><i>URL Parameters</i></td>
-<td><i>None</i></td></tr>
-<tr class="a">
-<td><i>Data Parameters</i></td>
-<td><i>None</i></td></tr>
-<tr class="b">
-<td><i>Success Response</i></td>
-<td><i>AtlasImporResult</i> is returned as JSON. See details below.</td></tr>
-<tr class="a">
-<td><i>Error Response</i></td>
-<td>Errors that are handled within the system will be returned as <i>AtlasBaseException</i>.</td></tr>
-<tr class="b">
-<td><i>Notes</i></td>
-<td>The file to be imported needs to be present on the server at the location specified by the <i>FILENAME</i> parameter.</td></tr></table><b><i>Method Signature for Import</i></b>
-<div class="source"><pre class="prettyprint">
-@POST
-@Path("/import")
-@Produces("application/json; charset=UTF-8")
-@Consumes("multipart/form-data")
-
-</pre></div>
-<p><b><i>Method Signature for Import File</i></b></p>
-<div class="source"><pre class="prettyprint">
-@POST
-@Path("/importfile")
-@Produces("application/json; charset=UTF-8")
-@Consumes("application/json")
-
-</pre></div>
-<p><b><i>Import Options</i></b> Please see <b><i><a href="./Import-API-Options.html">here</a></i></b> for the available options during import process.</p>
-<p><b><i>AtlasImportResult Response</i></b> The API will return the results of the import operation in the format defined by the <i>AtlasImportResult</i>:</p>
-<ul>
-<li><i>AtlasImportParameters</i>: This contains a collection of name value pair of the options that are applied during the import operation.</li>
-<li><i>Metrics</i>: Operation metrics. These include details on the number of types imported, number of entities imported, etc.</li>
-<li><i>Processed Entities</i>: Contains list of GUIDs for the entities that were processed.</li>
-<li><i>Operation Status</i>: Overall status of the operation. Values are <i>SUCCESS</i>, PARTIAL_SUCCESS, <i>FAIL</i>.</li></ul></div>
-<div class="section">
-<h4><a name="Examples_Using_CURL_Calls"></a>Examples Using CURL Calls</h4>
-<p>The call below performs Import of <i>QuickStart</i> database using POST.</p>
-<div class="source"><pre class="prettyprint">
-curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data"
- -H "Cache-Control: no-cache"
- -F request=@importOptions.json
- -F data=@quickStartDB.zip
- "http://localhost:21000/api/atlas/admin/import"
-
-</pre></div>
-<p>The <i>request</i> parameter is optional. If import has to be run without any options use:</p>
-<div class="source"><pre class="prettyprint">
-curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data"
- -H "Cache-Control: no-cache"
- -F data=@quickStartDB.zip
- "http://localhost:21000/api/atlas/admin/import"
-
-</pre></div>
-<p>The call below performs Import of <i>QuickStart</i> database using a ZIP file available on server.</p>
-<div class="source"><pre class="prettyprint">
-curl -X POST -u adminuser:password -H "Cache-Control: no-cache" -d ./importOptions.json
-"http://localhost:21000/api/atlas/admin/importFile" > quickStartDB-import-result.json
-
-</pre></div>
-<p>Below is the <i>AtlasImportResult</i> JSON for an import that contains <i>hive</i>db_.</p>
-<p>The <i>processedEntities</i> contains the <i>guids</i> of all the entities imported.</p>
-<p>The <i>metrics</i> contain a breakdown of the types and entities imported along with the operation performed on them viz. <i>created</i> or <i>updated</i>.</p>
-<div class="source"><pre class="prettyprint">
-{
- "request": {
- "options": {}
- },
- "userName": "admin",
- "clientIpAddress": "10.0.2.2",
- "hostName": "10.0.2.15",
- "timeStamp": 1491285622823,
- "metrics": {
- "duration": 9143,
- "typedef:enum": 0,
- "typedef:struct": 0,
- "entity:hive_column:created": 461,
- "entity:hive_storagedesc:created": 20,
- "entity:hive_process:created": 12,
- "entity:hive_db:created": 5,
- "entity:hive_table:created": 20,
- "entity:hdfs_path:created": 2,
- "typedef:entitydef": 0,
- "typedef:classification": 3
- },
- "processedEntities": [
- "2c4aa713-030b-4fb3-98b1-1cab23d9ac81",
- "e4aa71ed-70fd-4fa7-9dfb-8250a573e293",
-
- ...
-
- "ea0f9bdb-1dfc-4e48-9848-a006129929f9",
- "b5e2cb41-3e7d-4468-84e1-d87c320e75f9"
- ],
- "operationStatus": "SUCCESS"
-}
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Import-Export-API.html b/Import-Export-API.html
deleted file mode 100644
index e78480e..0000000
--- a/Import-Export-API.html
+++ /dev/null
@@ -1,173 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Import-Export-API.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Export & Import REST APIs</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Export & Import REST APIs</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Export_.26_Import_REST_APIs"></a>Export & Import REST APIs</h2></div>
-<div class="section">
-<h4><a name="What.27s_New"></a>What's New</h4>
-<p>The release of 0.8.3 includes the following improvements to Export and Import APIs:</p>
-<ul>
-<li>Export: Support for <i><a href="./Incremental-Export.html">Incremental Export</a></i>.</li>
-<li>Export & Import: Support for <a href="./ReplicatedToFromAttributes.html">replicated attributes</a> to entities made possible by <i><a href="./SoftReference.html">SoftReference</a></i> entity attribute option.</li>
-<li>Export option: <i><a href="./Incremental-Export.html">skipLineage</a></i>.</li>
-<li>New entity transforms framework.</li>
-<li>New <i><a href="./AtlasServer.html">AtlasServer</a></i> entity type.</li>
-<li>Export: <a href="./Export-HDFS-API.html">Automatic creation of HDFS path</a> requested entities.</li>
-<li>New <a href="./ExportImportAudits.html">audits</a> for Export & Import operations.</li></ul></div>
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>The Import-Export APIs for Atlas facilitate transfer of data to and from a cluster that has Atlas provisioned.</p>
-<p>The APIs when integrated with backup and/or disaster recovery process will ensure participation of Atlas.</p></div>
-<div class="section">
-<h4><a name="Introduction"></a>Introduction</h4>
-<p>There are 2 broad categories viz. Export & Import. The details of the APIs are discussed below.</p>
-<p>The APIs are available only to <i>admin</i> user.</p>
-<p>Only a single import or export operation can be performed at a given time. The operations have a potential for generating large amount. They can also put pressure on resources. This restriction tries to alleviate this problem.</p>
-<p>For Import-Export APIs relating to HDFS path, can be found <a href="./Import-Export-HDFS-Path.html">here</a>.</p>
-<p>For additional information please refer to the following:</p>
-<ul>
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/ATLAS-1503">ATLAS-1503</a> Original Import-Export API requirements.</li>
-<li><a class="externalLink" href="https://issues.apache.org/jira/browse/ATLAS-1618">ATLAS-1618</a> Export API Scope Specification.</li></ul></div>
-<div class="section">
-<h4><a name="Errors"></a>Errors</h4>
-<p>If an import or export operation is initiated while another is in progress, the consumer will receive this error:</p>
-<div class="source"><pre class="prettyprint">
-"ATLAS5005E": "Another import or export is in progress. Please try again."
-
-</pre></div>
-<p>Unhandled errors will be returned as Internal error code 500.</p></div>
-<div class="section">
-<h3><a name="REST_API_Reference"></a>REST API Reference</h3>
-<p></p>
-<ul>
-<li><b><i><a href="./Export-API.html">Export</a></i></b></li>
-<li><b><i><a href="./Export-HDFS-API.html">Export HDFS</a></i></b></li>
-<li><b><i><a href="./Import-API.html">Import</a></i></b></li>
-<li><b><i><a href="./Import-API-Options.html">Import Options</a></i></b></li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/ImportEntityTransforms.html b/ImportEntityTransforms.html
deleted file mode 100644
index ce0753b..0000000
--- a/ImportEntityTransforms.html
+++ /dev/null
@@ -1,312 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/ImportEntityTransforms.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – (New) Entity Transforms Framework</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">(New) Entity Transforms Framework</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<h1>(New) Entity Transforms Framework</h1>
-<div class="section">
-<div class="section">
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>During Import Process, entity transforms are required to make changes to the entity before it gets committed to the database. These modifications are necessary to make the entity conform to the environment it is going to reside. The Import Process provided a mechanism to do that.</p></div>
-<div class="section">
-<h4><a name="Transformation_Framework"></a>Transformation Framework</h4>
-<p>A transformation framework allows a mechanism to selectively transform an entity or specific attributes of that entity.</p>
-<p>To achieve this, the framework, provides:</p>
-<ul>
-
-<li>Way to set a condition that needs to be satisfied for a transformation to be applied.</li>
-<li>Action to be taken on the entity once the condition is met.</li>
-</ul>
-<p>The existing transformation frameworks allowed this to happen.</p></div>
-<div class="section">
-<h4><a name="Reason_for_New_Transformation_Framework"></a>Reason for New Transformation Framework</h4>
-<p>While the existing framework provided the basic benefits of transformation framework, it did not have support for some of the commonly used Atlas types. Which meant that users of this framework would have to meticulously define transformations for every type they are working with. This can be tedious and potentially error prone. The new framework addresses this problem by providing built-in transformations for some of the commonly used types. It can also be extended to accommodate new [...]
-<div class="section">
-<h4><a name="Approach"></a>Approach</h4>
-<p>The approach used by the new transformation framework creates a transformation by: * Specifying a condition. * Specifying action(s) to be taken if condition is met.</p>
-<div class="section">
-<h5><a name="Conditions"></a>Conditions</h5>
-<p>Following are built-in conditions.</p>
-<table border="0" class="table table-striped">
-<thead>
-
-<tr class="a">
-<th>Condition Types </th>
-<th> Description </th></tr>
-</thead><tbody>
-
-<tr class="b">
-<td>ENTITY_ALL </td>
-<td> Any/every entity </td></tr>
-<tr class="a">
-<td>ENTITY_TOP_LEVEL </td>
-<td> Entity that is the top-level entity. This is also the entity present specified in <i>AtlasExportRequest</i>.</td></tr>
-<tr class="b">
-<td>EQUALS </td>
-<td> Entity attribute equals to the one specified in the condition. </td></tr>
-<tr class="a">
-<td>EQUALS_IGNORE_CASE </td>
-<td> Entity attribute equals to the one specified in the condition ignoring case. </td></tr>
-<tr class="b">
-<td>STARTS_WITH </td>
-<td> Entity attribute starts with. </td></tr>
-<tr class="a">
-<td>STARTS_WITH_IGNORE_CASE </td>
-<td> Entity attribute starts with ignoring case. </td></tr>
-<tr class="b">
-<td>HAS_VALUE </td>
-<td> Entity attribute has value. </td></tr>
-</tbody>
-</table></div>
-<div class="section">
-<h5><a name="Actions"></a>Actions</h5>
-<table border="0" class="table table-striped">
-<thead>
-
-<tr class="a">
-<th>Action Type </th>
-<th> Description </th></tr>
-</thead><tbody>
-
-<tr class="b">
-<td>ADD_CLASSIFICATION </td>
-<td> Add classifiction </td></tr>
-<tr class="a">
-<td>REPLACE_PREFIX </td>
-<td> Replace value starting with another value. </td></tr>
-<tr class="b">
-<td>TO_LOWER </td>
-<td> Convert value of an attribute to lower case. </td></tr>
-<tr class="a">
-<td>SET </td>
-<td> Set the value of an attribute </td></tr>
-<tr class="b">
-<td>CLEAR </td>
-<td> Clear value of an attribute </td></tr>
-</tbody>
-</table></div></div>
-<div class="section">
-<h4><a name="Built-in_Transforms"></a>Built-in Transforms</h4>
-<div class="section">
-<div class="section">
-<h6><a name="Add_Classification"></a>Add Classification</h6>
-<p>During import, hive_db entity whose <i>qualifiedName</i> is <i>stocks@cl1</i> will get the classification <i>clSrcImported</i>.</p>
-
-<div>
-<div>
-<pre class="source">{
- "conditions": {
- "hive_db.qualifiedName": "stocks@cl1"
- },
- "action": {
- "__entity": "ADD_CLASSIFICATION: clSrcImported"
- }
-}
-</pre></div></div>
-
-<p>Every imported entity will get the classification by simply changing the condition. The __entity is special condition which matches entity.</p>
-
-<div>
-<div>
-<pre class="source">{
- "conditions": {
- "__entity": ""
- },
- "action": {
- "__entity": "ADD_CLASSIFICATION: clSrcImported"
- }
-}
-</pre></div></div>
-
-<p>To add classification to only the top-level entity (entity that is used as starting point for an export), use:</p>
-
-<div>
-<div>
-<pre class="source">{
- "conditions": {
- "__entity": "topLevel:"
- },
- "action": {
- "__entity": "ADD_CLASSIFICATION: clSrcImported"
- }
-}
-</pre></div></div>
-</div>
-<div class="section">
-<h6><a name="Replace_Prefix"></a>Replace Prefix</h6>
-<p>This action works on string values. The first parameter is the prefix that is searched for a match, once matched, it is replaced with the provided replacement string.</p>
-<p>The sample below searches for <i>/aa/bb/</i>, once found replaces it with <i>/xx/yy/</i>.</p>
-
-<div>
-<div>
-<pre class="source">{
- "conditions": {
- "hdfs_path.clusterName": "EQUALS: CL1"
- },
- "action": {
- "hdfs_path.path": "REPLACE_PREFIX: = :/aa/bb/=/xx/yy/"
- }
-}
-</pre></div></div>
-</div>
-<div class="section">
-<h6><a name="To_Lower"></a>To Lower</h6>
-<p>Entity whose hdfs_path.clusterName is CL1 will get its path attribute converted to lower case.</p>
-
-<div>
-<div>
-<pre class="source">{
- "conditions": {
- "hdfs_path.clusterName": "EQUALS: CL1"
- },
- "action": {
- "hdfs_path.path": "TO_LOWER:"
- }
-}
-</pre></div></div>
-</div>
-<div class="section">
-<h6><a name="Clear"></a>Clear</h6>
-<p>Entity whose hdfs_path.clusterName has value set, will get its <i>replicatedTo</i> attribute value cleared.</p>
-
-<div>
-<div>
-<pre class="source">{
- "conditions": {
- "hdfs_path.clusterName": "HAS_VALUE:"
- },
- "action": {
- "hdfs_path.replicatedTo": "CLEAR:"
- }
-}
-</pre></div></div>
-</div></div></div>
-<div class="section">
-<h4><a name="Additional_Examples"></a>Additional Examples</h4>
-<p>Please look at <a class="externalLink" href="https://github.com/apache/atlas/blob/master/intg/src/test/java/org/apache/atlas/entitytransform/TransformationHandlerTest.java">these tests</a> for examples using Java classes.</p></div></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Incremental-Export.html b/Incremental-Export.html
deleted file mode 100644
index e6f7446..0000000
--- a/Incremental-Export.html
+++ /dev/null
@@ -1,162 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/Incremental-Export.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Incremental Export</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Incremental Export</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Incremental_Export"></a>Incremental Export</h2>
-<div class="section">
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>Incremental export allows for export of entities after a specified timestamp. This allows for synchronization capability to be built as it makes payloads lighter.</p></div>
-<div class="section">
-<h4><a name="Export_Options"></a>Export Options</h4>
-<p>New <i>fetchType</i> added to indicate incremental export. This option can be used with any <i>matchType</i>. When <i>fetchType</i> is <i>incremental</i>, it is necessary to specify the <i>changeMarker</i> option for incremental export to function, else full export will be performed.</p>
-
-<div>
-<div>
-<pre class="source">{
- "itemsToExport": [
- { "typeName": "hive_db", "uniqueAttributes": { "qualifiedName": "stocks@cl1" } }
- ],
-"options": {
- "fetchType": "incremental",
- "changeMarker": 10000
- }
-}
-</pre></div></div>
-</div>
-<div class="section">
-<h4><a name="Getting_Change_Marker"></a>Getting Change Marker</h4>
-<p>The very first call to export with <i>fetchType</i> set to <i>incremental</i> should be made with <i>changeMarker</i> set to 0. This will perform a full export. The <i>AtlasExportResult</i> will have the <i>changeMarker</i> set to a value. This is the value that should be used for subsequent call to Export.</p></div>
-<div class="section">
-<h4><a name="Skip_Lineage_Option"></a>Skip Lineage Option</h4>
-<p>Export can be performed by skipping lineage information. This avoids all lineage information getting into the exported file.</p></div>
-<div class="section">
-<h4><a name="Benefit_of_Incremental_Export"></a>Benefit of Incremental Export</h4>
-<p>The real benefit of incremental export comes when export is done with <i>skipLineage</i> option set to <i>true</i>. This greatly improves performance when fetching entities that have changed since the last export.</p></div></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/InstallationSteps.html b/InstallationSteps.html
deleted file mode 100644
index 2e88a2a..0000000
--- a/InstallationSteps.html
+++ /dev/null
@@ -1,452 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/InstallationSteps.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Building & Installing Apache Atlas</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Building & Installing Apache Atlas</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h3><a name="Building_.26_Installing_Apache_Atlas"></a>Building & Installing Apache Atlas</h3></div>
-<div class="section">
-<h4><a name="Building_Apache_Atlas"></a>Building Apache Atlas</h4>
-<p>Download Apache Atlas 1.0.0 release sources, apache-atlas-1.0.0-sources.tar.gz, from <a class="externalLink" href="http://atlas.apache.org/Downloads.html">downloads</a> page. Then follow the instructions below to to build Apache Atlas.</p>
-<div class="source"><pre class="prettyprint">
-tar xvfz apache-atlas-1.0.0-sources.tar.gz
-cd apache-atlas-sources-1.0.0/
-export MAVEN_OPTS="-Xms2g -Xmx2g"
-mvn clean -DskipTests install
-</pre></div></div>
-<div class="section">
-<h4><a name="Packaging_Apache_Atlas"></a>Packaging Apache Atlas</h4>
-<p>To create Apache Atlas package for deployment in an environment having functional Apache HBase and Apache Solr instances, build with the following command:</p>
-<div class="source"><pre class="prettyprint">
-mvn clean -DskipTests package -Pdist
-</pre></div>
-<p></p>
-<ul>
-<li>NOTES:
-<ul>
-<li>Remove option '-DskipTests' to run unit and integration tests</li>
-<li>To build a distribution without minified js,css file, build with <i>skipMinify</i> profile. By default js and css files are minified.</li></ul></li></ul>
-<p>Above will build Apache Atlas for an environment having functional HBase and Solr instances. Apache Atlas needs to be setup with the following to run in this environment:</p>
-<ul>
-<li>Configure atlas.graph.storage.hostname (see "Graph persistence engine - HBase" in the <a href="./Configuration.html">Configuration</a> section).</li>
-<li>Configure atlas.graph.index.search.solr.zookeeper-url (see "Graph Search Index - Solr" in the <a href="./Configuration.html">Configuration</a> section).</li>
-<li>Set HBASE_CONF_DIR to point to a valid Apache HBase config directory (see "Graph persistence engine - HBase" in the <a href="./Configuration.html">Configuration</a> section).</li>
-<li>Create indices in Apache Solr (see "Graph Search Index - Solr" in the <a href="./Configuration.html">Configuration</a> section).</li></ul></div>
-<div class="section">
-<h4><a name="Packaging_Apache_Atlas_with_embedded_Apache_HBase_.26_Apache_Solr"></a>Packaging Apache Atlas with embedded Apache HBase & Apache Solr</h4>
-<p>To create Apache Atlas package that includes Apache HBase and Apache Solr, build with the embedded-hbase-solr profile as shown below:</p>
-<div class="source"><pre class="prettyprint">
-mvn clean -DskipTests package -Pdist,embedded-hbase-solr
-</pre></div>
-<p>Using the embedded-hbase-solr profile will configure Apache Atlas so that an Apache HBase instance and an Apache Solr instance will be started and stopped along with the Apache Atlas server.</p>
-<p>NOTE: This distribution profile is only intended to be used for single node development not in production.</p></div>
-<div class="section">
-<h4><a name="Packaging_Apache_Atlas_with_embedded_Apache_Cassandra_.26_Apache_Solr"></a>Packaging Apache Atlas with embedded Apache Cassandra & Apache Solr</h4>
-<p>To create Apache Atlas package that includes Apache Cassandra and Apache Solr, build with the embedded-cassandra-solr profile as shown below:</p>
-<div class="source"><pre class="prettyprint">
-mvn clean package -Pdist,embedded-cassandra-solr
-</pre></div>
-<p>Using the embedded-cassandra-solr profile will configure Apache Atlas so that an Apache Cassandra instance and an Apache Solr instance will be started and stopped along with the Atlas server.</p>
-<p>NOTE: This distribution profile is only intended to be used for single node development not in production.</p></div>
-<div class="section">
-<h4><a name="Apache_Atlas_Package"></a>Apache Atlas Package</h4>
-<p>Build will create following files, which are used to install Apache Atlas.</p>
-<div class="source"><pre class="prettyprint">
-distro/target/apache-atlas-${project.version}-bin.tar.gz
-distro/target/apache-atlas-${project.version}-hbase-hook.tar.gz
-distro/target/apache-atlas-${project.version}-hive-hook.gz
-distro/target/apache-atlas-${project.version}-kafka-hook.gz
-distro/target/apache-atlas-${project.version}-sources.tar.gz
-distro/target/apache-atlas-${project.version}-sqoop-hook.tar.gz
-distro/target/apache-atlas-${project.version}-storm-hook.tar.gz
-</pre></div></div>
-<div class="section">
-<h4><a name="Installing_.26_Running_Apache_Atlas"></a>Installing & Running Apache Atlas</h4></div>
-<div class="section">
-<h5><a name="Installing_Apache_Atlas"></a>Installing Apache Atlas</h5>
-<p>From the directory you would like Apache Atlas to be installed, run the following commands:</p>
-<div class="source"><pre class="prettyprint">
-tar -xzvf apache-atlas-${project.version}-server.tar.gz
-cd atlas-${project.version}
-</pre></div></div>
-<div class="section">
-<h5><a name="Running_Apache_Atlas_with_Local_Apache_HBase_.26_Apache_Solr"></a>Running Apache Atlas with Local Apache HBase & Apache Solr</h5>
-<p>To run Apache Atlas with local Apache HBase & Apache Solr instances that are started/stopped along with Atlas start/stop, run following commands:</p>
-<div class="source"><pre class="prettyprint">
-export MANAGE_LOCAL_HBASE=true
-export MANAGE_LOCAL_SOLR=true
-
-bin/atlas_start.py
-</pre></div></div>
-<div class="section">
-<h5><a name="Using_Apache_Atlas"></a>Using Apache Atlas</h5>
-<p></p>
-<ul>
-<li>To verify if Apache Atlas server is up and running, run curl command as shown below:</li></ul>
-<div class="source"><pre class="prettyprint">
- curl -u username:password http://localhost:21000/api/atlas/admin/version
-
- {"Description":"Metadata Management and Data Governance Platform over Hadoop","Version":"1.0.0","Name":"apache-atlas"}
-</pre></div>
-<p></p>
-<ul>
-<li>Run quick start to load sample model and data</li></ul>
-<div class="source"><pre class="prettyprint">
- bin/quick_start.py
- Enter username for atlas :-
- Enter password for atlas :-
-
-</pre></div>
-<p></p>
-<ul>
-<li>Access Apache Atlas UI using a browser: <a class="externalLink" href="http://localhost:21000">http://localhost:21000</a></li></ul></div>
-<div class="section">
-<h5><a name="Stopping_Apache_Atlas_Server"></a>Stopping Apache Atlas Server</h5>
-<p>To stop Apache Atlas, run following command:</p>
-<div class="source"><pre class="prettyprint">
-bin/atlas_stop.py
-</pre></div></div>
-<div class="section">
-<h4><a name="Configuring_Apache_Atlas"></a>Configuring Apache Atlas</h4>
-<p>By default config directory used by Apache Atlas is <i>{package dir}/conf</i>. To override this set environment variable ATLAS_CONF to the path of the conf dir.</p>
-<p>Environment variables needed to run Apache Atlas can be set in <i>atlas-env.sh</i> file in the conf directory. This file will be sourced by Apache Atlas scripts before any commands are executed. The following environment variables are available to set.</p>
-<div class="source"><pre class="prettyprint">
-# The java implementation to use. If JAVA_HOME is not found we expect java and jar to be in path
-#export JAVA_HOME=
-
-# any additional java opts you want to set. This will apply to both client and server operations
-#export ATLAS_OPTS=
-
-# any additional java opts that you want to set for client only
-#export ATLAS_CLIENT_OPTS=
-
-# java heap size we want to set for the client. Default is 1024MB
-#export ATLAS_CLIENT_HEAP=
-
-# any additional opts you want to set for atlas service.
-#export ATLAS_SERVER_OPTS=
-
-# java heap size we want to set for the atlas server. Default is 1024MB
-#export ATLAS_SERVER_HEAP=
-
-# What is is considered as atlas home dir. Default is the base location of the installed software
-#export ATLAS_HOME_DIR=
-
-# Where log files are stored. Defatult is logs directory under the base install location
-#export ATLAS_LOG_DIR=
-
-# Where pid files are stored. Defatult is logs directory under the base install location
-#export ATLAS_PID_DIR=
-
-# Where do you want to expand the war file. By Default it is in /server/webapp dir under the base install dir.
-#export ATLAS_EXPANDED_WEBAPP_DIR=
-</pre></div>
-<p><b>Settings to support large number of metadata objects</b></p>
-<p>If you plan to store large number of metadata objects, it is recommended that you use values tuned for better GC performance of the JVM.</p>
-<p>The following values are common server side options:</p>
-<div class="source"><pre class="prettyprint">
-export ATLAS_SERVER_OPTS="-server -XX:SoftRefLRUPolicyMSPerMB=0 -XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:+PrintTenuringDistribution -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=dumps/atlas_server.hprof -Xloggc:logs/gc-worker.log -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1m -XX:+PrintGCDetails -XX:+PrintHeapAtGC -XX:+PrintGCTimeStamps"
-</pre></div>
-<p>The <tt>-XX:SoftRefLRUPolicyMSPerMB</tt> option was found to be particularly helpful to regulate GC performance for query heavy workloads with many concurrent users.</p>
-<p>The following values are recommended for JDK 8:</p>
-<div class="source"><pre class="prettyprint">
-export ATLAS_SERVER_HEAP="-Xms15360m -Xmx15360m -XX:MaxNewSize=5120m -XX:MetaspaceSize=100M -XX:MaxMetaspaceSize=512m"
-</pre></div>
-<p><b>NOTE for Mac OS users</b> If you are using a Mac OS, you will need to configure the ATLAS_SERVER_OPTS (explained above).</p>
-<p>In <i>{package dir}/conf/atlas-env.sh</i> uncomment the following line</p>
-<div class="source"><pre class="prettyprint">
-#export ATLAS_SERVER_OPTS=
-</pre></div>
-<p>and change it to look as below</p>
-<div class="source"><pre class="prettyprint">
-export ATLAS_SERVER_OPTS="-Djava.awt.headless=true -Djava.security.krb5.realm= -Djava.security.krb5.kdc="
-</pre></div>
-<p><b>Configuring Apache HBase as the storage backend for the Graph Repository</b></p>
-<p>By default, Apache Atlas uses <a href="./JanusGraph.html">JanusGraph</a> as the graph repository and is the only graph repository implementation available currently. Apache HBase versions currently supported are 1.1.x. For configuring Apache Atlas graph persistence on Apache HBase, please see "Graph persistence engine - HBase" in the <a href="./Configuration.html">Configuration</a> section for more details.</p>
-<p>Apache HBase tables used by Apache Atlas can be set using the following configurations:</p>
-<div class="source"><pre class="prettyprint">
-atlas.graph.storage.hbase.table=atlas
-atlas.audit.hbase.tablename=apache_atlas_entity_audit
-</pre></div>
-<p><b>Configuring Apache Solr as the indexing backend for the Graph Repository</b></p>
-<p>By default, Apache Atlas uses <a href="./JanusGraph.html">JanusGraph</a> as the graph repository and is the only graph repository implementation available currently. For configuring <a href="./JanusGraph.html">JanusGraph</a> to work with Apache Solr, please follow the instructions below</p>
-<p></p>
-<ul>
-<li>Install Apache Solr if not already running. The version of Apache Solr supported is 5.5.1. Could be installed from <a class="externalLink" href="http://archive.apache.org/dist/lucene/solr/5.5.1/solr-5.5.1.tgz">http://archive.apache.org/dist/lucene/solr/5.5.1/solr-5.5.1.tgz</a></li></ul>
-<p></p>
-<ul>
-<li>Start Apache Solr in cloud mode.</li></ul>SolrCloud mode uses a ZooKeeper Service as a highly available, central location for cluster management. For a small cluster, running with an existing ZooKeeper quorum should be fine. For larger clusters, you would want to run separate multiple ZooKeeper quorum with at least 3 servers. Note: Apache Atlas currently supports Apache Solr in "cloud" mode only. "http" mode is not supported. For more information, refer Apache [...]
-<p></p>
-<ul>
-<li>For e.g., to bring up an Apache Solr node listening on port 8983 on a machine, you can use the command:</li></ul>
-<div class="source"><pre class="prettyprint">
- $SOLR_HOME/bin/solr start -c -z <zookeeper_host:port> -p 8983
-</pre></div>
-<p></p>
-<ul>
-<li>Run the following commands from SOLR_BIN (e.g. $SOLR_HOME/bin) directory to create collections in Apache Solr corresponding to the indexes that Apache Atlas uses. In the case that the Apache Atlas and Apache Solr instances are on 2 different hosts, first copy the required configuration files from ATLAS_HOME/conf/solr on the Apache Atlas instance host to Apache Solr instance host. SOLR_CONF in the below mentioned commands refer to the directory where Apache Solr configuration files ha [...]
-<div class="source"><pre class="prettyprint">
- $SOLR_BIN/solr create -c vertex_index -d SOLR_CONF -shards #numShards -replicationFactor #replicationFactor
- $SOLR_BIN/solr create -c edge_index -d SOLR_CONF -shards #numShards -replicationFactor #replicationFactor
- $SOLR_BIN/solr create -c fulltext_index -d SOLR_CONF -shards #numShards -replicationFactor #replicationFactor
-</pre></div>
-<p>Note: If numShards and replicationFactor are not specified, they default to 1 which suffices if you are trying out solr with ATLAS on a single node instance. Otherwise specify numShards according to the number of hosts that are in the Solr cluster and the maxShardsPerNode configuration. The number of shards cannot exceed the total number of Solr nodes in your !SolrCloud cluster.</p>
-<p>The number of replicas (replicationFactor) can be set according to the redundancy required.</p>
-<p>Also note that Apache Solr will automatically be called to create the indexes when Apache Atlas server is started if the SOLR_BIN and SOLR_CONF environment variables are set and the search indexing backend is set to 'solr5'.</p>
-<p></p>
-<ul>
-<li>Change ATLAS configuration to point to Apache Solr instance setup. Please make sure the following configurations are set to the below values in ATLAS_HOME/conf/atlas-application.properties</li></ul>
-<div class="source"><pre class="prettyprint">
- atlas.graph.index.search.backend=solr
- atlas.graph.index.search.solr.mode=cloud
- atlas.graph.index.search.solr.zookeeper-url=<the ZK quorum setup for solr as comma separated value> eg: 10.1.6.4:2181,10.1.6.5:2181
- atlas.graph.index.search.solr.zookeeper-connect-timeout=<SolrCloud Zookeeper Connection Timeout>. Default value is 60000 ms
- atlas.graph.index.search.solr.zookeeper-session-timeout=<SolrCloud Zookeeper Session Timeout>. Default value is 60000 ms
-</pre></div>
-<p>For more information on <a href="./JanusGraph.html">JanusGraph</a> solr configuration , please refer <a class="externalLink" href="http://docs.janusgraph.org/0.2.0/solr.html">http://docs.janusgraph.org/0.2.0/solr.html</a></p>
-<p>Pre-requisites for running Apache Solr in cloud mode * Memory - Apache Solr is both memory and CPU intensive. Make sure the server running Apache Solr has adequate memory, CPU and disk. Apache Solr works well with 32GB RAM. Plan to provide as much memory as possible to Apache Solr process * Disk - If the number of entities that need to be stored are large, plan to have at least 500 GB free space in the volume where Apache Solr is going to store the index data * SolrCloud has [...]
-<p><b>Configuring Elasticsearch as the indexing backend for the Graph Repository (Tech Preview)</b></p>
-<p>By default, Apache Atlas uses <a href="./JanusGraph.html">JanusGraph</a> as the graph repository and is the only graph repository implementation available currently. For configuring <a href="./JanusGraph.html">JanusGraph</a> to work with Elasticsearch, please follow the instructions below</p>
-<p></p>
-<ul>
-<li>Install an Elasticsearch cluster. The version currently supported is 5.6.4, and can be acquired from: <a class="externalLink" href="https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.6.4.tar.gz">https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.6.4.tar.gz</a></li></ul>
-<p></p>
-<ul>
-<li>For simple testing a single Elasticsearch node can be started by using the 'elasticsearch' command in the bin directory of the Elasticsearch distribution.</li></ul>
-<p></p>
-<ul>
-<li>Change Apache Atlas configuration to point to the Elasticsearch instance setup. Please make sure the following configurations are set to the below values in ATLAS_HOME/conf/atlas-application.properties</li></ul>
-<div class="source"><pre class="prettyprint">
- atlas.graph.index.search.backend=elasticsearch
- atlas.graph.index.search.hostname=<the hostname(s) of the Elasticsearch master nodes comma separated>
- atlas.graph.index.search.elasticsearch.client-only=true
-</pre></div>
-<p>For more information on <a href="./JanusGraph.html">JanusGraph</a> configuration for elasticsearch, please refer <a class="externalLink" href="http://docs.janusgraph.org/0.2.0/elasticsearch.html">http://docs.janusgraph.org/0.2.0/elasticsearch.html</a></p>
-<p><b>Configuring Kafka Topics</b></p>
-<p>Apache Atlas uses Apache Kafka to ingest metadata from other components at runtime. This is described in the <a href="./Architecture.html">Architecture page</a> in more detail. Depending on the configuration of Apache Kafka, sometimes you might need to setup the topics explicitly before using Apache Atlas. To do so, Apache Atlas provides a script <tt>bin/atlas_kafka_setup.py</tt> which can be run from Apache Atlas server. In some environments, the hooks might start getting used first [...]
-<div class="section">
-<h5><a name="Setting_up_Apache_Atlas"></a>Setting up Apache Atlas</h5>
-<p>There are a few steps that setup dependencies of Apache Atlas. One such example is setting up the <a href="./JanusGraph.html">JanusGraph</a> schema in the storage backend of choice. In a simple single server setup, these are automatically setup with default configuration when the server first accesses these dependencies.</p>
-<p>However, there are scenarios when we may want to run setup steps explicitly as one time operations. For example, in a multiple server scenario using <a href="./HighAvailability.html">High Availability</a>, it is preferable to run setup steps from one of the server instances the first time, and then start the services.</p>
-<p>To run these steps one time, execute the command <tt>bin/atlas_start.py -setup</tt> from a single Apache Atlas server instance.</p>
-<p>However, Apache Atlas server does take care of parallel executions of the setup steps. Also, running the setup steps multiple times is idempotent. Therefore, if one chooses to run the setup steps as part of server startup, for convenience, then they should enable the configuration option <tt>atlas.server.run.setup.on.start</tt> by defining it with the value <tt>true</tt> in the <tt>atlas-application.properties</tt> file.</p></div>
-<div class="section">
-<h4><a name="Examples:_calling_Apache_Atlas_REST_APIs"></a>Examples: calling Apache Atlas REST APIs</h4>
-<p>Here are few examples of calling Apache Atlas REST APIs via curl command.</p>
-<ul>
-<li>List the types in the repository</li></ul>
-<div class="source"><pre class="prettyprint">
- curl -u username:password http://localhost:21000/api/atlas/v2/types/typedefs/headers
- [ {"guid":"fa421be8-c21b-4cf8-a226-fdde559ad598","name":"Referenceable","category":"ENTITY"},
- {"guid":"7f3f5712-521d-450d-9bb2-ba996b6f2a4e","name":"Asset","category":"ENTITY"},
- {"guid":"84b02fa0-e2f4-4cc4-8b24-d2371cd00375","name":"DataSet","category":"ENTITY"},
- {"guid":"f93975d5-5a5c-41da-ad9d-eb7c4f91a093","name":"Process","category":"ENTITY"},
- {"guid":"79dcd1f9-f350-4f7b-b706-5bab416f8206","name":"Infrastructure","category":"ENTITY"}
- ]
-</pre></div>
-<p></p>
-<ul>
-<li>List the instances for a given type</li></ul>
-<div class="source"><pre class="prettyprint">
- curl -u username:password http://localhost:21000/api/atlas/v2/search/basic?typeName=hive_db
- {
- "queryType":"BASIC",
- "searchParameters":{
- "typeName":"hive_db",
- "excludeDeletedEntities":false,
- "includeClassificationAttributes":false,
- "includeSubTypes":true,
- "includeSubClassifications":true,
- "limit":100,
- "offset":0
- },
- "entities":[
- {
- "typeName":"hive_db",
- "guid":"5d900c19-094d-4681-8a86-4eb1d6ffbe89",
- "status":"ACTIVE",
- "displayText":"default",
- "classificationNames":[],
- "attributes":{
- "owner":"public",
- "createTime":null,
- "qualifiedName":"default@cl1",
- "name":"default",
- "description":"Default Hive database"
- }
- },
- {
- "typeName":"hive_db",
- "guid":"3a0b14b0-ab85-4b65-89f2-e418f3f7f77c",
- "status":"ACTIVE",
- "displayText":"finance",
- "classificationNames":[],
- "attributes":{
- "owner":"hive",
- "createTime":null,
- "qualifiedName":"finance@cl1",
- "name":"finance",
- "description":null
- }
- }
- ]
- }
-</pre></div>
-<p></p>
-<ul>
-<li>Search for entities</li></ul>
-<div class="source"><pre class="prettyprint">
- curl -u username:password http://localhost:21000/api/atlas/v2/search/dsl?query=hive_db%20where%20name='default'
- {
- "queryType":"DSL",
- "queryText":"hive_db where name='default'",
- "entities":[
- {
- "typeName":"hive_db",
- "guid":"5d900c19-094d-4681-8a86-4eb1d6ffbe89",
- "status":"ACTIVE",
- "displayText":"default",
- "classificationNames":[],
- "attributes":{
- "owner":"public",
- "createTime":null,
- "qualifiedName":"default@cl1",
- "name":"default",
- "description":
- "Default Hive database"
- }
- }
- ]
- }
-</pre></div></div>
-<div class="section">
-<h4><a name="Troubleshooting"></a>Troubleshooting</h4></div>
-<div class="section">
-<h5><a name="Setup_issues"></a>Setup issues</h5>
-<p>If the setup of Apache Atlas service fails due to any reason, the next run of setup (either by an explicit invocation of <tt>atlas_start.py -setup</tt> or by enabling the configuration option <tt>atlas.server.run.setup.on.start</tt>) will fail with a message such as <tt>A previous setup run may not have completed cleanly.</tt>. In such cases, you would need to manually ensure the setup can run and delete the Zookeeper node at <tt>/apache_atlas/setup_in_progress</tt> before attempting [...]
-<p>If the setup failed due to Apache HBase schema setup errors, it may be necessary to repair Apache HBase schema. If no data has been stored, one can also disable and drop the Apache HBase tables used by Apache Atlas and run setup again.</p></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Migration-0.8-to-1.0.html b/Migration-0.8-to-1.0.html
deleted file mode 100644
index 4e53ff8..0000000
--- a/Migration-0.8-to-1.0.html
+++ /dev/null
@@ -1,259 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Migration-0.8-to-1.0.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Migrating data from Apache Atlas 0.8 to Apache Atlas 1.0</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Migrating data from Apache Atlas 0.8 to Apache Atlas 1.0</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Migrating_data_from_Apache_Atlas_0.8_to_Apache_Atlas_1.0"></a>Migrating data from Apache Atlas 0.8 to Apache Atlas 1.0</h2>
-<p>Apache Atlas 1.0 uses JanusGraph graph database to store its type and entity details. Prior versions of Apache Atlas use Titan 0.5.4 graph database. The two databases use different formats for storage. For deployments upgrading from earlier version Apache Atlas, the data in Titan 0.5.4 graph database should be migrated to JanusGraph graph database.</p>
-<p>In addition to the change to the graph database, Apache Atlas 1.0 introduces few optimizations that require different internal representation compared to previous versions. Migration steps detailed below will transform data to be compliant with the new internal representation.</p></div>
-<div class="section">
-<h4><a name="Migration_Steps"></a>Migration Steps</h4>
-<p>Migration of data is done in following steps:</p>
-<ul>
-<li>Planning the migration.</li>
-<li>Export Apache Atlas 0.8 data to a directory on the file system.</li>
-<li>Import data from exported files into Apache Atlas 1.0.</li></ul></div>
-<div class="section">
-<h5><a name="Planning_the_migration"></a>Planning the migration</h5>
-<p>The duration of migration of data from Apache Atlas 0.8 to Apache Atlas 1.0 can be significant, depending upon the amount of data present in Apache Atlas. This section helps you to estimate the time to migrate, so that you can plan the upgrade process better.</p>
-<p>To estimate the time needed to export data, first you need to find the number of entities in Apache Atlas 0.8. This can be done by running the following DSL query:</p>
-<div class="source"><pre class="prettyprint">
-Referenceable select count()
-
-</pre></div>
-<p>Assuming Apache Atlas is deployed in a quad-core CPU with 4 GB of RAM allocated:</p>
-<ul>
-<li>Export from Apache Atlas 0.8 will process approximately 2 million entities per hour.</li>
-<li>Import into Apache Atlas 1.0 will process approximately 0.7 million entities per hour.</li></ul></div>
-<div class="section">
-<h5><a name="Exporting_data_from_Apache_Atlas_0.8"></a>Exporting data from Apache Atlas 0.8</h5>
-<p><i>Atlas Migration Export Utility</i> from Apache Atlas branch-0.8 should be used to export the data from Apache Atlas 0.8 deployments. The implementation of which can be found <a class="externalLink" href="https://github.com/apache/atlas/tree/branch-0.8/tools/atlas-migration-exporter">here</a>.</p>
-<p>To build this utility:</p>
-<ul>
-<li>Navigate to root directory of Apache Atlas branch-0.8 local repo (say, <i>/home/atlas/</i>)</li>
-<li>Build using the command: <i>mvn clean -DskipTests package -Pdist</i>.</li>
-<li>After successful build, the <i>Atlas Migration Utility</i> can be found in this <i>distro/target</i> directory. (Say, <i>/home/atlas/distro/target/apache-atlas-0.8.3-SNAPSHOT-bin/apache-atlas-0.8.3-SNAPSHOT/tools/migration-exporter</i>)</li></ul>
-<p>Move the <i>Atlas Migration Utility</i> directory to the Apache Atlas 0.8 cluster.</p>
-<p>Follow these steps to export the data:</p>
-<ul>
-<li>Shutdown <i>Apache Atlas 0.8</i>, so that the database is not updated while the migration is in progress.</li>
-<li>Execute the following command to export Apache Atlas data in Titan graph database to the specified directory:</li></ul>
-<div class="source"><pre class="prettyprint">
- atlas_migration_export.py -d <output directory>
-</pre></div>
-<p>Example:</p>
-<div class="source"><pre class="prettyprint">
- /home/atlas-migration-utility/atlas_migration_export.py -d /home/atlas-0.8-data
-
-</pre></div>
-<p>On successful execution, <i>Atlas Migration Utility</i> tool will display messages like these:</p>
-<div class="source"><pre class="prettyprint">
-atlas-migration-export: starting migration export. Log file location /var/log/atlas/atlas-migration-exporter.log
-atlas-migration-export: initializing
-atlas-migration-export: initialized
-atlas-migration-export: exporting typesDef to file /home/atlas-0.8-data/atlas-migration-typesdef.json
-atlas-migration-export: exported typesDef to file /home/atlas-0.8-data/atlas-migration-typesdef.json
-atlas-migration-export: exporting data to file /home/atlas-0.8-data/atlas-migration-data.json
-atlas-migration-export: exported data to file /home/atlas-0.8-data/atlas-migration-data.json
-atlas-migration-export: completed migration export!
-
-</pre></div>
-<p>More details on the progress of export can be found in a log file named <i>atlas-migration-exporter.log</i>, in the log directory specified in <i>atlas-log4j.xml</i>.</p></div>
-<div class="section">
-<h4><a name="Before_importing_into_Apache_Atlas_1.0"></a>Before importing into Apache Atlas 1.0</h4>
-<p></p>
-<ul>
-<li>For Apache Atlas deployments that use Solr as index store, please ensure that existing Apache Atlas specific collections are deleted or renamed before installing Apache Atlas 1.0.</li></ul>
-<p>Apache Atlas specific Solr collections can be deleted using CURL commands shown below:</p>
-<div class="source"><pre class="prettyprint">
-curl 'http://<solrHost:port>/solr/admin/collections?action=DELETE&name=vertex_index'
-curl 'http://<solrHost:port>/solr/admin/collections?action=DELETE&name=edge_index'
-curl 'http://<solrHost:port>/solr/admin/collections?action=DELETE&name=fulltext_index'
-</pre></div>
-<p></p>
-<ul>
-<li>Create Solr collections for Apache Atlas 1.0</li></ul>Apache Atlas specific Solr collections can be created using CURL commands shown below:
-<div class="source"><pre class="prettyprint">
-curl 'http://<solrHost:port>/solr/admin/collections?action=CREATE&name=vertex_index&numShards=1&replicationFactor=1&collection.configName=atlas_configs'
-curl 'http://<solrHost:port>/solr/admin/collections?action=CREATE&name=edge_index&numShards=1&replicationFactor=1&collection.configName=atlas_configs'
-curl 'http://<solrHost:port>/solr/admin/collections?action=CREATE&name=fulltext_index&numShards=1&replicationFactor=1&collection.configName=atlas_configs'
-</pre></div>
-<p></p>
-<ul>
-<li>For Apache Atlas deployments that use HBase as backend store, please note that HBase table used by earlier version can't be used by Apache Atlas 1.0. If you are constrained on disk storage space, the table used by earlier version can be removed after successful export of data.
-<ul>
-<li>Apache Atlas 0.8 uses HBase table named 'atlas_titan' (by default)</li>
-<li>Apache Atlas 1.0 uses HBase table named 'atlas_janus' (by default)</li></ul></li></ul>
-<p></p>
-<ul>
-<li>Install Apache Atlas 1.0. Do not start yet!</li></ul>
-<p></p>
-<ul>
-<li>Make sure the directory containing exported data is accessible to Apache Atlas 1.0 instance.</li></ul></div>
-<div class="section">
-<h5><a name="Importing_Data_into_Apache_Atlas_1.0"></a>Importing Data into Apache Atlas 1.0</h5>
-<p>Please follow the steps below to import the data exported above into Apache Atlas 1.0:</p>
-<ul>
-<li>Specify the location of the directory containing exported data in following property to <i>atlas-application.properties</i>:</li></ul>
-<div class="source"><pre class="prettyprint">
-atlas.migration.data.filename=<location of the directory containing exported data>
-</pre></div>
-<p></p>
-<ul>
-<li>Start Apache Atlas 1.0. Apache Atlas will start in migration mode. It will start importing data from the specified directory.</li></ul>
-<p></p>
-<ul>
-<li>Monitor the progress of import process with the following curl command:</li></ul>
-<div class="source"><pre class="prettyprint">
-curl -X GET -u admin:<password> -H "Content-Type: application/json" -H "Cache-Control: no-cache" http://<atlasHost>:port/api/atlas/admin/status
-</pre></div>
-<p>Progress of import will be indicated by a message like this:</p>
-<div class="source"><pre class="prettyprint">
-{"Status":"MIGRATING","MigrationStatus":{"operationStatus":"IN_PROGRESS","startTime":1526512275110,"endTime":1526512302750,"currentIndex":10,"currentCounter":101,"totalCount":0}}
-
-</pre></div>
-<p>Successful completion of the operation will show a message like this:</p>
-<div class="source"><pre class="prettyprint">
-{"Status":"MIGRATING","MigrationStatus":{"operationStatus":"SUCCESS","startTime":1526512275110,"endTime":1526512302750,"currentIndex":0,"currentCounter":0,"totalCount":371}}
-
-</pre></div>
-<p>Once migration import is complete, i.e. <i>operationStatus</i> is <i>SUCCESS</i>, follow the steps given below to restart Apache Atlas in <i>ACTIVE</i> mode for regular use:</p>
-<ul>
-<li>Stop Apache Atlas 1.0.</li>
-<li>Remove property <i>atlas.migration.data.filename</i> from <i>atlas-application.properties</i>.</li>
-<li>Start Apache Atlas 1.0.</li></ul></div>
-<div class="section">
-<h4><a name="Atlas_Entity_Defaults_for_Migrated_Data"></a>Atlas Entity Defaults for Migrated Data</h4>
-<p>Apache Atlas 1.0 introduces number of new features. For data that is migrated, the following defaults are set:</p>
-<ul>
-<li>All classifications will have <i>isPropagate</i> set to <i>false</i>.</li>
-<li>Taxonomy terms present in Apache Atlas 0.8, if any, will be converted to classification.</li></ul></div>
-<div class="section">
-<h5><a name="Handling_of_Entity_Definitions_that_use_Classifications_as_Types"></a>Handling of Entity Definitions that use Classifications as Types</h5>
-<p>This features is no longer supported. Classifications that are used as types in <i>attribute definitions</i> (<i><a href="./AttributeDefs.html">AttributeDefs</a></i>) are converted in to new types whose name has <i>legacy</i> prefix. These are then handled like any other type. Creation of such types was prevented in an earlier release, hence only type definitions have potential to exist. Care has been taken to handle entities of this type as well.</p></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Notifications.html b/Notifications.html
deleted file mode 100644
index 98138a3..0000000
--- a/Notifications.html
+++ /dev/null
@@ -1,193 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Notifications.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Notifications</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Notifications</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Notifications"></a>Notifications</h2></div>
-<div class="section">
-<h3><a name="Notifications_from_Apache_Atlas"></a>Notifications from Apache Atlas</h3>
-<p>Apache Atlas sends notifications about metadata changes to Kafka topic named ATLAS_ENTITIES . Applications interested in metadata changes can monitor for these notifications. For example, Apache Ranger processes these notifications to authorize data access based on classifications.</p></div>
-<div class="section">
-<h4><a name="Notifications_-_V2:_Apache_Atlas_version_1.0"></a>Notifications - V2: Apache Atlas version 1.0</h4>
-<p>Apache Atlas 1.0 sends notifications for following operations on metadata.</p>
-<div class="source"><pre class="prettyprint">
- ENTITY_CREATE: sent when an entity instance is created
- ENTITY_UPDATE: sent when an entity instance is updated
- ENTITY_DELETE: sent when an entity instance is deleted
- CLASSIFICATION_ADD: sent when classifications are added to an entity instance
- CLASSIFICATION_UPDATE: sent when classifications of an entity instance are updated
- CLASSIFICATION_DELETE: sent when classifications are removed from an entity instance
-
-</pre></div>
-<p>Notification includes the following data.</p>
-<div class="source"><pre class="prettyprint">
- AtlasEntity entity;
- OperationType operationType;
- List<AtlasClassification> classifications;
-
-</pre></div></div>
-<div class="section">
-<h4><a name="Notifications_-_V1:_Apache_Atlas_version_0.8.x_and_earlier"></a>Notifications - V1: Apache Atlas version 0.8.x and earlier</h4>
-<p>Notifications from Apache Atlas version 0.8.x and earlier have content formatted differently, as detailed below.</p>
-<p><b><i>Operations</i></b></p>
-<div class="source"><pre class="prettyprint">
- ENTITY_CREATE: sent when an entity instance is created
- ENTITY_UPDATE: sent when an entity instance is updated
- ENTITY_DELETE: sent when an entity instance is deleted
- TRAIT_ADD: sent when classifications are added to an entity instance
- TRAIT_UPDATE: sent when classifications of an entity instance are updated
- TRAIT_DELETE: sent when classifications are removed from an entity instance
-
-</pre></div>
-<p>Notification includes the following data.</p>
-<div class="source"><pre class="prettyprint">
- Referenceable entity;
- OperationType operationType;
- List<Struct> traits;
-
-</pre></div>
-<p>Apache Atlas 1.0 can be configured to send notifications in older version format, instead of the latest version format. This can be helpful in deployments that are not yet ready to process notifications in latest version format. To configure Apache Atlas 1.0 to send notifications in earlier version format, please set following configuration in atlas-application.properties:</p>
-<div class="source"><pre class="prettyprint">
- atlas.notification.entity.version=v1
-
-</pre></div></div>
-<div class="section">
-<h3><a name="Notifications_to_Apache_Atlas"></a>Notifications to Apache Atlas</h3>
-<p>Apache Atlas can be notified of metadata changes and lineage via notifications to Kafka topic named ATLAS_HOOK. Atlas hooks for Apache Hive/Apache HBase/Apache Storm/Apache Sqoop use this mechanism to notify Apache Atlas of events of interest.</p>
-<div class="source"><pre class="prettyprint">
-ENTITY_CREATE : create an entity. For more details, refer to Java class HookNotificationV1.EntityCreateRequest
-ENTITY_FULL_UPDATE : update an entity. For more details, refer to Java class HookNotificationV1.EntityUpdateRequest
-ENTITY_PARTIAL_UPDATE : update specific attributes of an entity. For more details, refer to HookNotificationV1.EntityPartialUpdateRequest
-ENTITY_DELETE : delete an entity. For more details, refer to Java class HookNotificationV1.EntityDeleteRequest
-ENTITY_CREATE_V2 : create an entity. For more details, refer to Java class HookNotification.EntityCreateRequestV2
-ENTITY_FULL_UPDATE_V2 : update an entity. For more details, refer to Java class HookNotification.EntityUpdateRequestV2
-ENTITY_PARTIAL_UPDATE_V2 : update specific attributes of an entity. For more details, refer to HookNotification.EntityPartialUpdateRequestV2
-ENTITY_DELETE_V2 : delete one or more entities. For more details, refer to Java class HookNotification.EntityDeleteRequestV2
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/QuickStart.html b/QuickStart.html
deleted file mode 100644
index d768b46..0000000
--- a/QuickStart.html
+++ /dev/null
@@ -1,153 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/QuickStart.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Quick Start</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Quick Start</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Quick_Start"></a>Quick Start</h2></div>
-<div class="section">
-<h3><a name="Introduction"></a>Introduction</h3>
-<p>Quick start is a simple client that adds a few sample type definitions modeled after the example shown below. It also adds sample entities along with traits as shown in the instance graph below.</p></div>
-<div class="section">
-<h4><a name="Example_Type_Definitions"></a>Example Type Definitions</h4>
-<p><img src="images/twiki/guide-class-diagram.png" alt="" /></p></div>
-<div class="section">
-<h4><a name="Example_Instance_Graph"></a>Example Instance Graph</h4>
-<p><img src="images/twiki/guide-instance-graph.png" alt="" /></p></div>
-<div class="section">
-<h3><a name="Running_the_example"></a>Running the example</h3>
-<p>This will add sample types and instances along with traits as shown in the instance graph above.</p>
-<p></p>
-<ul>
-<li>bin/quick-start.sh</li></ul></div>
-<div class="section">
-<h3><a name="Dashboard"></a>Dashboard</h3>
-<p>A simple dashboard with search is available.</p>
-<p></p>
-<ul>
-<li><a class="externalLink" href="http://localhost:21000/">http://localhost:21000/</a></li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/ReplicatedToFromAttributes.html b/ReplicatedToFromAttributes.html
deleted file mode 100644
index 64f0c47..0000000
--- a/ReplicatedToFromAttributes.html
+++ /dev/null
@@ -1,137 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/ReplicatedToFromAttributes.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Replicated Attributes</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Replicated Attributes</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<h1>Replicated Attributes</h1>
-<div class="section">
-<div class="section">
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>Users want knowledge of how the entities have landed into Atlas instance, if they were created via hook ingestion or whether they were imported from another Atlas instance.</p>
-<p>This is addressed by 2 new attributes that are now part of <i>Referenceable</i> entity type viz. <i>replicatedFrom</i> and <i>replicatedTo</i>.</p></div></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Search-Advanced.html b/Search-Advanced.html
deleted file mode 100644
index 08f7dec..0000000
--- a/Search-Advanced.html
+++ /dev/null
@@ -1,499 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Search-Advanced.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Advanced Search</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Advanced Search</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Advanced_Search"></a>Advanced Search</h2></div>
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>Advanced Search in Atlas is also referred to as DSL-based Search.</p>
-<p>Domain Specific Search (DSL) is a language with simple constructs that help users navigate Atlas data repository. The syntax loosely emulates the popular Structured Query Language (SQL) from relation database world.</p>
-<p>Benefits of DSL:</p>
-<ul>
-<li>Abstracts the implementation-level database constructs. This avoids the necessity of knowing about the underlying graph database constructs.</li>
-<li>User are provided with an abstraction that helps them retrieve the data by just being aware of the types and their relationships within their dataset.</li>
-<li>Allows for a way to specify the desired output.</li>
-<li>Use of classifications is accounted for in the syntax.</li>
-<li>Provides way to group and aggregate results.</li></ul>
-<p>We will be using the quick start dataset in the examples that follow. This dataset is comprehensive enough to be used to to demonstrate the various features of the language.</p>
-<p>For details on the grammar, please refer to Atlas DSL Grammer on <a class="externalLink" href="https://github.com/apache/atlas/blob/master/repository/src/main/java/org/apache/atlas/query/antlr4/AtlasDSLParser.g4">Github</a> (Antlr G4 format).</p></div>
-<div class="section">
-<h3><a name="Using_Advanced_Search"></a>Using Advanced Search</h3>
-<p>Within the Atlas UI, select Advanced in the Search pane on the left.</p>
-<p>Notice that the <i>Favorite Searches</i> pane below the <i>Search By Query</i> box. Like <i>Basic Search</i>, it is possible to save the <i>Advanced Searches</i> as well.</p></div>
-<div class="section">
-<h3><a name="Introduction_to_Domain_Specific_Language"></a>Introduction to Domain Specific Language</h3>
-<p>DSL uses the familiar SQL-like syntax.</p>
-<p>At a high-level a query has a <i>from-where-select</i> format. Additional keywords like <i>grouby</i>, <i>orderby</i>, <i>limit</i> can be used to added to affect the output. We will see examples of these below.</p></div>
-<div class="section">
-<h4><a name="From_Clause"></a>From Clause</h4>
-<p>Specifying the <i>from</i> clause is mandatory. Using the <i>from</i> keyword itself is optional. The value specified in the <i>from</i> clause acts as the source or starting point for the rest of the query to source its inputs.</p>
-<p>Example: To retrieve all entities of type <i>DB</i>:</p>
-<div class="source"><pre class="prettyprint">
-DB
-from DB
-</pre></div>
-<p>In the absence of <i>where</i> for filtering on the source, the dataset fetched by the <i>from</i> clause is everything from the database. Based on the size of the data present in the database, there is a potential to overwhelm the server. The query processor thus adds <i>limit</i> clause with a default value set. See the section on <i>limit</i> clause for details.</p></div>
-<div class="section">
-<h4><a name="Where_Clause"></a>Where Clause</h4>
-<p>The <i>where</i> clause allows for filtering over the dataset. This achieved by using conditions within the where clause.</p>
-<p>A conditions is identifier followed by an operator followed by a literal. Literal must be enclosed in single or double quotes. Example, <i>name = "Sales"</i>. An identifier can be name of the property of the type specified in the <i>from</i> clause or an alias.</p>
-<p>Example: To retrieve entity of type <i>Table</i> with a specific name say time_dim:</p>
-<div class="source"><pre class="prettyprint">
-from Table where name = 'time_dim'
-</pre></div>
-<p>It is possible to specify multiple conditions by combining them using <i>and</i>, <i>or</i> operators.</p>
-<p>Example: To retrieve entity of type Table with name that can be either time_dim or customer_dim:</p>
-<div class="source"><pre class="prettyprint">
-from Table where name = 'time_dim' or name = 'customer_dim'
-</pre></div>
-<p>Filtering based on a list of values is done using by specifying the values in the square brackets. A value array is a list of values enclosed within square brackets. This is a simple way to specify an OR clause on an identifier.</p>
-<p>Note that having several OR clauses on the same attribute may be inefficient. Alternate way is to use the value array as shown in the example below.</p>
-<p>Example: The query in the example above can be written using a value array as shown below.</p>
-<div class="source"><pre class="prettyprint">
-from Table where name = ["customer_dim", "time_dim"]
-</pre></div>
-<p>A condition that uses the LIKE operator, allows for filtering using wildcards like '*' or '?'.</p>
-<p>Example: To retrieve entity of type <i>Table</i> whose name ends with '_dim':</p>
-<div class="source"><pre class="prettyprint">
-from Table where name LIKE '*_dim'
-</pre></div>
-<p>Additional forms of regular expressions can also be used.</p>
-<p>Example: To retrieve <i>DB</i> whose name starts with <i>R</i> followed by has any 3 characters, followed by <i>rt</i> followed by at least 1 character, followed by none or any number of characters.</p>
-<div class="source"><pre class="prettyprint">
-DB where name like "R???rt?*"
-</pre></div></div>
-<div class="section">
-<h5><a name="Using_Date_Literals"></a>Using Date Literals</h5>
-<p>Dates used in literals need to be specified using the ISO 8601 format.</p>
-<p>Dates in this format follow this notation:</p>
-<ul>
-<li><i>yyyy-MM-ddTHH:mm:ss.SSSZ</i>. Which means, year-month-day followed by time in hour-minutes-seconds-milli-seconds. Date and time need to be separated by 'T'. It should end with 'Z'.</li>
-<li><i>yyyy-MM-dd</i>. Which means, year-month-day.</li></ul>
-<p>Example: Date represents December 11, 2017 at 2:35 AM.</p>
-<div class="source"><pre class="prettyprint">2017-12-11T02:35:0.0Z
-</pre></div>
-<p>Example: To retrieve entity of type <i>Table</i> created within 2017 and 2018.</p>
-<div class="source"><pre class="prettyprint">
-from Table where createTime < '2018-01-01' and createTime > '2017-01-01'
-</pre></div></div>
-<div class="section">
-<h5><a name="Using_Boolean_Literals"></a>Using Boolean Literals</h5>
-<p>Properties of entities of type boolean can be used within queries.</p>
-<p>Eample: To retrieve entity of type hdfs_path whose attribute <i>isFile</i> is set to <i>true</i> and whose name is <i>Invoice</i>.</p>
-<div class="source"><pre class="prettyprint">
-from hdfs_path where isFile = true or name = "Invoice"
-</pre></div>
-<p>Valid values for boolean literals are 'true' and 'false'.</p></div>
-<div class="section">
-<h4><a name="Existence_of_a_Property"></a>Existence of a Property</h4>
-<p>The has keyword can be used with or without the where clause. It is used to check existence of a property in an entity.</p>
-<p>Example: To retreive entity of type Table with a property locationUri.</p>
-<div class="source"><pre class="prettyprint">
-Table has locationUri
-from Table where Table has locationUri
-
-</pre></div></div>
-<div class="section">
-<h4><a name="Select_Clause"></a>Select Clause</h4>
-<p>If you noticed the output displayed on the web page, it displays a tabular display, each row corresponding to an entity and columns are properties of that entity. The select clause allows for choosing the properties of entity that are of interest.</p>
-<p>Example: To retrieve entity of type <i>Table</i> with few properties:</p>
-<div class="source"><pre class="prettyprint">
-from Table select owner, name, qualifiedName
-
-</pre></div>
-<p>Example: To retrieve entity of type Table for a specific table with some properties.</p>
-<div class="source"><pre class="prettyprint">
-from Table where name = 'customer_dim' select owner, name, qualifiedName
-</pre></div>
-<p>To display column headers that are more meaningful, aliases can be added using the 'as' clause.</p>
-<p>Example: To display column headers as 'Owner', 'Name' and 'FullName'.</p>
-<div class="source"><pre class="prettyprint">
-from Table select owner as Owner, name as Name, qualifiedName as FullName
-</pre></div></div>
-<div class="section">
-<h5><a name="Note_About_Select_Clauses"></a>Note About Select Clauses</h5>
-<p>Given the complexity involved in using select clauses, these are the few rules to remember when using select clauses:</p>
-<ul>
-<li>Works with all immediate attributes.</li>
-<li>Works with Immediate attributes and aggregation on immediate attributes.</li>
-<li>Referred attributes cannot be mixed with immediate attributes.</li></ul>
-<p>Example: To retrieve entity of type Table with name 'Sales' and display 'name' and 'owner' attribute of the referred entity DB.</p>
-<div class="source"><pre class="prettyprint">
-Table where name = 'abcd' select DB.name, DB.owner
-</pre></div>
-<p>Current implementation does not allow the following:</p>
-<div class="source"><pre class="prettyprint">
-Table where name = 'abcd' select DB.name, Table.name
-</pre></div></div>
-<div class="section">
-<h4><a name="Classification-based_Filtering"></a>Classification-based Filtering</h4>
-<p>In order to retrieve entities based on classification, a query would use <i>is</i> or <i>isa</i> keywords.</p>
-<p>Example: To retrieve all entities of type <i>Table</i> that are tagged with <i>Dimension</i> classification.</p>
-<div class="source"><pre class="prettyprint">
-from Table isa Dimension
-</pre></div>
-<p>Since, from is optional and <i>is</i> (or <i>isa</i>) are equivalent, the following queries yield the same results:</p>
-<div class="source"><pre class="prettyprint">
-Table is Dimension
-</pre></div>
-<p>The <i>is</i> and <i>isa</i> clauses can also be used in <i>where</i> condition like:</p>
-<div class="source"><pre class="prettyprint">
-from Table where Table isa Dimension
-</pre></div>
-<p>To search for all entities having a particular classification, simply use the name of the classification.</p>
-<p>Example: To retrieve all entities that have <i>Dimension</i> classification.</p>
-<div class="source"><pre class="prettyprint">
-Dimension
-</pre></div></div>
-<div class="section">
-<h4><a name="Limit_.26_Offset_Clauses"></a>Limit & Offset Clauses</h4>
-<p>Often a query yields large number of results. To limit the outcome of the query, the limit and offset clauses are used.</p>
-<p>Example: To retrieve only the 5 entities from a result set.</p>
-<div class="source"><pre class="prettyprint">
-Column limit 5
-</pre></div>
-<p>The offset clauses retrieves results after the offset value.</p>
-<p>Example: To retrieve only 5 entities from the result set after skipping the first 10.</p>
-<div class="source"><pre class="prettyprint">
-Column limit 5 offset 10
-</pre></div>
-<p>The <i>limit</i> and <i>offset</i> clauses are usually specified in conjunction.</p>
-<p>If no limit clause is specified in the query, a limit clause with a default limit (usually 100) is added to the query. This prevents the query from inadvertently fetching large number of results.</p>
-<p>The <i>offset</i> clause is useful for displaying results in a user interface where few results from the result set are showing and more results are fetched as the user advances to next page.</p></div>
-<div class="section">
-<h4><a name="Ordering_Results"></a>Ordering Results</h4>
-<p>The <i>orderby</i> clause allows for sorting of results. Results are sorted in ascending order by default. Only immediate attributes can be used within this clause.</p>
-<p>Ordering can be changed by using:</p>
-<ul>
-<li>ASC Sort in ascending order. This is the default. If no ordering is specified after the <i>orderby</i> clause.</li>
-<li>DESC Sort in descending order. This needs to be explicitly specified after the <i>orderby</i> clause.</li></ul>
-<p>Example: To retrieve the entities of type <i>Column</i> that are sorted in ascending order using the name property.</p>
-<div class="source"><pre class="prettyprint">
-from Column orderby name
-from Column orderby name asc
-</pre></div>
-<p>Example: Same results as above except that they are sorted in descending order.</p>
-<div class="source"><pre class="prettyprint">
-from Column orderby name desc
-</pre></div></div>
-<div class="section">
-<h4><a name="Aggregate_Functions"></a>Aggregate Functions</h4>
-<p>Let's look at aggregate functions:</p>
-<p></p>
-<ul>
-<li><i>sum</i>: Adds (sums up) a value of the property specified, within the result set.</li>
-<li><i>min</i>: Finds the minimum value of the property specified, within a result set.</li>
-<li><i>max</i>: Finds the maximum value of the property specified, within a result set.</li>
-<li><i>count</i>: Finds the number of items specified by the group by clause.</li></ul>
-<p>These work only on immediate attributes.</p>
-<p>Other examples of these in the <i>Grouping Results</i> section.</p></div>
-<div class="section">
-<h5><a name="The_count_Keyword"></a>The count Keyword</h5>
-<p>Shows the number of items in a result set.</p>
-<p>Example: To know how may entities of a type Column.</p>
-<div class="source"><pre class="prettyprint">
-Column select count()
-</pre></div>
-<p>Example: Same as above with alias.</p>
-<div class="source"><pre class="prettyprint">
-Column select count() as Cols
-</pre></div>
-<p>Example: To find the number of tables in a database.</p>
-<div class="source"><pre class="prettyprint">
-Table where db.name = "Reporting" select count()
-</pre></div></div>
-<div class="section">
-<h5><a name="The_max_Keyword"></a>The max Keyword</h5>
-<p>Using this keyword it is possible to retrieve the maximum value of a property for an entity.</p>
-<p>Example: Get the most recently created value of the <i>createTime</i> property of the Table entity.</p>
-<div class="source"><pre class="prettyprint">
-Table select max(createTime)
-</pre></div></div>
-<div class="section">
-<h5><a name="The_min_Keyword"></a>The min Keyword</h5>
-<p>Using this keyword it is possible to retrieve the minimum value of a property for an entity.</p>
-<p>Example: Get the least recently created value of the <i>createTime</i> property of the Table entity.</p>
-<div class="source"><pre class="prettyprint">
-Table select min(createTime)
-</pre></div></div>
-<div class="section">
-<h4><a name="Grouping_Results"></a>Grouping Results</h4>
-<p>The <i>groupby</i> clause groups results within the result using specified property.</p>
-<p>Example: To retrieve entity of type Table such that tables belonging to an owner are together (grouped by owner).</p>
-<div class="source"><pre class="prettyprint">
-Table groupby(owner)
-</pre></div>
-<p>While <i>groupby</i> can work without <i>select</i>, if aggregate functions are used within <i>select</i> clause, using <i>groupby</i> clause becomes mandatory as aggregate functions operate on a group.</p>
-<p>Example: To retrieve entity of type Table such we know the most recently created entity.</p>
-<div class="source"><pre class="prettyprint">
-Table groupby(createTime) select owner, name, max(createTime)
-</pre></div>
-<p>Example: To retrieve entity of type Table such we know the oldest entity.</p>
-<div class="source"><pre class="prettyprint">
-Table groupby(createTime) select owner, name, min(createTime)
-</pre></div>
-<p>Example: To know the number of entities owned by each owner.</p>
-<div class="source"><pre class="prettyprint">
-Table groupby(owner) select owner, count()
-</pre></div></div>
-<div class="section">
-<h4><a name="Where_Clause_With_Complex_Types"></a>Where Clause With Complex Types</h4>
-<p>In the discussion so far we looked at where clauses with primitive types. This section will look at using properties that are non-primitive types.</p>
-<p>In this model, the DB is modeled such that it is aware of all the Table it contains. Table on the other hand is aware of existence of the DB but is not aware of all the other <i>Table</i> instances within the system. Each Table maintains reference of the <i>DB</i> it belongs to.</p>
-<p>Similar structure exists within the <i>hive</i> data model.</p>
-<p>Example: To retrieve all the instances of the <i>Table</i> belonging to a database named 'Sales':</p>
-<div class="source"><pre class="prettyprint">
-Table where db.name = "Sales"
-</pre></div>
-<p>The entity Column is modeled in a similar way. Each Table entity has outward edges pointing to Column entity instances corresponding to each column within the table.</p>
-<p>Example: To retrieve all the Column entities for a given Table.</p>
-<div class="source"><pre class="prettyprint">
-Table where name = "time_dim" select columns
-</pre></div>
-<p>The propeties of each <i>Column</i> entity type are displayed.</p></div>
-<div class="section">
-<h4><a name="Using_System_Attributes"></a>Using System Attributes</h4>
-<p>Each type defined within Atlas gets few attributes by default. These attributes help with internal book keeping of the entities. All the system attributes are prefixed with '__' (double underscore). This helps in identifying them from other attributes.</p>
-<p>Following are the system attributes:</p>
-<ul>
-<li>__guid Each entity within Atlas is assigned a globally unique identifier (GUID for short).</li>
-<li>__modifiedBy Name of the user who last modified the entity.</li>
-<li>__createdBy Name of the user who created the entity.</li>
-<li>__state Current state of the entity. Please see below for details.</li>
-<li>__timestamp Timestamp (date represented as integer) of the entity at the time of creation.</li>
-<li>__modificationTimestamp Timestamp (date represented as integer) of the entity at the time of last modification.</li></ul></div>
-<div class="section">
-<h5><a name="State_of_an_Entity"></a>State of an Entity</h5>
-<p>Entity within Atlas can be in the following states:</p>
-<ul>
-<li>ACTIVE This is the state of entities that when it is available and is used within the system. It can be retrieved by default by searches.</li>
-<li>DELETED When an entity is deleted, it's state is marked as DELETED. Entity in this state does not show up in search results. Explicit request needs to be made to retrieve this entity.</li></ul></div>
-<div class="section">
-<h5><a name="Using_System_Attributes_in_Queries"></a>Using System Attributes in Queries</h5>
-<p>Example: To retrieve all entities that are deleted.</p>
-<div class="source"><pre class="prettyprint">
-Asset where __state = "DELETED"
-</pre></div>
-<p>Example: To retrieve entity GUIDs.</p>
-<div class="source"><pre class="prettyprint">
-Table select __guid
-</pre></div>
-<p>Example: To retrieve several system attributes.</p>
-<div class="source"><pre class="prettyprint">
-hive_db select __timestamp, __modificationTimestamp, __state, __createdBy
-</pre></div></div>
-<div class="section">
-<h3><a name="Advanced_Search_REST_API"></a>Advanced Search REST API</h3>
-<p>Relevant models for these operations:</p>
-<ul>
-<li><i><a class="externalLink" href="https://github.com/apache/atlas/blob/master/intg/src/main/java/org/apache/atlas/model/discovery/AtlasSearchResult.java">AtlasSearchResult</a></i></li>
-<li><i><a class="externalLink" href="https://github.com/apache/atlas/blob/master/intg/src/main/java/org/apache/atlas/exception/AtlasBaseException.java">AtlasBaseException</a></i></li></ul></div>
-<div class="section">
-<h4><a name="The_V2_API"></a>The V2 API</h4>
-<p></p>
-<table border="0" class="table table-striped">
-<tr class="a">
-<th>Get Results using DSL Search</th>
-<td></td></tr>
-<tr class="b">
-<td><i>Example</i></td>
-<td>See Examples sections below.</td></tr>
-<tr class="a">
-<td><i>URL</i></td>
-<td><i>api/atlas/v2/search/dsl</i></td></tr>
-<tr class="b">
-<td><i>Method</i></td>
-<td><i>GET</i></td></tr>
-<tr class="a">
-<td><i>URL Parameters</i></td>
-<td><i>query</i>: Query conforming to DSL syntax.</td></tr>
-<tr class="b">
-<td></td>
-<td><i>typeName</i>: Type name of the entity to be retrived.</td></tr>
-<tr class="a">
-<td></td>
-<td><i>classification</i>: Classification associated with the type or query.</td></tr>
-<tr class="b">
-<td></td>
-<td><i>limit</i>: Maximum number of items in the result set.</td></tr>
-<tr class="a">
-<td></td>
-<td><i>offset</i>: Starting index of the item in the result set.</td></tr>
-<tr class="b">
-<td><i>Data Parameters</i></td>
-<td><i>None</i></td></tr>
-<tr class="a">
-<td><i>Success Response</i></td>
-<td>The JSON will correspond to <a class="externalLink" href="https://github.com/apache/atlas/blob/master/intg/src/main/java/org/apache/atlas/model/discovery/AtlasSearchResult.java">AtlasSearchResult</a>.</td></tr>
-<tr class="b">
-<td><i>Error Response</i></td>
-<td>Errors that are handled within the system will be returned as <a class="externalLink" href="https://github.com/apache/atlas/blob/master/intg/src/main/java/org/apache/atlas/exception/AtlasBaseException.java">AtlasBaseException</a>.</td></tr>
-<tr class="a">
-<td><i>Method Signature</i></td>
-<td>@GET</td></tr>
-<tr class="b">
-<td></td>
-<td>@Path("/dsl")</td></tr>
-<tr class="a">
-<td></td>
-<td>@Consumes(Servlets.JSON_MEDIA_TYPE)</td></tr>
-<tr class="b">
-<td></td>
-<td>@Produces(Servlets.JSON_MEDIA_TYPE)</td></tr></table><b>Examples</b>
-<div class="source"><pre class="prettyprint">
-curl -X GET -u admin:admin -H "Content-Type: application/json" "http://localhost:21000/api/atlas/v2/search/dsl?typeName=Table"
-curl -X GET -u admin:admin -H "Content-Type: application/json" "http://localhost:21000/api/atlas/v2/search/dsl?typeName=Column&classification=PII"
-curl -X GET -u admin:admin -H "Content-Type: application/json" "http://localhost:21000/api/atlas/v2/search/dsl?typeName=Table&classification=Dimension&limit=10&offset=2"
-curl -X GET -u admin:admin -H "Content-Type: application/json" "http://localhost:21000/api/atlas/v2/search/dsl?query=Table%20isa%20Dimension"
-curl -X GET -u admin:admin -H "Content-Type: application/json" "http://localhost:21000/api/atlas/v2/search/dsl?query=Table%20isa%20Dimension&limit=5&offset=2"
-</pre></div></div>
-<div class="section">
-<h3><a name="Implementation_Approach"></a>Implementation Approach</h3>
-<p>The general approach followed in implementation of DSL within Atlas can be enumerated in following steps:</p>
-<ul>
-<li>Parser parses the incoming query for syntax.</li>
-<li>Abstract syntax tree is generated by for a query that is parsed successfully.</li>
-<li>Syntax tree is 'walked' using visitor pattern.</li>
-<li>Each 'visit' within the tree adds a step in the Gremlin pipeline.</li>
-<li>When done, the generated script is executed using Gremlin Script Engine.</li>
-<li>Results generated be the query, if any, are processed and packaged in <a href="./AtlasSearchResult.html">AtlasSearchResult</a> structure.</li></ul></div>
-<div class="section">
-<h3><a name="Differences_Between_Master_and_Earlier_Versions"></a>Differences Between Master and Earlier Versions</h3>
-<p>The following clauses are no longer supported:</p>
-<ul>
-<li>path</li>
-<li>loop</li></ul></div>
-<div class="section">
-<h3><a name="Resources"></a>Resources</h3>
-<p></p>
-<ul>
-<li>Antlr <a class="externalLink" href="https://pragprog.com/book/tpantlr2/the-definitive-antlr-4-reference">Book</a>.</li>
-<li>Antlr <a class="externalLink" href="https://github.com/antlr/antlr4/blob/master/doc/getting-started.md">Quick Start</a>.</li>
-<li>Atlas DSL Grammar on <a class="externalLink" href="https://github.com/apache/atlas/blob/master/repository/src/main/java/org/apache/atlas/query/antlr4/AtlasDSLParser.g4">Github</a> (Antlr G4 format).</li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Search-Basic.html b/Search-Basic.html
deleted file mode 100644
index 8cb3dc7..0000000
--- a/Search-Basic.html
+++ /dev/null
@@ -1,285 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Search-Basic.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Basic Search</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Basic Search</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Basic_Search"></a>Basic Search</h2>
-<p>The basic search allows you to query using typename of an entity, associated classification/tag and has support for filtering on the entity attribute(s) as well as the classification/tag attributes.</p>
-<p>The entire query structure can be represented using the following JSON structure (called SearchParameters)</p>
-<div class="source"><pre class="prettyprint">
-{
- "typeName": "hive_column",
- "excludeDeletedEntities": true,
- "classification": "PII",
- "query": "",
- "offset": 0,
- "limit": 25,
- "entityFilters": { },
- "tagFilters": { },
- "attributes": [ "table", "qualifiedName"]
-}
-
-</pre></div>
-<p><b><i>Field description</i></b></p>
-<div class="source"><pre class="prettyprint">
- typeName: the type of entity to look for
- excludeDeletedEntities: should the search exclude deleted entities? (default: true)
- classification: only include entities with given classification
- query: any free text occurrence that the entity should have (generic/wildcard queries might be slow)
- offset: starting offset of the result set (useful for pagination)
- limit: max number of results to fetch
- entityFilters: entity attribute filter(s)
- tagFilters: classification attribute filter(s)
- attributes: attributes to include in the search result
-
-</pre></div>
-<p><img src="images/twiki/search-basic-hive_column-PII.png" alt="" /></p>
-<p>Attribute based filtering can be done on multiple attributes with AND/OR conditions.</p>
-<p><b><i>Examples of filtering (for hive_table attributes)</i></b></p>
-<ul>
-<li>Single attribute</li></ul>
-<div class="source"><pre class="prettyprint">
- {
- "typeName": "hive_table",
- "excludeDeletedEntities": true,
- "offset": 0,
- "limit": 25,
- "entityFilters": {
- "attributeName": "name",
- "operator": "contains",
- "attributeValue": "customers"
- },
- "attributes": [ "db", "qualifiedName" ]
- }
-
-</pre></div>
-<p><img src="images/twiki/search-basic-hive_table-customers.png" alt="" /></p>
-<p></p>
-<ul>
-<li>Multi-attribute with OR</li></ul>
-<div class="source"><pre class="prettyprint">
- {
- "typeName": "hive_table",
- "excludeDeletedEntities": true,
- "offset": 0,
- "limit": 25,
- "entityFilters": {
- "condition": "OR",
- "criterion": [
- {
- "attributeName": "name",
- "operator": "contains",
- "attributeValue": "customers"
- },
- {
- "attributeName": "name",
- "operator": "contains",
- "attributeValue": "provider"
- }
- ]
- },
- "attributes": [ "db", "qualifiedName" ]
- }
-
-</pre></div>
-<p><img src="images/twiki/search-basic-hive_table-customers-or-provider.png" alt="" /></p>
-<p></p>
-<ul>
-<li>Multi-attribute with AND</li></ul>
-<div class="source"><pre class="prettyprint">
- {
- "typeName": "hive_table",
- "excludeDeletedEntities": true,
- "offset": 0,
- "limit": 25,
- "entityFilters": {
- "condition": "AND",
- "criterion": [
- {
- "attributeName": "name",
- "operator": "contains",
- "attributeValue": "customers"
- },
- {
- "attributeName": "owner",
- "operator": "eq",
- "attributeValue": "hive"
- }
- ]
- },
- "attributes": [ "db", "qualifiedName" ]
- }
-
-</pre></div>
-<p><img src="images/twiki/search-basic-hive_table-customers-owner_is_hive.png" alt="" /></p>
-<p><b><i>Supported operators for filtering</i></b></p>
-<p></p>
-<ul>
-<li>LT (symbols: <, lt) works with Numeric, Date attributes</li>
-<li>GT (symbols: >, gt) works with Numeric, Date attributes</li>
-<li>LTE (symbols: <=, lte) works with Numeric, Date attributes</li>
-<li>GTE (symbols: >=, gte) works with Numeric, Date attributes</li>
-<li>EQ (symbols: eq, =) works with Numeric, Date, String attributes</li>
-<li>NEQ (symbols: neq, !=) works with Numeric, Date, String attributes</li>
-<li>LIKE (symbols: like, LIKE) works with String attributes</li>
-<li>STARTS_WITH (symbols: startsWith, STARTSWITH) works with String attributes</li>
-<li>ENDS_WITH (symbols: endsWith, ENDSWITH) works with String attributes</li>
-<li>CONTAINS (symbols: contains, CONTAINS) works with String attributes</li></ul>
-<p><b><i>CURL Samples</i></b></p>
-<div class="source"><pre class="prettyprint">
- curl -sivk -g
- -u <user>:<password>
- -X POST
- -d '{
- "typeName": "hive_table",
- "excludeDeletedEntities": true,
- "classification": "",
- "query": "",
- "offset": 0,
- "limit": 50,
- "entityFilters": {
- "condition": "AND",
- "criterion": [
- {
- "attributeName": "name",
- "operator": "contains",
- "attributeValue": "customers"
- },
- {
- "attributeName": "owner",
- "operator": "eq",
- "attributeValue": "hive"
- }
- ]
- },
- "attributes": [ "db", "qualifiedName" ]
- }'
- <protocol>://<atlas_host>:<atlas_port>/api/atlas/v2/search/basic
-
-</pre></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/Security.html b/Security.html
deleted file mode 100644
index 37d384f..0000000
--- a/Security.html
+++ /dev/null
@@ -1,388 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/security.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Security Features of Apache Atlas</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Security Features of Apache Atlas</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Security_Features_of_Apache_Atlas"></a>Security Features of Apache Atlas</h2></div>
-<div class="section">
-<h3><a name="Overview"></a>Overview</h3>
-<p>The following features are available for enhancing the security of the platform:</p>
-<ul>
-<li>SSL</li>
-<li>Service Authentication</li>
-<li>SPNEGO-based HTTP Authentication</li></ul></div>
-<div class="section">
-<h4><a name="SSL"></a>SSL</h4>
-<p>Both SSL one-way (server authentication) and two-way (server and client authentication) are supported. The following application properties (properties configured in the atlas-application.properties file) are available for configuring SSL:</p>
-<p></p>
-<ul>
-<li><code>atlas.enableTLS</code> (false|true) [default: false] - enable/disable the SSL listener</li>
-<li><code>keystore.file</code> - the path to the keystore file leveraged by the server. This file contains the server certificate.</li>
-<li><code>truststore.file</code> - the path to the truststore file. This file contains the certificates of other trusted entities (e.g. the certificates for client processes if two-way SSL is enabled). In most instances this can be set to the same value as the keystore.file property (especially if one-way SSL is enabled).</li>
-<li><code>client.auth.enabled</code> (false|true) [default: false] - enable/disable client authentication. If enabled, the client will have to authenticate to the server during the transport session key creation process (i.e. two-way SSL is in effect).</li>
-<li><code>cert.stores.credential.provider.path</code> - the path to the Credential Provider store file. The passwords for the keystore, truststore, and server certificate are maintained in this secure file. Utilize the cputil script in the 'bin' directoy (see below) to populate this file with the passwords required.</li>
-<li><code>atlas.ssl.exclude.cipher.suites</code> - the excluded Cipher Suites list - <b>NULL.</b>,.*RC4.*,.*MD5.*,.*DES.*,.*DSS.* are weak and unsafe Cipher Suites that are excluded by default. If additional Ciphers need to be excluded, set this property with the default Cipher Suites such as atlas.ssl.exclude.cipher.suites=.*NULL.*, .*RC4.*, .*MD5.*, .*DES.*, .*DSS.*, and add the additional Ciper Suites to the list with a comma separator. They can be added with their full name or a reg [...]
-<div class="section">
-<h5><a name="Credential_Provider_Utility_Script"></a>Credential Provider Utility Script</h5>
-<p>In order to prevent the use of clear-text passwords, the Atlas platofrm makes use of the Credential Provider facility for secure password storage (see <a class="externalLink" href="http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CommandsManual.html#credential">Hadoop Credential Command Reference</a> for more information about this facility). The cputil script in the 'bin' directory can be leveraged to create the password store required.</p>
-<p>To create the credential provdier for Atlas:</p>
-<p></p>
-<ul>
-<li>cd to the '<code>bin</code>' directory</li>
-<li>type '<code>./cputil.py</code>'</li>
-<li>Enter the path for the generated credential provider. The format for the path is:
-<ul>
-<li><a class="externalLink" href="jceks://file/local/file/path/file.jceks">jceks://file/local/file/path/file.jceks</a> or <a class="externalLink" href="jceks://hdfs@namenodehost:port/path/in/hdfs/to/file.jceks.">jceks://hdfs@namenodehost:port/path/in/hdfs/to/file.jceks.</a> The files generally use the ".jceks" extension (e.g. test.jceks)</li></ul></li>
-<li>Enter the passwords for the keystore, truststore, and server key (these passwords need to match the ones utilized for actually creating the associated certificate store files).</li></ul>
-<p>The credential provider will be generated and saved to the path provided.</p></div>
-<div class="section">
-<h4><a name="Service_Authentication"></a>Service Authentication</h4>
-<p>The Atlas platform, upon startup, is associated to an authenticated identity. By default, in an insecure environment, that identity is the same as the OS authenticated user launching the server. However, in a secure cluster leveraging kerberos, it is considered a best practice to configure a keytab and principal in order for the platform to authenticate to the KDC. This allows the service to subsequently interact with other secure cluster services (e.g. HDFS).</p>
-<p>The properties for configuring service authentication are:</p>
-<p></p>
-<ul>
-<li><code>atlas.authentication.method</code> (simple|kerberos) [default: simple] - the authentication method to utilize. Simple will leverage the OS authenticated identity and is the default mechanism. 'kerberos' indicates that the service is required to authenticate to the KDC leveraging the configured keytab and principal.</li>
-<li><code>atlas.authentication.keytab</code> - the path to the keytab file.</li>
-<li><code>atlas.authentication.principal</code> - the principal to use for authenticating to the KDC. The principal is generally of the form "user/host@realm". You may use the '_HOST' token for the hostname and the local hostname will be substituted in by the runtime (e.g. "Atlas/_HOST@EXAMPLE.COM").</li></ul>
-<p>Note that when Atlas is configured with HBase as the storage backend in a secure cluster, the graph db (JanusGraph) needs sufficient user permissions to be able to create and access an HBase table. To grant the appropriate permissions see <a href="./Configuration.html">Graph persistence engine - Hbase</a>.</p></div>
-<div class="section">
-<h4><a name="JAAS_configuration"></a>JAAS configuration</h4>
-<p>In a secure cluster, some of the components (such as Kafka) that Atlas interacts with, require Atlas to authenticate itself to them using JAAS. The following properties are used to set up appropriate JAAS Configuration.</p>
-<p></p>
-<ul>
-<li><code>atlas.jaas.<code>client-id<code>.loginModuleName<code> - the authentication method used by the component (for example, com.sun.security.auth.module.Krb5LoginModule)</li>
-<li><code>atlas.jaas.<code>client-id<code>.loginModuleControlFlag<code> (required|requisite|sufficient|optional) [default: required]</li>
-<li><code>atlas.jaas.<code>client-id<code>.option.useKeyTab<code> (true|false)</li>
-<li><code>atlas.jaas.<code>client-id<code>.option.storeKey<code> (true | false)</li>
-<li><code>atlas.jaas.<code>client-id<code>.option.serviceName<code> - service name of server component</li>
-<li><code>atlas.jaas.<code>client-id<code>.option.keyTab<code> = <atlas keytab></li>
-<li><code>atlas.jaas.<code>client-id<code>.option.principal<code> = <atlas principal></li></ul>
-<p>For example, the following property settings in jaas-application.properties file</p>
-<div class="source"><pre class="prettyprint">
-
-atlas.jaas.KafkaClient.loginModuleName = com.sun.security.auth.module.Krb5LoginModule
-atlas.jaas.KafkaClient.loginModuleControlFlag = required
-atlas.jaas.KafkaClient.option.useKeyTab = true
-atlas.jaas.KafkaClient.option.storeKey = true
-atlas.jaas.KafkaClient.option.serviceName = kafka
-atlas.jaas.KafkaClient.option.keyTab = /etc/security/keytabs/kafka_client.keytab
-atlas.jaas.KafkaClient.option.principal = kafka-client-1@EXAMPLE.COM
-
-atlas.jaas.MyClient.0.loginModuleName = com.sun.security.auth.module.Krb5LoginModule
-atlas.jaas.MyClient.0.loginModuleControlFlag = required
-atlas.jaas.MyClient.0.option.useKeyTab = true
-atlas.jaas.MyClient.0.option.storeKey = true
-atlas.jaas.MyClient.0.option.serviceName = kafka
-atlas.jaas.MyClient.0.option.keyTab = /etc/security/keytabs/kafka_client.keytab
-atlas.jaas.MyClient.0.option.principal = kafka-client-1@EXAMPLE.COM
-
-atlas.jaas.MyClient.1.loginModuleName = com.sun.security.auth.module.Krb5LoginModule
-atlas.jaas.MyClient.1.loginModuleControlFlag = optional
-atlas.jaas.MyClient.1.option.useKeyTab = true
-atlas.jaas.MyClient.1.option.storeKey = true
-atlas.jaas.MyClient.1.option.serviceName = kafka
-atlas.jaas.MyClient.1.option.keyTab = /etc/security/keytabs/kafka_client.keytab
-atlas.jaas.MyClient.1.option.principal = kafka-client-1@EXAMPLE.COM
-
-
-</pre></div>
-<p>will set the JAAS configuration that is equivalent to the following jaas.conf file entries.</p>
-<div class="source"><pre class="prettyprint">
-
-KafkaClient {
- com.sun.security.auth.module.Krb5LoginModule required
- useKeyTab=true
- storeKey=true
- serviceName=kafka
- keyTab="/etc/security/keytabs/kafka_client.keytab"
- principal="kafka-client-1@EXAMPLE.COM";
-};
-MyClient {
- com.sun.security.auth.module.Krb5LoginModule required
- useKeyTab=true
- storeKey=true
- serviceName=kafka keyTab="/etc/security/keytabs/kafka_client.keytab"
- principal="kafka-client-1@EXAMPLE.COM";
-};
-MyClient {
- com.sun.security.auth.module.Krb5LoginModule optional
- useKeyTab=true
- storeKey=true
- serviceName=kafka
- keyTab="/etc/security/keytabs/kafka_client.keytab"
- principal="kafka-client-1@EXAMPLE.COM";
-};
-
-
-</pre></div></div>
-<div class="section">
-<h4><a name="SPNEGO-based_HTTP_Authentication"></a>SPNEGO-based HTTP Authentication</h4>
-<p>HTTP access to the Atlas platform can be secured by enabling the platform's SPNEGO support. There are currently two supported authentication mechanisms:</p>
-<p></p>
-<ul>
-<li><code>simple</code> - authentication is performed via a provided user name</li>
-<li><code>kerberos</code> - the KDC authenticated identity of the client is leveraged to authenticate to the server</li></ul>
-<p>The kerberos support requires the client accessing the server to first authenticate to the KDC (usually this is done via the 'kinit' command). Once authenticated, the user may access the server (the authenticated identity will be related to the server via the SPNEGO negotiation mechanism).</p>
-<p>The properties for configuring the SPNEGO support are:</p>
-<p></p>
-<ul>
-<li><code>atlas.http.authentication.enabled</code> (true|false) [default: false] - a property indicating whether to enable HTTP authentication</li>
-<li><code>atlas.http.authentication.type</code> (simple|kerberos) [default: simple] - the authentication type</li>
-<li><code>atlas.http.authentication.kerberos.principal</code> - the web-application Kerberos principal name. The Kerberos principal name must start with "HTTP/...". For example: "HTTP/localhost@LOCALHOST". There is no default value.</li>
-<li><code>atlas.http.authentication.kerberos.keytab</code> - the path to the keytab file containing the credentials for the kerberos principal.</li>
-<li><code>atlas.rest.address</code> - <http/https>://<atlas-fqdn>:<atlas port></li></ul>
-<p>For a more detailed discussion of the HTTP authentication mechanism refer to <a class="externalLink" href="http://hadoop.apache.org/docs/stable/hadoop-auth/Configuration.html">Hadoop Auth, Java HTTP SPNEGO 2.6.0 - Server Side Configuration</a>. The prefix that document references is "atlas.http.authentication" in the case of the Atlas authentication implementation.</p></div>
-<div class="section">
-<h4><a name="Client_security_configuration"></a>Client security configuration</h4>
-<p>When leveraging Atlas client code to communicate with an Atlas server configured for SSL transport and/or Kerberos authentication, there is a requirement to provide the Atlas client configuration file that provides the security properties that allow for communication with, or authenticating to, the server. Update the atlas-application.properties file with the appropriate settings (see below) and copy it to the client's classpath or to the directory specified by the "atlas.conf&qu [...]
-<p>The client properties for SSL communication are:</p>
-<p></p>
-<ul>
-<li><code>atlas.enableTLS</code> (false|true) [default: false] - enable/disable the SSL client communication infrastructure.</li>
-<li><code>keystore.file</code> - the path to the keystore file leveraged by the client. This file is only required if 2-Way SSL is enabled at the server and contains the client certificate.</li>
-<li><code>truststore.file</code> - the path to the truststore file. This file contains the certificates of trusted entities (e.g. the certificates for the server or a shared certification authority). This file is required for both one-way or two-way SSL.</li>
-<li><code>cert.stores.credential.provider.path</code> - the path to the Credential Provider store file. The passwords for the keystore, truststore, and client certificate are maintained in this secure file.</li></ul>
-<p>The property required for authenticating to the server (if authentication is enabled):</p>
-<p></p>
-<ul>
-<li><code>atlas.http.authentication.type</code> (simple|kerberos) [default: simple] - the authentication type</li></ul></div>
-<div class="section">
-<h4><a name="SOLR_Kerberos_configuration"></a>SOLR Kerberos configuration</h4>
-<p>If the authentication type specified is 'kerberos', then the kerberos ticket cache will be accessed for authenticating to the server (Therefore the client is required to authenticate to the KDC prior to communication with the server using 'kinit' or a similar mechanism).</p>
-<p>See <a class="externalLink" href="https://cwiki.apache.org/confluence/display/RANGER/How+to+configure+Solr+Cloud+with+Kerberos+for+Ranger+0.5">the Apache SOLR Kerberos configuration</a>.</p>
-<p></p>
-<ul>
-<li>Add principal and generate the keytab file for solr. Create a keytab per host for each host where Solr is going to run and use the principal name with the host (e.g. addprinc -randkey solr/${HOST1}@EXAMPLE.COM. Replace ${HOST1} with the actual host names).</li></ul>
-<div class="source"><pre class="prettyprint">
- kadmin.local
- kadmin.local: addprinc -randkey solr/<hostname>@EXAMPLE.COM
- kadmin.local: xst -k solr.keytab solr/<hostname>@EXAMPLE.COM
- kadmin.local: quit
-
-</pre></div>
-<p></p>
-<ul>
-<li>Add principal and generate the keytab file for authenticating HTTP request. (Note that if Ambari is used to Kerberize the cluster, the keytab /etc/security/keytabs/spnego.service.keytab can be used)</li></ul>
-<div class="source"><pre class="prettyprint">
- kadmin.local
- kadmin.local: addprinc -randkey HTTP/<hostname>@EXAMPLE.COM
- kadmin.local: xst -k HTTP.keytab HTTP/<hostname>@EXAMPLE.COM
- kadmin.local: quit
-
-</pre></div>
-<p></p>
-<ul>
-<li>Copy the keytab file to all the hosts running Solr.</li></ul>
-<div class="source"><pre class="prettyprint">
- cp solr.keytab /etc/security/keytabs/
- chmod 400 /etc/security/keytabs/solr.keytab
-
- cp HTTP.keytab /etc/security/keytabs/
- chmod 400 /etc/security/keytabs/HTTP.keytab
-
-</pre></div>
-<p></p>
-<ul>
-<li>Create path in Zookeeper for storing the Solr configs and other parameters.</li></ul>
-<div class="source"><pre class="prettyprint">
- $SOLR_INSTALL_HOME/server/scripts/cloud-scripts/zkcli.sh -zkhost $ZK_HOST:2181 -cmd makepath solr
-
-</pre></div>
-<p></p>
-<ul>
-<li>Upload the configuration to Zookeeper.</li></ul>
-<div class="source"><pre class="prettyprint">
- $SOLR_INSTALL_HOME/server/scripts/cloud-scripts/zkcli.sh -cmd upconfig -zkhost $ZK_HOST:2181/solr -confname basic_configs -confdir $SOLR_INSTALL_HOME/server/solr/configsets/_default/conf
-
-</pre></div>
-<p></p>
-<ul>
-<li>Create the JAAS configuration.</li></ul>
-<div class="source"><pre class="prettyprint">
- vi /etc/solr/conf/solr_jaas.conf
-
- Client {
- com.sun.security.auth.module.Krb5LoginModule required
- useKeyTab=true
- keyTab="/etc/security/keytabs/solr.keytab"
- storeKey=true
- useTicketCache=true
- debug=true
- principal="solr/<hostname>@EXAMPLE.COM";
- };
-
-</pre></div>
-<p></p>
-<ul>
-<li>Copy /etc/solr/conf/solr_jaas.conf to all hosts running Solr.</li></ul>
-<p></p>
-<ul>
-<li>Edit solr.in.sh in $SOLR_INSTALL_HOME/bin/</li></ul>
-<div class="source"><pre class="prettyprint">
- vi $SOLR_INSTALL_HOME/bin/solr.in.sh
-
- SOLR_JAAS_FILE=/etc/solr/conf/solr_jaas.conf
- SOLR_HOST=`hostname -f`
- ZK_HOST="$ZK_HOST1:2181,$ZK_HOST2:2181,$ZK_HOST3:2181/solr"
- KERBEROS_REALM="EXAMPLE.COM"
- SOLR_KEYTAB=/etc/solr/conf/solr.keytab
- SOLR_KERB_PRINCIPAL=HTTP@${KERBEROS_REALM}
- SOLR_KERB_KEYTAB=/etc/solr/conf/HTTP.keytab
- SOLR_AUTHENTICATION_CLIENT_CONFIGURER="org.apache.solr.client.solrj.impl.Krb5HttpClientConfigurer"
- SOLR_AUTHENTICATION_OPTS=" -DauthenticationPlugin=org.apache.solr.security.KerberosPlugin -Djava.security.auth.login.config=${SOLR_JAAS_FILE} -Dsolr.kerberos.principal=${SOLR_KERB_PRINCIPAL} -Dsolr.kerberos.keytab=${SOLR_KERB_KEYTAB} -Dsolr.kerberos.cookie.domain=${SOLR_HOST} -Dhost=${SOLR_HOST} -Dsolr.kerberos.name.rules=DEFAULT"
-
-</pre></div>
-<p></p>
-<ul>
-<li>Copy solr.in.sh to all hosts running Solr.</li></ul>
-<p></p>
-<ul>
-<li>Set up Solr to use the Kerberos plugin by uploading the security.json.</li></ul>
-<div class="source"><pre class="prettyprint">
- $SOLR_INSTALL_HOME/server/scripts/cloud-scripts/zkcli.sh -zkhost <zk host>:2181 -cmd put /security.json '{"authentication":{"class": "org.apache.solr.security.KerberosPlugin"}}'
-
-</pre></div>
-<p></p>
-<ul>
-<li>Start Solr.</li></ul>
-<div class="source"><pre class="prettyprint">
- $SOLR_INSTALL_HOME/bin/solr start -cloud -z $ZK_HOST1:2181,$ZK_HOST2:2181,$ZK_HOST3:2181 -noprompt
-
-</pre></div>
-<p></p>
-<ul>
-<li>Test Solr</li></ul>
-<div class="source"><pre class="prettyprint">
- kinit -k -t /etc/security/keytabs/HTTP.keytab HTTP/<host>@EXAMPLE.COM
- curl --negotiate -u : "http://<host>:8983/solr/"
-
-</pre></div>
-<p></p>
-<ul>
-<li>Create collections in Solr corresponding to the indexes that Atlas uses and change the Atlas configuration to point to the Solr instance setup as described in the <a href="./InstallationSteps.html">Install Steps</a>.</li></ul></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/SoftReference.html b/SoftReference.html
deleted file mode 100644
index a0ce6b7..0000000
--- a/SoftReference.html
+++ /dev/null
@@ -1,158 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/SoftReference.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Entity Attribute Option: SoftReference</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Entity Attribute Option: SoftReference</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<h1>Entity Attribute Option: SoftReference</h1>
-<div class="section">
-<div class="section">
-<div class="section">
-<h4><a name="Background"></a>Background</h4>
-<p>Entity attributes are specified using attribute definitions. An attributes persistence strategy is determined by based on their type.</p>
-<p>Primitive types are persisted as properties within the vertex of their parent.</p>
-<p>Non-primitive attributes get a vertex of their own and and edge is created between the parent the child to establish ownership.</p>
-<p>Attribute with <i>isSoftReference</i> option set to <i>true</i>, is non-primitive attribute that gets treatment of a primitive attribute.</p></div>
-<div class="section">
-<h4><a name="Specification"></a>Specification</h4>
-<p>Below is an example of using the new attribute option.</p>
-
-<div>
-<div>
-<pre class="source"> "attributeDefs": [
- {
- "name": "replicatedFrom",
- "typeName": "array<AtlasServer>",
- "cardinality": "SET",
- "isIndexable": false,
- "isOptional": true,
- "isUnique": false,
- "options": {
- "isSoftReference": "true"
- }
- },
-</pre></div></div></div></div></div>
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/TypeSystem.html b/TypeSystem.html
deleted file mode 100644
index cc52426..0000000
--- a/TypeSystem.html
+++ /dev/null
@@ -1,278 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/TypeSystem.twiki at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Type System</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
- <input class="search-query" name="q" id="query" type="text" />
-</form>
-<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script>
- <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"
- scrolling="no" frameborder="0"
- style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe>
- <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script>
- <ul class="nav pull-right"><li style="margin-top: 10px;">
- <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs" data-size="medium" width="60px" align="right" ></div>
- </li></ul>
- </div>
- </div>
- </div>
- </div>
- <div class="container">
- <div id="banner">
- <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div>
- <div class="pull-right"></div>
- <div class="clear"><hr/></div>
- </div>
-
- <div id="breadcrumbs">
- <ul class="breadcrumb">
- <li class=""><a href="http://www.apache.org" class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li>
- <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li>
- <li class="active ">Type System</li>
- <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2019-06-28</li>
- <li id="projectVersion" class="pull-right">Version: 2.0.0</li>
- </ul>
- </div>
- <div id="bodyColumn" >
-<div class="section">
-<h2><a name="Type_System"></a>Type System</h2></div>
-<div class="section">
-<h3><a name="Overview"></a>Overview</h3>
-<p>Atlas allows users to define a model for the metadata objects they want to manage. The model is composed of definitions called ‘types’. Instances of ‘types’ called ‘entities’ represent the actual metadata objects that are managed. The Type System is a component that allows users to define and manage the types and entities. All metadata objects managed by Atlas out of the box (like Hive tables, for e.g.) are modelled using types and represented [...]
-<div class="section">
-<h3><a name="Types"></a>Types</h3>
-<p>A ‘Type’ in Atlas is a definition of how a particular type of metadata objects are stored and accessed. A type represents one or a collection of attributes that define the properties for the metadata object. Users with a development background will recognize the similarity of a type to a ‘Class’ definition of object oriented programming languages, or a ‘table schema’ of relational databases.</p>
-<p>An example of a type that comes natively defined with Atlas is a Hive table. A Hive table is defined with these attributes:</p>
-<div class="source"><pre class="prettyprint">
-Name: hive_table
-TypeCategory: Entity
-SuperTypes: DataSet
-Attributes:
- name: string
- db: hive_db
- owner: string
- createTime: date
- lastAccessTime: date
- comment: string
- retention: int
- sd: hive_storagedesc
- partitionKeys: array<hive_column>
- aliases: array<string>
- columns: array<hive_column>
- parameters: map<string,string>
- viewOriginalText: string
- viewExpandedText: string
- tableType: string
- temporary: boolean
-</pre></div>
-<p>The following points can be noted from the above example:</p>
-<p></p>
-<ul>
-<li>A type in Atlas is identified uniquely by a ‘name’</li>
-<li>A type has a metatype. Atlas has the following metatypes:
-<ul>
-<li>Primitive metatypes: boolean, byte, short, int, long, float, double, biginteger, bigdecimal, string, date</li>
-<li>Enum metatypes</li>
-<li>Collection metatypes: array, map</li>
-<li>Composite metatypes: Entity, Struct, Classification, Relationship</li></ul></li>
-<li>Entity & Classification types can ‘extend’ from other types, called ‘supertype’ - by virtue of this, it will get to include the attributes that are defined in the supertype as well. This allows modellers to define common attributes across a set of related types etc. This is again similar to the concept of how Object Oriented languages define super classes for a class. It is also possible for a type in Atlas to extend from multiple super types.
-<ul>
-<li>In this example, every hive table extends from a pre-defined supertype called a ‘DataSet’. More details about this pre-defined types will be provided later.</li></ul></li>
-<li>Types which have a metatype of ‘Entity’, ‘Struct’, ‘Classification’ or 'Relationship' can have a collection of attributes. Each attribute has a name (e.g. ‘name’) and some other associated properties. A property can be referred to using an expression type_name.attribute_name. It is also good to note that attributes themselves are defined using Atlas metatypes.
-<ul>
-<li>In this example, hive_table.name is a String, hive_table.aliases is an array of Strings, hive_table.db refers to an instance of a type called hive_db and so on.</li></ul></li>
-<li>Type references in attributes, (like hive_table.db) are particularly interesting. Note that using such an attribute, we can define arbitrary relationships between two types defined in Atlas and thus build rich models. Note that one can also collect a list of references as an attribute type (e.g. hive_table.columns which represents a list of references from hive_table to hive_column type)</li></ul></div>
-<div class="section">
-<h3><a name="Entities"></a>Entities</h3>
-<p>An ‘entity’ in Atlas is a specific value or instance of an Entity ‘type’ and thus represents a specific metadata object in the real world. Referring back to our analogy of Object Oriented Programming languages, an ‘instance’ is an ‘Object’ of a certain ‘Class’.</p>
-<p>An example of an entity will be a specific Hive Table. Say Hive has a table called ‘customers’ in the ‘default’ database. This table will be an ‘entity’ in Atlas of type hive_table. By virtue of being an instance of an entity type, it will have values for every attribute that are a part of the Hive table ‘type’, such as:</p>
-<div class="source"><pre class="prettyprint">
-guid: "9ba387dd-fa76-429c-b791-ffc338d3c91f"
-typeName: "hive_table"
-status: "ACTIVE"
-values:
- name: “customers”
- db: { "guid": "b42c6cfc-c1e7-42fd-a9e6-890e0adf33bc", "typeName": "hive_db" }
- owner: “admin”
- createTime: 1490761686029
- updateTime: 1516298102877
- comment: null
- retention: 0
- sd: { "guid": "ff58025f-6854-4195-9f75-3a3058dd8dcf", "typeName": "hive_storagedesc" }
- partitionKeys: null
- aliases: null
- columns: [ { "guid": ""65e2204f-6a23-4130-934a-9679af6a211f", "typeName": "hive_column" }, { "guid": ""d726de70-faca-46fb-9c99-cf04f6b579a6", "typeName": "hive_column" }, ...]
- parameters: { "transient_lastDdlTime": "1466403208"}
- viewOriginalText: null
- viewExpandedText: null
- tableType: “MANAGED_TABLE”
- temporary: false
-</pre></div>
-<p>The following points can be noted from the example above:</p>
-<p></p>
-<ul>
-<li>Every instance ofan entity type is identified by a unique identifier, a GUID. This GUID is generated by the Atlas server when the object is defined, and remains constant for the entire lifetime of the entity. At any point in time, this particular entity can be accessed using its GUID.
-<ul>
-<li>In this example, the ‘customers’ table in the default database is uniquely identified by the GUID "9ba387dd-fa76-429c-b791-ffc338d3c91f"</li></ul></li>
-<li>An entity is of a given type, and the name of the type is provided with the entity definition.
-<ul>
-<li>In this example, the ‘customers’ table is a ‘hive_table.</li></ul></li>
-<li>The values of this entity are a map of all the attribute names and their values for attributes that are defined in the hive_table type definition.</li>
-<li>Attribute values will be according to the datatype of the attribute. Entity-type attributes will have value of type <a href="./AtlasObjectId.html">AtlasObjectId</a></li></ul>
-<p>With this idea on entities, we can now see the difference between Entity and Struct metatypes. Entities and Structs both compose attributes of other types. However, instances of Entity types have an identity (with a GUID value) and can be referenced from other entities (like a hive_db entity is referenced from a hive_table entity). Instances of Struct types do not have an identity of their own. The value of a Struct type is a collection of attributes that are ‘embedded’ [...]
-<div class="section">
-<h3><a name="Attributes"></a>Attributes</h3>
-<p>We already saw that attributes are defined inside metatypes like Entity, Struct, Classification and Relationship. But we implistically referred to attributes as having a name and a metatype value. However, attributes in Atlas have some more properties that define more concepts related to the type system.</p>
-<p>An attribute has the following properties:</p>
-<div class="source"><pre class="prettyprint">
- name: string,
- typeName: string,
- isOptional: boolean,
- isIndexable: boolean,
- isUnique: boolean,
- cardinality: enum
-</pre></div>
-<p>The properties above have the following meanings:</p>
-<p></p>
-<ul>
-<li>name - the name of the attribute</li>
-<li>dataTypeName - the metatype name of the attribute (native, collection or composite)</li>
-<li>isComposite -
-<ul>
-<li>This flag indicates an aspect of modelling. If an attribute is defined as composite, it means that it cannot have a lifecycle independent of the entity it is contained in. A good example of this concept is the set of columns that make a part of a hive table. Since the columns do not have meaning outside of the hive table, they are defined as composite attributes.</li>
-<li>A composite attribute must be created in Atlas along with the entity it is contained in. i.e. A hive column must be created along with the hive table.</li></ul></li>
-<li>isIndexable -
-<ul>
-<li>This flag indicates whether this property should be indexed on, so that look ups can be performed using the attribute value as a predicate and can be performed efficiently.</li></ul></li>
-<li>isUnique -
-<ul>
-<li>This flag is again related to indexing. If specified to be unique, it means that a special index is created for this attribute in <a href="./JanusGraph.html">JanusGraph</a> that allows for equality based look ups.</li>
-<li>Any attribute with a true value for this flag is treated like a primary key to distinguish this entity from other entities. Hence care should be taken ensure that this attribute does model a unique property in real world.
-<ul>
-<li>For e.g. consider the name attribute of a hive_table. In isolation, a name is not a unique attribute for a hive_table, because tables with the same name can exist in multiple databases. Even a pair of (database name, table name) is not unique if Atlas is storing metadata of hive tables amongst multiple clusters. Only a cluster location, database name and table name can be deemed unique in the physical world.</li></ul></li></ul></li>
-<li>multiplicity - indicates whether this attribute is required, optional, or could be multi-valued. If an entity’s definition of the attribute value does not match the multiplicity declaration in the type definition, this would be a constraint violation and the entity addition will fail. This field can therefore be used to define some constraints on the metadata information.</li></ul>
-<p>Using the above, let us expand on the attribute definition of one of the attributes of the hive table below. Let us look at the attribute called ‘db’ which represents the database to which the hive table belongs:</p>
-<div class="source"><pre class="prettyprint">
-db:
- "name": "db",
- "typeName": "hive_db",
- "isOptional": false,
- "isIndexable": true,
- "isUnique": false,
- "cardinality": "SINGLE"
-</pre></div>
-<p>Note the “isOptional=true” constraint - a table entity cannot be created without a db reference.</p>
-<div class="source"><pre class="prettyprint">
-columns:
- "name": "columns",
- "typeName": "array<hive_column>",
- "isOptional": optional,
- "isIndexable": true,
- “isUnique": false,
- "constraints": [ { "type": "ownedRef" } ]
-</pre></div>
-<p>Note the “ownedRef” constraint for columns. By doing this, we are indicating that the defined column entities should always be bound to the table entity they are defined with.</p>
-<p>From this description and examples, you will be able to realize that attribute definitions can be used to influence specific modelling behavior (constraints, indexing, etc) to be enforced by the Atlas system.</p></div>
-<div class="section">
-<h3><a name="System_specific_types_and_their_significance"></a>System specific types and their significance</h3>
-<p>Atlas comes with a few pre-defined system types. We saw one example (DataSet) in preceding sections. In this section we will see more of these types and understand their significance.</p>
-<p><b>Referenceable</b>: This type represents all entities that can be searched for using a unique attribute called qualifiedName.</p>
-<p><b>Asset</b>: This type extends Referenceable and adds attributes like name, description and owner. Name is a required attribute (isOptional=false), the others are optional.</p>
-<p>The purpose of Referenceable and Asset is to provide modellers with way to enforce consistency when defining and querying entities of their own types. Having these fixed set of attributes allows applications and user interfaces to make convention based assumptions about what attributes they can expect of types by default.</p>
-<p><b>Infrastructure</b>: This type extends Asset and typically can be used to be a common super type for infrastructural metadata objects like clusters, hosts etc.</p>
-<p><b>DataSet</b>: This type extends Referenceable. Conceptually, it can be used to represent an type that stores data. In Atlas, hive tables, hbase_tables etc are all types that extend from DataSet. Types that extend DataSet can be expected to have a Schema in the sense that they would have an attribute that defines attributes of that dataset. For e.g. the columns attribute in a hive_table. Also entities of types that extend DataSet participate in data transformation and this transforma [...]
-<p><b>Process</b>: This type extends Asset. Conceptually, it can be used to represent any data transformation operation. For example, an ETL process that transforms a hive table with raw data to another hive table that stores some aggregate can be a specific type that extends the Process type. A Process type has two specific attributes, inputs and outputs. Both inputs and outputs are arrays of DataSet entities. Thus an instance of a Process type can use these inputs and outputs to captur [...]
- </div>
- </div>
- <hr/>
- <footer>
- <div class="container">
- <div class="row">
-<p><a href="https://www.apache.org/foundation/contributing"><img src="https://www.apache.org/images/SupportApache-small.png" alt="Support the ASF" id="asf-logo" height="20" width="20" /></a>Copyright © 2011-2018 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.<br/>
-Apache Atlas, Atlas, Apache, the Apache feather logo are trademarks of the <a href="https://www.apache.org">Apache Software Foundation</a>.<br/>
-All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
- </div>
- <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a>
-</p>
- </div>
- </footer>
- </body>
-</html>
diff --git a/WhatsNew-1.0.html b/WhatsNew-1.0.html
deleted file mode 100644
index 5bb499c..0000000
--- a/WhatsNew-1.0.html
+++ /dev/null
@@ -1,238 +0,0 @@
-<!DOCTYPE html>
-<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/markdown/WhatsNew-1.0.md at 2019-06-28
- | Rendered using Apache Maven Fluido Skin 1.7
--->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta charset="UTF-8" />
- <meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20190628" />
- <meta http-equiv="Content-Language" content="en" />
- <title>Apache Atlas – Whats new in Apache Atlas 1.0?</title>
- <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" />
- <link rel="stylesheet" href="./css/site.css" />
- <link rel="stylesheet" href="./css/print.css" media="print" />
- <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script>
- </head>
- <body class="topBarEnabled">
- <div id="topbar" class="navbar navbar-fixed-top ">
- <div class="navbar-inner">
- <div class="container" style="width: 68%;"><div class="nav-collapse">
- <ul class="nav">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Apache Atlas <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="index.html" title="Overview">Overview</a></li>
- <li><a href="license.html" title="License">License</a></li>
- <li><a href="Downloads.html" title="Downloads">Downloads</a></li>
- <li><a href="https://cwiki.apache.org/confluence/display/ATLAS" title="Wiki">Wiki</a></li>
- <li><a href="https://gitbox.apache.org/repos/asf/atlas.git" title="Git">Git</a></li>
- <li><a href="https://issues.apache.org/jira/browse/ATLAS" title="Jira">Jira</a></li>
- <li><a href="https://reviews.apache.org/groups/atlas/?sort=-time_added" title="Review Board">Review Board</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="project-info.html" title="Summary">Summary</a></li>
- <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li>
- <li><a href="team-list.html" title="Team">Team</a></li>
- <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li>
- <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="Downloads.html" target="_blank" title="All Releases">All Releases</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="../index.html" title="latest">latest</a></li>
- <li><a href="../2.0.0/index.html" title="2.0.0">2.0.0</a></li>
- <li><a href="../1.2.0/index.html" title="1.2.0">1.2.0</a></li>
- <li><a href="../1.1.0/index.html" title="1.1.0">1.1.0</a></li>
- <li><a href="../1.0.0/index.html" title="1.0.0">1.0.0</a></li>
- <li><a href="../0.8.4/index.html" title="0.8.4">0.8.4</a></li>
- <li><a href="../0.8.3/index.html" title="0.8.3">0.8.3</a></li>
- <li><a href="../0.8.2/index.html" title="0.8.2">0.8.2</a></li>
- <li><a href="../0.8.1/index.html" title="0.8.1">0.8.1</a></li>
- <li><a href="../0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li>
- <li><a href="../0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li>
- <li><a href="../0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li>
- <li><a href="../0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li>
- <li><a href="../0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a>
- <ul class="dropdown-menu">
- <li><a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a></li>
- <li><a href="https://www.apache.org/events/current-event" title="Events">Events</a></li>
- <li><a href="https://www.apache.org/licenses/" title="License">License</a></li>
- <li><a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li>
- </ul>
- </li>
- </ul>
-<form id="search-form" action="https://www.google.com/search" method="get" class="navbar-search pull-right" >
- <input value="http://atlas.apache.org" name="sitesearch" type="hidden"/>
... 4755 lines suppressed ...