You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@asterixdb.apache.org by bu...@apache.org on 2016/03/26 00:31:58 UTC
[04/30] incubator-asterixdb-site git commit: Add the documentation
for release-0.8.8.
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/data/twm.adm
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/data/twm.adm b/docs/0.8.8-incubating/data/twm.adm
new file mode 100644
index 0000000..fa764af
--- /dev/null
+++ b/docs/0.8.8-incubating/data/twm.adm
@@ -0,0 +1,12 @@
+{"tweetid":"1","user":{"screen-name":"NathanGiesen@211","lang":"en","friends_count":39339,"statuses_count":473,"name":"Nathan Giesen","followers_count":49416},"sender-location":point("47.44,80.65"),"send-time":datetime("2008-04-26T10:10:00"),"referred-topics":{{"t-mobile","customization"}},"message-text":" love t-mobile its customization is good:)"}
+{"tweetid":"2","user":{"screen-name":"ColineGeyer@63","lang":"en","friends_count":121,"statuses_count":362,"name":"Coline Geyer","followers_count":17159},"sender-location":point("32.84,67.14"),"send-time":datetime("2010-05-13T10:10:00"),"referred-topics":{{"verizon","shortcut-menu"}},"message-text":" like verizon its shortcut-menu is awesome:)"}
+{"tweetid":"3","user":{"screen-name":"NathanGiesen@211","lang":"en","friends_count":39339,"statuses_count":473,"name":"Nathan Giesen","followers_count":49416},"sender-location":point("29.72,75.8"),"send-time":datetime("2006-11-04T10:10:00"),"referred-topics":{{"motorola","speed"}},"message-text":" like motorola the speed is good:)"}
+{"tweetid":"4","user":{"screen-name":"NathanGiesen@211","lang":"en","friends_count":39339,"statuses_count":473,"name":"Nathan Giesen","followers_count":49416},"sender-location":point("39.28,70.48"),"send-time":datetime("2011-12-26T10:10:00"),"referred-topics":{{"sprint","voice-command"}},"message-text":" like sprint the voice-command is mind-blowing:)"}
+{"tweetid":"5","user":{"screen-name":"NathanGiesen@211","lang":"en","friends_count":39339,"statuses_count":473,"name":"Nathan Giesen","followers_count":49416},"sender-location":point("40.09,92.69"),"send-time":datetime("2006-08-04T10:10:00"),"referred-topics":{{"motorola","speed"}},"message-text":" can't stand motorola its speed is terrible:("}
+{"tweetid":"6","user":{"screen-name":"ColineGeyer@63","lang":"en","friends_count":121,"statuses_count":362,"name":"Coline Geyer","followers_count":17159},"sender-location":point("47.51,83.99"),"send-time":datetime("2010-05-07T10:10:00"),"referred-topics":{{"iphone","voice-clarity"}},"message-text":" like iphone the voice-clarity is good:)"}
+{"tweetid":"7","user":{"screen-name":"ChangEwing_573","lang":"en","friends_count":182,"statuses_count":394,"name":"Chang Ewing","followers_count":32136},"sender-location":point("36.21,72.6"),"send-time":datetime("2011-08-25T10:10:00"),"referred-topics":{{"samsung","platform"}},"message-text":" like samsung the platform is good"}
+{"tweetid":"8","user":{"screen-name":"NathanGiesen@211","lang":"en","friends_count":39339,"statuses_count":473,"name":"Nathan Giesen","followers_count":49416},"sender-location":point("46.05,93.34"),"send-time":datetime("2005-10-14T10:10:00"),"referred-topics":{{"t-mobile","shortcut-menu"}},"message-text":" like t-mobile the shortcut-menu is awesome:)"}
+{"tweetid":"9","user":{"screen-name":"NathanGiesen@211","lang":"en","friends_count":39339,"statuses_count":473,"name":"Nathan Giesen","followers_count":49416},"sender-location":point("36.86,74.62"),"send-time":datetime("2012-07-21T10:10:00"),"referred-topics":{{"verizon","voicemail-service"}},"message-text":" love verizon its voicemail-service is awesome"}
+{"tweetid":"10","user":{"screen-name":"ColineGeyer@63","lang":"en","friends_count":121,"statuses_count":362,"name":"Coline Geyer","followers_count":17159},"sender-location":point("29.15,76.53"),"send-time":datetime("2008-01-26T10:10:00"),"referred-topics":{{"verizon","voice-clarity"}},"message-text":" hate verizon its voice-clarity is OMG:("}
+{"tweetid":"11","user":{"screen-name":"NilaMilliron_tw","lang":"en","friends_count":445,"statuses_count":164,"name":"Nila Milliron","followers_count":22649},"sender-location":point("37.59,68.42"),"send-time":datetime("2008-03-09T10:10:00"),"referred-topics":{{"iphone","platform"}},"message-text":" can't stand iphone its platform is terrible"}
+{"tweetid":"12","user":{"screen-name":"OliJackson_512","lang":"en","friends_count":445,"statuses_count":164,"name":"Oli Jackson","followers_count":22649},"sender-location":point("24.82,94.63"),"send-time":datetime("2010-02-13T10:10:00"),"referred-topics":{{"samsung","voice-command"}},"message-text":" like samsung the voice-command is amazing:)"}
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/data/twu.adm
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/data/twu.adm b/docs/0.8.8-incubating/data/twu.adm
new file mode 100644
index 0000000..32a1917
--- /dev/null
+++ b/docs/0.8.8-incubating/data/twu.adm
@@ -0,0 +1,4 @@
+{"screen-name":"NathanGiesen@211","lang":"en","friends_count":18,"statuses_count":473,"name":"Nathan Giesen","followers_count":49416}
+{"screen-name":"ColineGeyer@63","lang":"en","friends_count":121,"statuses_count":362,"name":"Coline Geyer","followers_count":17159}
+{"screen-name":"NilaMilliron_tw","lang":"en","friends_count":445,"statuses_count":164,"name":"Nila Milliron","followers_count":22649}
+{"screen-name":"ChangEwing_573","lang":"en","friends_count":182,"statuses_count":394,"name":"Chang Ewing","followers_count":32136}
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/feeds/tutorial.html
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/feeds/tutorial.html b/docs/0.8.8-incubating/feeds/tutorial.html
new file mode 100644
index 0000000..0beea3a
--- /dev/null
+++ b/docs/0.8.8-incubating/feeds/tutorial.html
@@ -0,0 +1,425 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at 2016-03-25
+ | Rendered using Apache Maven Fluido Skin 1.3.0
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+ <head>
+ <meta charset="UTF-8" />
+ <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+ <meta name="Date-Revision-yyyymmdd" content="20160325" />
+ <meta http-equiv="Content-Language" content="en" />
+ <title>AsterixDB – Support for Data Ingestion in AsterixDB</title>
+ <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" />
+ <link rel="stylesheet" href="../css/site.css" />
+ <link rel="stylesheet" href="../css/print.css" media="print" />
+
+
+ <script type="text/javascript" src="../js/apache-maven-fluido-1.3.0.min.js"></script>
+
+
+
+<script>(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-41536543-1', 'uci.edu');
+ ga('send', 'pageview');</script>
+
+ </head>
+ <body class="topBarDisabled">
+
+
+
+
+ <div class="container-fluid">
+ <div id="banner">
+ <div class="pull-left">
+ <a href="http://asterixdb.apache.org/" id="bannerLeft">
+ <img src="../images/asterixlogo.png" alt="AsterixDB"/>
+ </a>
+ </div>
+ <div class="pull-right"> </div>
+ <div class="clear"><hr/></div>
+ </div>
+
+ <div id="breadcrumbs">
+ <ul class="breadcrumb">
+
+
+ <li id="publishDate">Last Published: 2016-03-25</li>
+
+
+
+ <li id="projectVersion" class="pull-right">Version: 0.8.8-incubating</li>
+
+ <li class="divider pull-right">|</li>
+
+ <li class="pull-right"> <a href="../index.html" title="Documentation Home">
+ Documentation Home</a>
+ </li>
+
+ </ul>
+ </div>
+
+
+ <div class="row-fluid">
+ <div id="leftColumn" class="span3">
+ <div class="well sidebar-nav">
+
+
+ <ul class="nav nav-list">
+ <li class="nav-header">Documentation</li>
+
+ <li>
+
+ <a href="../install.html" title="Installing and Managing AsterixDB using Managix">
+ <i class="none"></i>
+ Installing and Managing AsterixDB using Managix</a>
+ </li>
+
+ <li>
+
+ <a href="../yarn.html" title="Deploying AsterixDB using YARN">
+ <i class="none"></i>
+ Deploying AsterixDB using YARN</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/primer.html" title="AsterixDB 101: An ADM and AQL Primer">
+ <i class="none"></i>
+ AsterixDB 101: An ADM and AQL Primer</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/primer-sql-like.html" title="AsterixDB 101: An ADM and AQL Primer (For SQL Fans)">
+ <i class="none"></i>
+ AsterixDB 101: An ADM and AQL Primer (For SQL Fans)</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/js-sdk.html" title="AsterixDB Javascript SDK">
+ <i class="none"></i>
+ AsterixDB Javascript SDK</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/datamodel.html" title="Asterix Data Model (ADM)">
+ <i class="none"></i>
+ Asterix Data Model (ADM)</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/manual.html" title="Asterix Query Language (AQL)">
+ <i class="none"></i>
+ Asterix Query Language (AQL)</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/functions.html" title="AQL Functions">
+ <i class="none"></i>
+ AQL Functions</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/allens.html" title="AQL Allen's Relations Functions">
+ <i class="none"></i>
+ AQL Allen's Relations Functions</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/similarity.html" title="AQL Support of Similarity Queries">
+ <i class="none"></i>
+ AQL Support of Similarity Queries</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/externaldata.html" title="Accessing External Data">
+ <i class="none"></i>
+ Accessing External Data</a>
+ </li>
+
+ <li class="active">
+
+ <a href="#"><i class="none"></i>Support for Data Ingestion in AsterixDB</a>
+ </li>
+
+ <li>
+
+ <a href="../udf.html" title="Support for User Defined Functions in AsterixDB">
+ <i class="none"></i>
+ Support for User Defined Functions in AsterixDB</a>
+ </li>
+
+ <li>
+
+ <a href="../aql/filters.html" title="Filter-Based LSM Index Acceleration">
+ <i class="none"></i>
+ Filter-Based LSM Index Acceleration</a>
+ </li>
+
+ <li>
+
+ <a href="../api.html" title="HTTP API to AsterixDB">
+ <i class="none"></i>
+ HTTP API to AsterixDB</a>
+ </li>
+ </ul>
+
+
+
+ <hr class="divider" />
+
+ <div id="poweredBy">
+ <div class="clear"></div>
+ <div class="clear"></div>
+ <div class="clear"></div>
+ <a href="https://code.google.com/p/hyracks/" title="Hyracks" class="builtBy">
+ <img class="builtBy" alt="Hyracks" src="../images/hyrax_ts.png" />
+ </a>
+ </div>
+ </div>
+ </div>
+
+
+ <div id="bodyColumn" class="span9" >
+
+ <!-- ! Licensed to the Apache Software Foundation (ASF) under one
+ ! or more contributor license agreements. See the NOTICE file
+ ! distributed with this work for additional information
+ ! regarding copyright ownership. The ASF licenses this file
+ ! to you under the Apache License, Version 2.0 (the
+ ! "License"); you may not use this file except in compliance
+ ! with the License. You may obtain a copy of the License at
+ !
+ ! http://www.apache.org/licenses/LICENSE-2.0
+ !
+ ! Unless required by applicable law or agreed to in writing,
+ ! software distributed under the License is distributed on an
+ ! "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ ! KIND, either express or implied. See the License for the
+ ! specific language governing permissions and limitations
+ ! under the License.
+ ! --><h1>Support for Data Ingestion in AsterixDB</h1>
+<div class="section">
+<h2><a name="Table_of_Contents"></a><a name="atoc" id="#toc">Table of Contents</a></h2>
+
+<ul>
+
+<li><a href="#Introduction">Introduction</a></li>
+
+<li><a href="#FeedAdaptors">Feed Adaptors</a></li>
+
+<li><a href="#FeedPolicies">Feed Policies</a></li>
+</ul></div>
+<div class="section">
+<h2><a name="Introduction">Introduction</a></h2>
+<p>In this document, we describe the support for data ingestion in AsterixDB. Data feeds are a new mechanism for having continuous data arrive into a BDMS from external sources and incrementally populate a persisted dataset and associated indexes. We add a new BDMS architectural component, called a data feed, that makes a Big Data system the caretaker for functionality that used to live outside, and we show how it improves users’ lives and system performance.</p></div>
+<div class="section">
+<h2><a name="Feed_Adaptors"></a><a name="FeedAdaptors">Feed Adaptors</a></h2>
+<p>The functionality of establishing a connection with a data source and receiving, parsing and translating its data into ADM records (for storage inside AsterixDB) is contained in a feed adaptor. A feed adaptor is an implementation of an interface and its details are specific to a given data source. An adaptor may optionally be given parameters to configure its runtime behavior. Depending upon the data transfer protocol/APIs offered by the data source, a feed adaptor may operate in a push or a pull mode. Push mode involves just one initial request by the adaptor to the data source for setting up the connection. Once a connection is authorized, the data source “pushes” data to the adaptor without any subsequent requests by the adaptor. In contrast, when operating in a pull mode, the adaptor makes a separate request each time to receive data. AsterixDB currently provides built-in adaptors for several popular data sources such as Twitter, CNN, and RSS feeds. AsterixDB ad
ditionally provides a generic socket-based adaptor that can be used to ingest data that is directed at a prescribed socket.</p>
+<p>In this tutorial, we shall describe building two example data ingestion pipelines that cover the popular scenario of ingesting data from (a) Twitter and (b) RSS Feed source.</p>
+<div class="section">
+<div class="section">
+<h4><a name="Ingesting_Twitter_Stream"></a>Ingesting Twitter Stream</h4>
+<p>We shall use the built-in push-based Twitter adaptor. As a pre-requisite, we must define a Tweet using the AsterixDB Data Model (ADM) and the AsterixDB Query Language (AQL). Given below are the type definition in AQL that create a Tweet datatype which is representative of a real tweet as obtained from Twitter.</p>
+
+<div class="source">
+<div class="source">
+<pre> create dataverse feeds;
+ use dataverse feeds;
+
+ create type TwitterUser if not exists as open{
+ screen_name: string,
+ language: string,
+ friends_count: int32,
+ status_count: int32,
+ name: string,
+ followers_count: int32
+ };
+ create type Tweet if not exists as open{
+ id: string,
+ user: TwitterUser,
+ latitude:double,
+ longitude:double,
+ created_at:string,
+ message_text:string
+ };
+
+ create dataset Tweets (Tweet)
+ primary key id;
+</pre></div></div>
+<p>We also create a dataset that we shall use to persist the tweets in AsterixDB. Next we make use of the <tt>create feed</tt> AQL statement to define our example data feed.</p>
+<div class="section">
+<h5><a name="Using_the_push_twitter_feed_adapter"></a>Using the “push_twitter” feed adapter</h5>
+<p>The “push_twitter” adaptor requires setting up an application account with Twitter. To retrieve tweets, Twitter requires registering an application with Twitter. Registration involves providing a name and a brief description for the application. Each application has an associated OAuth authentication credential that includes OAuth keys and tokens. Accessing the Twitter API requires providing the following. 1. Consumer Key (API Key) 2. Consumer Secret (API Secret) 3. Access Token 4. Access Token Secret</p>
+<p>The “push_twitter” adaptor takes as configuration the above mentioned parameters. End users are required to obtain the above authentication credentials prior to using the “push_twitter” adaptor. For further information on obtaining OAuth keys and tokens and registering an application with Twitter, please visit <a class="externalLink" href="http://apps.twitter.com">http://apps.twitter.com</a></p>
+<p>Given below is an example AQL statement that creates a feed called “TwitterFeed” by using the “push_twitter” adaptor.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ create feed TwitterFeed if not exists using "push_twitter"
+ (("type-name"="Tweet"),
+ ("consumer.key"="************"),
+ ("consumer.secret"="**************"),
+ ("access.token"="**********"),
+ ("access.token.secret"="*************"));
+</pre></div></div>
+<p>It is required that the above authentication parameters are provided valid values. Note that the <tt>create feed</tt> statement does not initiate the flow of data from Twitter into our AsterixDB instance. Instead, the <tt>create feed</tt> statement only results in registering the feed with AsterixDB. The flow of data along a feed is initiated when it is connected to a target dataset using the connect feed statement (which we shall revisit later).</p></div></div>
+<div class="section">
+<h4><a name="Lifecycle_of_a_Feed"></a>Lifecycle of a Feed</h4>
+<p>A feed is a logical artifact that is brought to life (i.e., its data flow is initiated) only when it is connected to a dataset using the <tt>connect
+feed</tt> AQL statement. Subsequent to a <tt>connect feed</tt> statement, the feed is said to be in the connected state. Multiple feeds can simultaneously be connected to a dataset such that the contents of the dataset represent the union of the connected feeds. In a supported but unlikely scenario, one feed may also be simultaneously connected to different target datasets. Note that connecting a secondary feed does not require the parent feed (or any ancestor feed) to be in the connected state; the order in which feeds are connected to their respective datasets is not important. Furthermore, additional (secondary) feeds can be added to an existing hierarchy and connected to a dataset at any time without impeding/interrupting the flow of data along a connected ancestor feed.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ connect feed TwitterFeed to dataset Tweets;
+</pre></div></div>
+<p>The <tt>connect feed</tt> statement above directs AsterixDB to persist the <tt>TwitterFeed</tt> feed in the <tt>Tweets</tt> dataset. If it is required (by the high-level application) to also retain the raw tweets obtained from Twitter, the end user may additionally choose to connect TwitterFeed to a different dataset.</p>
+<p>Let the feed run for a minute, then run the following query to see the latest tweets that are stored into the data set.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ for $i in dataset Tweets limit 10 return $i;
+</pre></div></div>
+<p>The flow of data from a feed into a dataset can be terminated explicitly by use of the <tt>disconnect feed</tt> statement. Disconnecting a feed from a particular dataset does not interrupt the flow of data from the feed to any other dataset(s), nor does it impact other connected feeds in the lineage.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ disconnect feed TwitterFeed from dataset Tweets;
+</pre></div></div></div>
+<div class="section">
+<h4><a name="Ingesting_an_RSS_Feed"></a>Ingesting an RSS Feed</h4>
+<p>RSS (Rich Site Summary), originally RDF Site Summary and often called Really Simple Syndication, uses a family of standard web feed formats to publish frequently updated information: blog entries, news headlines, audio, video. An RSS document (called “feed”, “web feed”, or “channel”) includes full or summarized text, and metadata, like publishing date and author’s name. RSS feeds enable publishers to syndicate data automatically.</p>
+<div class="section">
+<h5><a name="Using_the_rss_feed_feed_adapter"></a>Using the “rss_feed” feed adapter</h5>
+<p>AsterixDB provides a built-in feed adaptor that allows retrieving data given a collection of RSS end point URLs. As observed in the case of ingesting tweets, it is required to model an RSS data item using AQL.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ create type Rss if not exists as open {
+ id: string,
+ title: string,
+ description: string,
+ link: string
+ };
+
+ create dataset RssDataset (Rss)
+ primary key id;
+</pre></div></div>
+<p>Next, we define an RSS feed using our built-in adaptor “rss_feed”.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ create feed my_feed using
+ rss_feed (
+ ("type-name"="Rss"),
+ ("url"="http://rss.cnn.com/rss/edition.rss")
+ );
+</pre></div></div>
+<p>In the above definition, the configuration parameter “url” can be a comma-separated list that reflects a collection of RSS URLs, where each URL corresponds to an RSS endpoint or a RSS feed. The “rss_adaptor” retrieves data from each of the specified RSS URLs (comma separated values) in parallel.</p>
+<p>The following statements connect the feed into the <tt>RssDataset</tt>:</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ connect feed my_feed to dataset RssDataset;
+</pre></div></div>
+<p>The following statements show the latest data from the data set, and disconnect the feed from the data set.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ for $i in dataset RssDataset limit 10 return $i;
+
+ disconnect feed my_feed from dataset RssDataset;
+</pre></div></div>
+<p>AsterixDB also allows multiple feeds to be connected to form a cascade network to process data.</p></div></div></div></div>
+<div class="section">
+<h2><a name="Policies_for_Feed_Ingestion"></a><a name="FeedPolicies">Policies for Feed Ingestion</a></h2>
+<p>Multiple feeds may be concurrently operational on an AsterixDB cluster, each competing for resources (CPU cycles, network bandwidth, disk IO) to maintain pace with their respective data sources. As a data management system, AsterixDB is able to manage a set of concurrent feeds and make dynamic decisions related to the allocation of resources, resolving resource bottlenecks and the handling of failures. Each feed has its own set of constraints, influenced largely by the nature of its data source and the applications that intend to consume and process the ingested data. Consider an application that intends to discover the trending topics on Twitter by analyzing tweets that are being processed. Losing a few tweets may be acceptable. In contrast, when ingesting from a data source that provides a click-stream of ad clicks, losing data would translate to a loss of revenue for an application that tracks revenue by charging advertisers per click.</p>
+<p>AsterixDB allows a data feed to have an associated ingestion policy that is expressed as a collection of parameters and associated values. An ingestion policy dictates the runtime behavior of the feed in response to resource bottlenecks and failures. AsterixDB provides a list of policy parameters that help customize the system’s runtime behavior when handling excess records. AsterixDB provides a set of built-in policies, each constructed by setting appropriate value(s) for the policy parameter(s) from the table below.</p>
+<div class="section">
+<div class="section">
+<h4><a name="Policy_Parameters"></a>Policy Parameters</h4>
+
+<ul>
+
+<li>
+<p><i>excess.records.spill</i>: Set to true if records that cannot be processed by an operator for lack of resources (referred to as excess records hereafter) should be persisted to the local disk for deferred processing. (Default: false)</p></li>
+
+<li>
+<p><i>excess.records.discard</i>: Set to true if excess records should be discarded. (Default: false)</p></li>
+
+<li>
+<p><i>excess.records.throttle</i>: Set to true if rate of arrival of records is required to be reduced in an adaptive manner to prevent having any excess records (Default: false)</p></li>
+
+<li>
+<p><i>excess.records.elastic</i>: Set to true if the system should attempt to resolve resource bottlenecks by re-structuring and/or rescheduling the feed ingestion pipeline. (Default: false)</p></li>
+
+<li>
+<p><i>recover.soft.failure</i>: Set to true if the feed must attempt to survive any runtime exception. A false value permits an early termination of a feed in such an event. (Default: true)</p></li>
+
+<li>
+<p><i>recover.soft.failure</i>: Set to true if the feed must attempt to survive a hardware failures (loss of AsterixDB node(s)). A false value permits the early termination of a feed in the event of a hardware failure (Default: false)</p></li>
+</ul>
+<p>Note that the end user may choose to form a custom policy. For example, it is possible in AsterixDB to create a custom policy that spills excess records to disk and subsequently resorts to throttling if the spillage crosses a configured threshold. In all cases, the desired ingestion policy is specified as part of the <tt>connect feed</tt> statement or else the “Basic” policy will be chosen as the default. It is worth noting that a feed can be connected to a dataset at any time, which is independent from other related feeds in the hierarchy.</p>
+
+<div class="source">
+<div class="source">
+<pre> use dataverse feeds;
+
+ connect feed TwitterFeed to dataset Tweets
+ using policy Basic ;
+</pre></div></div></div></div></div>
+ </div>
+ </div>
+ </div>
+
+ <hr/>
+
+ <footer>
+ <div class="container-fluid">
+ <div class="row span12">Copyright © 2016
+ <a href="http://www.apache.org/">The Apache Software Foundation</a>.
+ All Rights Reserved.
+
+ </div>
+
+ <?xml version="1.0" encoding="UTF-8"?>
+<div class="row-fluid">Apache AsterixDB, AsterixDB, Apache, the Apache
+ feather logo, and the Apache AsterixDB project logo are either
+ registered trademarks or trademarks of The Apache Software
+ Foundation in the United States and other countries.
+ All other marks mentioned may be trademarks or registered
+ trademarks of their respective owners.</div>
+
+
+ </div>
+ </footer>
+ </body>
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/AsterixCluster.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/AsterixCluster.png b/docs/0.8.8-incubating/images/AsterixCluster.png
new file mode 100644
index 0000000..a16ee26
Binary files /dev/null and b/docs/0.8.8-incubating/images/AsterixCluster.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/accessories-text-editor.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/accessories-text-editor.png b/docs/0.8.8-incubating/images/accessories-text-editor.png
new file mode 100644
index 0000000..abc3366
Binary files /dev/null and b/docs/0.8.8-incubating/images/accessories-text-editor.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/add.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/add.gif b/docs/0.8.8-incubating/images/add.gif
new file mode 100644
index 0000000..1cb3dbf
Binary files /dev/null and b/docs/0.8.8-incubating/images/add.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/apache-maven-project-2.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/apache-maven-project-2.png b/docs/0.8.8-incubating/images/apache-maven-project-2.png
new file mode 100644
index 0000000..6c096ec
Binary files /dev/null and b/docs/0.8.8-incubating/images/apache-maven-project-2.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/application-certificate.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/application-certificate.png b/docs/0.8.8-incubating/images/application-certificate.png
new file mode 100644
index 0000000..cc6aff6
Binary files /dev/null and b/docs/0.8.8-incubating/images/application-certificate.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/asf_logo_wide.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/asf_logo_wide.png b/docs/0.8.8-incubating/images/asf_logo_wide.png
new file mode 100644
index 0000000..56a4369
Binary files /dev/null and b/docs/0.8.8-incubating/images/asf_logo_wide.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/asterix_webui.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/asterix_webui.png b/docs/0.8.8-incubating/images/asterix_webui.png
new file mode 100644
index 0000000..27522c4
Binary files /dev/null and b/docs/0.8.8-incubating/images/asterix_webui.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/asterixlogo.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/asterixlogo.png b/docs/0.8.8-incubating/images/asterixlogo.png
new file mode 100644
index 0000000..45cd64f
Binary files /dev/null and b/docs/0.8.8-incubating/images/asterixlogo.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/contact-new.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/contact-new.png b/docs/0.8.8-incubating/images/contact-new.png
new file mode 100644
index 0000000..ebc4316
Binary files /dev/null and b/docs/0.8.8-incubating/images/contact-new.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/document-properties.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/document-properties.png b/docs/0.8.8-incubating/images/document-properties.png
new file mode 100644
index 0000000..34c2409
Binary files /dev/null and b/docs/0.8.8-incubating/images/document-properties.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/drive-harddisk.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/drive-harddisk.png b/docs/0.8.8-incubating/images/drive-harddisk.png
new file mode 100644
index 0000000..d7ce475
Binary files /dev/null and b/docs/0.8.8-incubating/images/drive-harddisk.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/egg-logo.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/egg-logo.png b/docs/0.8.8-incubating/images/egg-logo.png
new file mode 100644
index 0000000..c04e70d
Binary files /dev/null and b/docs/0.8.8-incubating/images/egg-logo.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/fix.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/fix.gif b/docs/0.8.8-incubating/images/fix.gif
new file mode 100644
index 0000000..b7eb3dc
Binary files /dev/null and b/docs/0.8.8-incubating/images/fix.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/hyrax_ts.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/hyrax_ts.png b/docs/0.8.8-incubating/images/hyrax_ts.png
new file mode 100644
index 0000000..001c788
Binary files /dev/null and b/docs/0.8.8-incubating/images/hyrax_ts.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/icon_error_sml.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/icon_error_sml.gif b/docs/0.8.8-incubating/images/icon_error_sml.gif
new file mode 100644
index 0000000..12e9a01
Binary files /dev/null and b/docs/0.8.8-incubating/images/icon_error_sml.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/icon_help_sml.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/icon_help_sml.gif b/docs/0.8.8-incubating/images/icon_help_sml.gif
new file mode 100644
index 0000000..aaf20e6
Binary files /dev/null and b/docs/0.8.8-incubating/images/icon_help_sml.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/icon_info_sml.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/icon_info_sml.gif b/docs/0.8.8-incubating/images/icon_info_sml.gif
new file mode 100644
index 0000000..b776326
Binary files /dev/null and b/docs/0.8.8-incubating/images/icon_info_sml.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/icon_success_sml.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/icon_success_sml.gif b/docs/0.8.8-incubating/images/icon_success_sml.gif
new file mode 100644
index 0000000..0a19527
Binary files /dev/null and b/docs/0.8.8-incubating/images/icon_success_sml.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/icon_warning_sml.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/icon_warning_sml.gif b/docs/0.8.8-incubating/images/icon_warning_sml.gif
new file mode 100644
index 0000000..ac6ad6a
Binary files /dev/null and b/docs/0.8.8-incubating/images/icon_warning_sml.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/image-x-generic.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/image-x-generic.png b/docs/0.8.8-incubating/images/image-x-generic.png
new file mode 100644
index 0000000..ab49efb
Binary files /dev/null and b/docs/0.8.8-incubating/images/image-x-generic.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/internet-web-browser.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/internet-web-browser.png b/docs/0.8.8-incubating/images/internet-web-browser.png
new file mode 100644
index 0000000..307d6ac
Binary files /dev/null and b/docs/0.8.8-incubating/images/internet-web-browser.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/logos/build-by-maven-black.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/logos/build-by-maven-black.png b/docs/0.8.8-incubating/images/logos/build-by-maven-black.png
new file mode 100644
index 0000000..919fd0f
Binary files /dev/null and b/docs/0.8.8-incubating/images/logos/build-by-maven-black.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/logos/build-by-maven-white.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/logos/build-by-maven-white.png b/docs/0.8.8-incubating/images/logos/build-by-maven-white.png
new file mode 100644
index 0000000..7d44c9c
Binary files /dev/null and b/docs/0.8.8-incubating/images/logos/build-by-maven-white.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/logos/maven-feather.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/logos/maven-feather.png b/docs/0.8.8-incubating/images/logos/maven-feather.png
new file mode 100644
index 0000000..b5ada83
Binary files /dev/null and b/docs/0.8.8-incubating/images/logos/maven-feather.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/network-server.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/network-server.png b/docs/0.8.8-incubating/images/network-server.png
new file mode 100644
index 0000000..1d12e19
Binary files /dev/null and b/docs/0.8.8-incubating/images/network-server.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/package-x-generic.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/package-x-generic.png b/docs/0.8.8-incubating/images/package-x-generic.png
new file mode 100644
index 0000000..8b7e9e6
Binary files /dev/null and b/docs/0.8.8-incubating/images/package-x-generic.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/profiles/pre-release.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/profiles/pre-release.png b/docs/0.8.8-incubating/images/profiles/pre-release.png
new file mode 100644
index 0000000..d448e85
Binary files /dev/null and b/docs/0.8.8-incubating/images/profiles/pre-release.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/profiles/retired.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/profiles/retired.png b/docs/0.8.8-incubating/images/profiles/retired.png
new file mode 100644
index 0000000..f89f6a2
Binary files /dev/null and b/docs/0.8.8-incubating/images/profiles/retired.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/profiles/sandbox.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/profiles/sandbox.png b/docs/0.8.8-incubating/images/profiles/sandbox.png
new file mode 100644
index 0000000..f88b362
Binary files /dev/null and b/docs/0.8.8-incubating/images/profiles/sandbox.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/remove.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/remove.gif b/docs/0.8.8-incubating/images/remove.gif
new file mode 100644
index 0000000..fc65631
Binary files /dev/null and b/docs/0.8.8-incubating/images/remove.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/rss.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/rss.png b/docs/0.8.8-incubating/images/rss.png
new file mode 100644
index 0000000..a9850ee
Binary files /dev/null and b/docs/0.8.8-incubating/images/rss.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/running_inst.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/running_inst.png b/docs/0.8.8-incubating/images/running_inst.png
new file mode 100644
index 0000000..66eb03a
Binary files /dev/null and b/docs/0.8.8-incubating/images/running_inst.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/update.gif
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/update.gif b/docs/0.8.8-incubating/images/update.gif
new file mode 100644
index 0000000..b2a6d0b
Binary files /dev/null and b/docs/0.8.8-incubating/images/update.gif differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/window-new.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/window-new.png b/docs/0.8.8-incubating/images/window-new.png
new file mode 100644
index 0000000..0e12ef9
Binary files /dev/null and b/docs/0.8.8-incubating/images/window-new.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/images/yarn_clust.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/images/yarn_clust.png b/docs/0.8.8-incubating/images/yarn_clust.png
new file mode 100644
index 0000000..5e386bc
Binary files /dev/null and b/docs/0.8.8-incubating/images/yarn_clust.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/img/glyphicons-halflings-white.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/img/glyphicons-halflings-white.png b/docs/0.8.8-incubating/img/glyphicons-halflings-white.png
new file mode 100644
index 0000000..3bf6484
Binary files /dev/null and b/docs/0.8.8-incubating/img/glyphicons-halflings-white.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/img/glyphicons-halflings.png
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/img/glyphicons-halflings.png b/docs/0.8.8-incubating/img/glyphicons-halflings.png
new file mode 100644
index 0000000..a996999
Binary files /dev/null and b/docs/0.8.8-incubating/img/glyphicons-halflings.png differ
http://git-wip-us.apache.org/repos/asf/incubator-asterixdb-site/blob/08953b2e/docs/0.8.8-incubating/index.html
----------------------------------------------------------------------
diff --git a/docs/0.8.8-incubating/index.html b/docs/0.8.8-incubating/index.html
new file mode 100644
index 0000000..b01eef2
--- /dev/null
+++ b/docs/0.8.8-incubating/index.html
@@ -0,0 +1,268 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at 2016-03-25
+ | Rendered using Apache Maven Fluido Skin 1.3.0
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+ <head>
+ <meta charset="UTF-8" />
+ <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+ <meta name="Date-Revision-yyyymmdd" content="20160325" />
+ <meta http-equiv="Content-Language" content="en" />
+ <title>AsterixDB – AsterixDB</title>
+ <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" />
+ <link rel="stylesheet" href="./css/site.css" />
+ <link rel="stylesheet" href="./css/print.css" media="print" />
+
+
+ <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script>
+
+
+
+<script>(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-41536543-1', 'uci.edu');
+ ga('send', 'pageview');</script>
+
+ </head>
+ <body class="topBarDisabled">
+
+
+
+
+ <div class="container-fluid">
+ <div id="banner">
+ <div class="pull-left">
+ <a href="http://asterixdb.apache.org/" id="bannerLeft">
+ <img src="images/asterixlogo.png" alt="AsterixDB"/>
+ </a>
+ </div>
+ <div class="pull-right"> </div>
+ <div class="clear"><hr/></div>
+ </div>
+
+ <div id="breadcrumbs">
+ <ul class="breadcrumb">
+
+
+ <li id="publishDate">Last Published: 2016-03-25</li>
+
+
+
+ <li id="projectVersion" class="pull-right">Version: 0.8.8-incubating</li>
+
+ <li class="divider pull-right">|</li>
+
+ <li class="pull-right"> <a href="index.html" title="Documentation Home">
+ Documentation Home</a>
+ </li>
+
+ </ul>
+ </div>
+
+
+ <div class="row-fluid">
+ <div id="leftColumn" class="span3">
+ <div class="well sidebar-nav">
+
+
+ <ul class="nav nav-list">
+ <li class="nav-header">Documentation</li>
+
+ <li>
+
+ <a href="install.html" title="Installing and Managing AsterixDB using Managix">
+ <i class="none"></i>
+ Installing and Managing AsterixDB using Managix</a>
+ </li>
+
+ <li>
+
+ <a href="yarn.html" title="Deploying AsterixDB using YARN">
+ <i class="none"></i>
+ Deploying AsterixDB using YARN</a>
+ </li>
+
+ <li>
+
+ <a href="aql/primer.html" title="AsterixDB 101: An ADM and AQL Primer">
+ <i class="none"></i>
+ AsterixDB 101: An ADM and AQL Primer</a>
+ </li>
+
+ <li>
+
+ <a href="aql/primer-sql-like.html" title="AsterixDB 101: An ADM and AQL Primer (For SQL Fans)">
+ <i class="none"></i>
+ AsterixDB 101: An ADM and AQL Primer (For SQL Fans)</a>
+ </li>
+
+ <li>
+
+ <a href="aql/js-sdk.html" title="AsterixDB Javascript SDK">
+ <i class="none"></i>
+ AsterixDB Javascript SDK</a>
+ </li>
+
+ <li>
+
+ <a href="aql/datamodel.html" title="Asterix Data Model (ADM)">
+ <i class="none"></i>
+ Asterix Data Model (ADM)</a>
+ </li>
+
+ <li>
+
+ <a href="aql/manual.html" title="Asterix Query Language (AQL)">
+ <i class="none"></i>
+ Asterix Query Language (AQL)</a>
+ </li>
+
+ <li>
+
+ <a href="aql/functions.html" title="AQL Functions">
+ <i class="none"></i>
+ AQL Functions</a>
+ </li>
+
+ <li>
+
+ <a href="aql/allens.html" title="AQL Allen's Relations Functions">
+ <i class="none"></i>
+ AQL Allen's Relations Functions</a>
+ </li>
+
+ <li>
+
+ <a href="aql/similarity.html" title="AQL Support of Similarity Queries">
+ <i class="none"></i>
+ AQL Support of Similarity Queries</a>
+ </li>
+
+ <li>
+
+ <a href="aql/externaldata.html" title="Accessing External Data">
+ <i class="none"></i>
+ Accessing External Data</a>
+ </li>
+
+ <li>
+
+ <a href="feeds/tutorial.html" title="Support for Data Ingestion in AsterixDB">
+ <i class="none"></i>
+ Support for Data Ingestion in AsterixDB</a>
+ </li>
+
+ <li>
+
+ <a href="udf.html" title="Support for User Defined Functions in AsterixDB">
+ <i class="none"></i>
+ Support for User Defined Functions in AsterixDB</a>
+ </li>
+
+ <li>
+
+ <a href="aql/filters.html" title="Filter-Based LSM Index Acceleration">
+ <i class="none"></i>
+ Filter-Based LSM Index Acceleration</a>
+ </li>
+
+ <li>
+
+ <a href="api.html" title="HTTP API to AsterixDB">
+ <i class="none"></i>
+ HTTP API to AsterixDB</a>
+ </li>
+ </ul>
+
+
+
+ <hr class="divider" />
+
+ <div id="poweredBy">
+ <div class="clear"></div>
+ <div class="clear"></div>
+ <div class="clear"></div>
+ <a href="https://code.google.com/p/hyracks/" title="Hyracks" class="builtBy">
+ <img class="builtBy" alt="Hyracks" src="images/hyrax_ts.png" />
+ </a>
+ </div>
+ </div>
+ </div>
+
+
+ <div id="bodyColumn" class="span9" >
+
+ <!-- ! Licensed to the Apache Software Foundation (ASF) under one
+ ! or more contributor license agreements. See the NOTICE file
+ ! distributed with this work for additional information
+ ! regarding copyright ownership. The ASF licenses this file
+ ! to you under the Apache License, Version 2.0 (the
+ ! "License"); you may not use this file except in compliance
+ ! with the License. You may obtain a copy of the License at
+ !
+ ! http://www.apache.org/licenses/LICENSE-2.0
+ !
+ ! Unless required by applicable law or agreed to in writing,
+ ! software distributed under the License is distributed on an
+ ! "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ ! KIND, either express or implied. See the License for the
+ ! specific language governing permissions and limitations
+ ! under the License.
+ ! --><h1>AsterixDB</h1>
+<p>AsterixDB is a BDMS (Big Data Management System) with a rich feature set that sets it apart from other Big Data platforms. Its feature set makes it well-suited to modern needs such as web data warehousing and social data storage and analysis. AsterixDB has:</p>
+
+<ul>
+
+<li>A semistructured NoSQL style data model (ADM) resulting from extending JSON with object database ideas</li>
+
+<li>An expressive and declarative query language (AQL) that supports a broad range of queries and analysis over semistructured data</li>
+
+<li>A parallel runtime query execution engine, Hyracks, that has been scale-tested on up to 1000+ cores and 500+ disks</li>
+
+<li>Partitioned LSM-based data storage and indexing to support efficient ingestion and management of semistructured data</li>
+
+<li>Support for query access to externally stored data (e.g., data in HDFS) as well as to data stored natively by AsterixDB</li>
+
+<li>A rich set of primitive data types, including spatial and temporal data in addition to integer, floating point, and textual data</li>
+
+<li>Secondary indexing options that include B+ trees, R trees, and inverted keyword (exact and fuzzy) index types</li>
+
+<li>Support for fuzzy and spatial queries as well as for more traditional parametric queries</li>
+
+<li>Basic transactional (concurrency and recovery) capabilities akin to those of a NoSQL store</li>
+</ul>
+<div class="section">
+<div class="section">
+<h3><a name="Disclaimer"></a>Disclaimer</h3>
+<p>Apache AsterixDB is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.</p></div></div>
+ </div>
+ </div>
+ </div>
+
+ <hr/>
+
+ <footer>
+ <div class="container-fluid">
+ <div class="row span12">Copyright © 2016
+ <a href="http://www.apache.org/">The Apache Software Foundation</a>.
+ All Rights Reserved.
+
+ </div>
+
+ <?xml version="1.0" encoding="UTF-8"?>
+<div class="row-fluid">Apache AsterixDB, AsterixDB, Apache, the Apache
+ feather logo, and the Apache AsterixDB project logo are either
+ registered trademarks or trademarks of The Apache Software
+ Foundation in the United States and other countries.
+ All other marks mentioned may be trademarks or registered
+ trademarks of their respective owners.</div>
+
+
+ </div>
+ </footer>
+ </body>
+</html>