You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by ad...@apache.org on 2015/02/26 02:16:45 UTC
svn commit: r1662344 [1/8] - in /drill/site/trunk/content/drill: ./
blog/2014/12/11/apache-drill-qa-panelist-spotlight/ docs/
docs/2014-q1-drill-report/ docs/advanced-properties/
docs/analyzing-yelp-json-data-with-apache-drill/ docs/apache-drill-0-6-0-...
Author: adi
Date: Thu Feb 26 01:16:43 2015
New Revision: 1662344
URL: http://svn.apache.org/r1662344
Log:
DRILL-2315: Confluence conversion plus fixes (for Kristine Hahn)
Added:
drill/site/trunk/content/drill/README.md
drill/site/trunk/content/drill/docs/advanced-properties/
drill/site/trunk/content/drill/docs/advanced-properties/index.html
drill/site/trunk/content/drill/docs/apache-drill-contribution-ideas/
drill/site/trunk/content/drill/docs/apache-drill-contribution-ideas/index.html
drill/site/trunk/content/drill/docs/configuring-odbc-connections-for-linux-and-mac-os-x/
drill/site/trunk/content/drill/docs/configuring-odbc-connections-for-linux-and-mac-os-x/index.html
drill/site/trunk/content/drill/docs/drill-patch-review-tool/
drill/site/trunk/content/drill/docs/drill-patch-review-tool/index.html
drill/site/trunk/content/drill/docs/driver-configuration-options/
drill/site/trunk/content/drill/docs/driver-configuration-options/index.html
drill/site/trunk/content/drill/docs/img/58.png (with props)
drill/site/trunk/content/drill/docs/img/BI_to_Drill_2.png (with props)
drill/site/trunk/content/drill/docs/img/HbaseViewCreation0.png (with props)
drill/site/trunk/content/drill/docs/img/HbaseViewDSN.png (with props)
drill/site/trunk/content/drill/docs/img/Hbase_Browse.png (with props)
drill/site/trunk/content/drill/docs/img/Hive_DSN.png (with props)
drill/site/trunk/content/drill/docs/img/ODBC_CustomSQL.png (with props)
drill/site/trunk/content/drill/docs/img/ODBC_HbasePreview2.png (with props)
drill/site/trunk/content/drill/docs/img/ODBC_HbaseView.png (with props)
drill/site/trunk/content/drill/docs/img/ODBC_HiveConnection.png (with props)
drill/site/trunk/content/drill/docs/img/ODBC_to_Drillbit.png (with props)
drill/site/trunk/content/drill/docs/img/ODBC_to_Quorum.png (with props)
drill/site/trunk/content/drill/docs/img/Parquet_DSN.png (with props)
drill/site/trunk/content/drill/docs/img/Parquet_Preview.png (with props)
drill/site/trunk/content/drill/docs/img/RegionParquet_table.png (with props)
drill/site/trunk/content/drill/docs/img/SelectHbaseView.png (with props)
drill/site/trunk/content/drill/docs/img/Untitled.png (with props)
drill/site/trunk/content/drill/docs/img/VoterContributions_hbaseview.png (with props)
drill/site/trunk/content/drill/docs/img/ngram_plugin.png (with props)
drill/site/trunk/content/drill/docs/img/ngram_plugin2.png (with props)
drill/site/trunk/content/drill/docs/img/settings.png (with props)
drill/site/trunk/content/drill/docs/img/student_hive.png (with props)
drill/site/trunk/content/drill/docs/installing-the-mapr-drill-odbc-driver-on-linux/
drill/site/trunk/content/drill/docs/installing-the-mapr-drill-odbc-driver-on-linux/index.html
drill/site/trunk/content/drill/docs/installing-the-mapr-drill-odbc-driver-on-mac-os-x/
drill/site/trunk/content/drill/docs/installing-the-mapr-drill-odbc-driver-on-mac-os-x/index.html
drill/site/trunk/content/drill/docs/odbc-jdbc-interfaces/
drill/site/trunk/content/drill/docs/odbc-jdbc-interfaces/index.html
drill/site/trunk/content/drill/docs/reserved-keywords/
drill/site/trunk/content/drill/docs/reserved-keywords/index.html
drill/site/trunk/content/drill/docs/sql-reference/
drill/site/trunk/content/drill/docs/sql-reference/index.html
drill/site/trunk/content/drill/docs/step-1-install-the-mapr-drill-odbc-driver-on-windows/
drill/site/trunk/content/drill/docs/step-1-install-the-mapr-drill-odbc-driver-on-windows/index.html
drill/site/trunk/content/drill/docs/step-2-configure-odbc-connections-to-drill-data-sources/
drill/site/trunk/content/drill/docs/step-2-configure-odbc-connections-to-drill-data-sources/index.html
drill/site/trunk/content/drill/docs/step-3-connect-to-drill-data-sources-from-a-bi-tool/
drill/site/trunk/content/drill/docs/step-3-connect-to-drill-data-sources-from-a-bi-tool/index.html
drill/site/trunk/content/drill/docs/tableau-examples/
drill/site/trunk/content/drill/docs/tableau-examples/index.html
drill/site/trunk/content/drill/docs/testing-the-odbc-connection-on-linux-and-mac-os-x/
drill/site/trunk/content/drill/docs/testing-the-odbc-connection-on-linux-and-mac-os-x/index.html
drill/site/trunk/content/drill/docs/using-drill-explorer-to-browse-data-and-create-views/
drill/site/trunk/content/drill/docs/using-drill-explorer-to-browse-data-and-create-views/index.html
drill/site/trunk/content/drill/docs/using-the-jdbc-driver/
drill/site/trunk/content/drill/docs/using-the-jdbc-driver/index.html
drill/site/trunk/content/drill/docs/using-the-mapr-odbc-driver-on-linux-and-mac-os-x/
drill/site/trunk/content/drill/docs/using-the-mapr-odbc-driver-on-linux-and-mac-os-x/index.html
drill/site/trunk/content/drill/docs/using-the-mapr-odbc-driver-on-windows/
drill/site/trunk/content/drill/docs/using-the-mapr-odbc-driver-on-windows/index.html
drill/site/trunk/content/drill/docs/what-is-apache-drill/
drill/site/trunk/content/drill/docs/what-is-apache-drill/index.html
Modified:
drill/site/trunk/content/drill/blog/2014/12/11/apache-drill-qa-panelist-spotlight/index.html
drill/site/trunk/content/drill/docs/2014-q1-drill-report/index.html
drill/site/trunk/content/drill/docs/analyzing-yelp-json-data-with-apache-drill/index.html
drill/site/trunk/content/drill/docs/apache-drill-0-6-0-release-notes-apache-drill-alpha/index.html
drill/site/trunk/content/drill/docs/apache-drill-contribution-guidelines/index.html
drill/site/trunk/content/drill/docs/apache-drill-in-10-minutes/index.html
drill/site/trunk/content/drill/docs/apache-drill-m1-release-notes-apache-drill-alpha/index.html
drill/site/trunk/content/drill/docs/apache-drill-tutorial/index.html
drill/site/trunk/content/drill/docs/architectural-highlights/index.html
drill/site/trunk/content/drill/docs/architectural-overview/index.html
drill/site/trunk/content/drill/docs/compiling-drill-from-source/index.html
drill/site/trunk/content/drill/docs/configuration-options/index.html
drill/site/trunk/content/drill/docs/connect-to-data-sources/index.html
drill/site/trunk/content/drill/docs/contribute-to-drill/index.html
drill/site/trunk/content/drill/docs/core-modules-within-a-drillbit/index.html
drill/site/trunk/content/drill/docs/custom-function-interfaces/index.html
drill/site/trunk/content/drill/docs/data-types/index.html
drill/site/trunk/content/drill/docs/deploying-apache-drill-in-a-clustered-environment/index.html
drill/site/trunk/content/drill/docs/design-docs/index.html
drill/site/trunk/content/drill/docs/develop-a-simple-function/index.html
drill/site/trunk/content/drill/docs/develop-custom-functions/index.html
drill/site/trunk/content/drill/docs/develop-drill/index.html
drill/site/trunk/content/drill/docs/developing-an-aggregate-function/index.html
drill/site/trunk/content/drill/docs/drill-default-input-format/index.html
drill/site/trunk/content/drill/docs/drill-plan-syntax/index.html
drill/site/trunk/content/drill/docs/enron-emails/index.html
drill/site/trunk/content/drill/docs/explain-commands/index.html
drill/site/trunk/content/drill/docs/flatten-function/index.html
drill/site/trunk/content/drill/docs/flexibility/index.html
drill/site/trunk/content/drill/docs/getting-to-know-the-drill-sandbox/index.html
drill/site/trunk/content/drill/docs/how-to-run-the-drill-demo/index.html
drill/site/trunk/content/drill/docs/index.html
drill/site/trunk/content/drill/docs/install-drill/index.html
drill/site/trunk/content/drill/docs/installing-drill-in-distributed-mode/index.html
drill/site/trunk/content/drill/docs/installing-drill-in-embedded-mode/index.html
drill/site/trunk/content/drill/docs/installing-drill-on-linux/index.html
drill/site/trunk/content/drill/docs/installing-drill-on-mac-os-x/index.html
drill/site/trunk/content/drill/docs/installing-drill-on-windows/index.html
drill/site/trunk/content/drill/docs/installing-the-apache-drill-sandbox/index.html
drill/site/trunk/content/drill/docs/installing-the-mapr-sandbox-with-apache-drill-on-virtualbox/index.html
drill/site/trunk/content/drill/docs/installing-the-mapr-sandbox-with-apache-drill-on-vmware-player-vmware-fusion/index.html
drill/site/trunk/content/drill/docs/kvgen-function/index.html
drill/site/trunk/content/drill/docs/lession-1-learn-about-the-data-set/index.html
drill/site/trunk/content/drill/docs/lession-2-run-queries-with-ansi-sql/index.html
drill/site/trunk/content/drill/docs/lession-3-run-queries-on-complex-data-types/index.html
drill/site/trunk/content/drill/docs/manage-drill/index.html
drill/site/trunk/content/drill/docs/mapr-db-plugin-for-apache-drill/index.html
drill/site/trunk/content/drill/docs/memory-allocation/index.html
drill/site/trunk/content/drill/docs/mongodb-plugin-for-apache-drill/index.html
drill/site/trunk/content/drill/docs/monitoring-and-canceling-queries-in-the-drill-web-ui/index.html
drill/site/trunk/content/drill/docs/nested-data-functions/index.html
drill/site/trunk/content/drill/docs/operators/index.html
drill/site/trunk/content/drill/docs/partition-pruning/index.html
drill/site/trunk/content/drill/docs/performance/index.html
drill/site/trunk/content/drill/docs/persistent-configuration-storage/index.html
drill/site/trunk/content/drill/docs/planning-and-execution-options/index.html
drill/site/trunk/content/drill/docs/ports-used-by-drill/index.html
drill/site/trunk/content/drill/docs/progress-reports/index.html
drill/site/trunk/content/drill/docs/project-bylaws/index.html
drill/site/trunk/content/drill/docs/query-2-using-standard-sql-functions-clauses-and-joins/index.html
drill/site/trunk/content/drill/docs/query-3-selecting-nested-data-for-a-column/index.html
drill/site/trunk/content/drill/docs/query-data/index.html
drill/site/trunk/content/drill/docs/querying-a-file-system/index.html
drill/site/trunk/content/drill/docs/querying-complex-data/index.html
drill/site/trunk/content/drill/docs/querying-hbase/index.html
drill/site/trunk/content/drill/docs/querying-hive/index.html
drill/site/trunk/content/drill/docs/querying-json-files/index.html
drill/site/trunk/content/drill/docs/querying-parquet-files/index.html
drill/site/trunk/content/drill/docs/querying-plain-text-files/index.html
drill/site/trunk/content/drill/docs/querying-system-tables/index.html
drill/site/trunk/content/drill/docs/registering-a-file-system/index.html
drill/site/trunk/content/drill/docs/registering-hbase/index.html
drill/site/trunk/content/drill/docs/registering-hive/index.html
drill/site/trunk/content/drill/docs/release-notes/index.html
drill/site/trunk/content/drill/docs/repeated-count-function/index.html
drill/site/trunk/content/drill/docs/sample-datasets/index.html
drill/site/trunk/content/drill/docs/select-statements/index.html
drill/site/trunk/content/drill/docs/show-files-command/index.html
drill/site/trunk/content/drill/docs/sql-commands-summary/index.html
drill/site/trunk/content/drill/docs/sql-functions/index.html
drill/site/trunk/content/drill/docs/start-up-options/index.html
drill/site/trunk/content/drill/docs/starting-stopping-drill/index.html
drill/site/trunk/content/drill/docs/storage-plugin-registration/index.html
drill/site/trunk/content/drill/docs/summary/index.html
drill/site/trunk/content/drill/docs/supported-date-time-data-type-formats/index.html
drill/site/trunk/content/drill/docs/useful-research/index.html
drill/site/trunk/content/drill/docs/value-vectors/index.html
drill/site/trunk/content/drill/docs/wikipedia-edit-history/index.html
drill/site/trunk/content/drill/docs/workspaces/index.html
drill/site/trunk/content/drill/feed.xml
Added: drill/site/trunk/content/drill/README.md
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/README.md?rev=1662344&view=auto
==============================================================================
--- drill/site/trunk/content/drill/README.md (added)
+++ drill/site/trunk/content/drill/README.md Thu Feb 26 01:16:43 2015
@@ -0,0 +1,34 @@
+The Apache Drill website is built using [Jekyll](http://jekyllrb.com/).
+
+# Developing and Previewing the Website
+
+To preview the website through GitHub Pages: <http://apache.github.io/drill>
+
+To preview the website on your local machine:
+
+```bash
+jekyll serve --config _config.yml,_config-prod.yml
+```
+
+# Compiling the Website
+
+Once the website is ready, you'll need to compile the site to static HTML so that it can then be published to Apache. This is as simple as running the `jekyll build` command. The _config-prod.yml configuration file causes a few changes to the site:
+
+* The `noindex` meta tag is removed. We want the production site to be indexed by search engines, but we don't want the staging site to be indexed.
+* The base URL is set to `/`. The production site is at `/`, whereas the staging site is at `/drill-webiste/`.
+
+```bash
+jekyll build --config _config.yml,_config-prod.yml
+```
+
+# Uploading to the Apache Website (Drill Committers Only)
+
+Apache project websites use a system called svnpubsub for publishing. Basically, the static HTML needs to be pushed by one of the committers into the Apache SVN.
+
+```bash
+svn co https://svn.apache.org/repos/asf/drill/site/trunk/content/drill ../_site-apache
+cp -R _site/* ../_site-apache/
+cd ../_site-apache
+```
+
+Then `svn add` and `svn rm` as needed, and commit the changes via `svn commit -m "Website update"`. Note that once changes are committed via `svn commit`, they will immediately be visible on the live site: <http://drill.apache.org>.
Modified: drill/site/trunk/content/drill/blog/2014/12/11/apache-drill-qa-panelist-spotlight/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/blog/2014/12/11/apache-drill-qa-panelist-spotlight/index.html?rev=1662344&r1=1662343&r2=1662344&view=diff
==============================================================================
--- drill/site/trunk/content/drill/blog/2014/12/11/apache-drill-qa-panelist-spotlight/index.html (original)
+++ drill/site/trunk/content/drill/blog/2014/12/11/apache-drill-qa-panelist-spotlight/index.html Thu Feb 26 01:16:43 2015
@@ -78,9 +78,8 @@
<div class="addthis_sharing_toolbox"></div>
<article class="post-content">
- <script type="text/javascript" src="https://addthisevent.com/libs/1.5.8/ate.min.js"></script>
-
-<p><a href="/blog/2014/12/11/apache-drill-qa-panelist-spotlight/" title="Add to Calendar" class="addthisevent">
+ <p><script type="text/javascript" src="https://addthisevent.com/libs/1.5.8/ate.min.js"></script>
+<a href="/blog/2014/12/11/apache-drill-qa-panelist-spotlight/" title="Add to Calendar" class="addthisevent">
Add to Calendar
<span class="_start">12-17-2014 11:30:00</span>
<span class="_end">12-17-2014 12:30:00</span>
Modified: drill/site/trunk/content/drill/docs/2014-q1-drill-report/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/2014-q1-drill-report/index.html?rev=1662344&r1=1662343&r2=1662344&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/2014-q1-drill-report/index.html (original)
+++ drill/site/trunk/content/drill/docs/2014-q1-drill-report/index.html Thu Feb 26 01:16:43 2015
@@ -73,10 +73,7 @@
<p>Apache Drill is a distributed system for interactive analysis of large-scale
datasets that is based on Google's Dremel. Its goal is to efficiently process
-nested data, scale to 10,000 servers or</p>
-
-<p>more and to be able to process petabyes of data and trillions of records in
-seconds.</p>
+nested data, scale to 10,000 servers or more and to be able to process petabyes of data and trillions of records in seconds.</p>
<p>Drill has been incubating since 2012-08-11.</p>
@@ -110,9 +107,7 @@ HortonWorks and Aman Sinha, MapR Drill e
<p>Additional events include:</p>
-<p>⢠Two new Drill committers accepted appointment:</p>
-
-<p>Julian Hyde (HortonWorks) and Tim Chen (Microsoft).</p>
+<p>⢠Two new Drill committers accepted appointment: Julian Hyde (HortonWorks) and Tim Chen (Microsoft).</p>
<p>⢠Drill has a new project mentor, Sebastian Schelter.</p>
@@ -122,10 +117,7 @@ HortonWorks and Aman Sinha, MapR Drill e
on the user list and 508 uniques across both lists.</p>
<p>There has been active and increasing participation in discussions on the
-developer mailing list, including new participants and</p>
-
-<p>developers. Participation on the user list is growing although still small;
-mainly activity takes place on developer mailing list.</p>
+developer mailing list, including new participants and developers. Participation on the user list is growing although still small; mainly activity takes place on developer mailing list.</p>
<p>Activity summary for the user mailing list:</p>
@@ -149,11 +141,9 @@ mainly activity takes place on developer
<p><a href="http://mail-archives.apache.org/mod_mbox/incubator-drill-dev/">http://mail-archives.apache.org/mod_mbox/incubator-drill-dev/</a></p>
-<p>February to date 02/26/2014: 250 (jira; discussion; review</p>
+<p>February to date 02/26/2014: 250 (jira; discussion; review requests)</p>
-<p>requests)</p>
-
-<p>January2014, 156(jira, focused discussions)</p>
+<p>January 2014, 156(jira, focused discussions)</p>
<p>December 2013, 51 (jira; focused discussions)</p>
@@ -161,13 +151,8 @@ mainly activity takes place on developer
<p>limited to:</p>
-<p>⢠February to date 02/26/2014: How to contribute to Drill;</p>
-
-<p>review requests for Drill 357, 346, 366, 364; status of</p>
-
-<p>Drill functions including Hash functions; support operators</p>
-
-<p>+,- for date and interval arithmetic</p>
+<p>⢠February to date 02/26/2014: How to contribute to Drill;
+review requests for Drill 357, 346, 366, 364; status of Drill functions including Hash functions; support operators +,- for date and interval arithmetic</p>
<p>⢠January: Sql Options discussions, Casting discussions, Multiplex Data
Channel feedbacks</p>
@@ -181,9 +166,7 @@ feedback</p>
<p>There has been continued activity in code commits</p>
-<p>19 contributors have participated in GitHUB code activity; there</p>
-
-<p>have been 116 forks.</p>
+<p>19 contributors have participated in GitHUB code activity; there have been 116 forks.</p>
<p>February code commits include but not limited to: Support for
Information_schema, Hive storage and metastore integration, Optiq JDBC
@@ -197,15 +180,11 @@ allocation to use hierarchical memory al
<p>Community Interactions</p>
<p>Weekly Drill hangout continues, conducted remotely through Google hangouts
-Tuesday mornings 9am Pacific Time to keep</p>
-
-<p>core developers in contact in realtime despite geographical separation.</p>
+Tuesday mornings 9am Pacific Time to keep core developers in contact in realtime despite geographical separation.</p>
<p>Community stays in touch through @ApacheDrill Twitter ID, and by postings on
various blogs including Apache Drill User <a href="http://drill-user.org/">http://drill-user.org/</a> which has
-had several updates and through</p>
-
-<p>international presentations at conferences.</p>
+had several updates and through international presentations at conferences.</p>
<p>Viability of community is also apparent through active participation in the
Bay Area Apache Drill User group meeting in early November, which has grown to
@@ -224,24 +203,18 @@ Apache Drill Meet-up 24 February</p>
<p>Articles</p>
-<p>Examples of articles or reports on Apache Drill since last report</p>
-
-<p>include:</p>
+<p>Examples of articles or reports on Apache Drill since last report include:</p>
<p>⢠Drill blog post by Ellen Friedman at Apache Drill User updating community on
how people will use Drill and inviting comments/ questions from remote
-participants as</p>
-
-<p>part of the Drill User Group <a href="http://bit.ly/1p1Qvgn">http://bit.ly/1p1Qvgn</a></p>
+participants as part of the Drill User Group <a href="http://bit.ly/1p1Qvgn">http://bit.ly/1p1Qvgn</a></p>
<p>⢠Drill blog post by Ellen Friedman at Apache Drill User reports on
appointment of new Drill committers and new mentor <a href="http://bit.ly/JIcwQe">http://bit.ly/JIcwQe</a></p>
<p>Social Networking</p>
-<p>@ApacheDrill Twitter entity is active and has grown substantially</p>
-
-<p>by 19%, to 744 followers.</p>
+<p>@ApacheDrill Twitter entity is active and has grown substantially by 19%, to 744 followers.</p>
<p>How project has developed since last report:</p>
@@ -260,13 +233,12 @@ and commiters</p>
<p>Signed-off-by:</p>
-<p>Ted Dunning: <a href="drill"></a></p>
-
-<p>Grant Ingersoll: <a href="drill"> </a></p>
-
-<p>Isabel Drost: <a href="drill"> </a></p>
-
-<p>Sebastian Schelter: <a href="drill"> </a></p>
+<ul>
+<li>Ted Dunning</li>
+<li>Grant Ingersoll</li>
+<li>Isabel Drost</li>
+<li>Sebastian Schelter</li>
+</ul>
</div>
Added: drill/site/trunk/content/drill/docs/advanced-properties/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/advanced-properties/index.html?rev=1662344&view=auto
==============================================================================
--- drill/site/trunk/content/drill/docs/advanced-properties/index.html (added)
+++ drill/site/trunk/content/drill/docs/advanced-properties/index.html Thu Feb 26 01:16:43 2015
@@ -0,0 +1,105 @@
+<!DOCTYPE html>
+<html>
+
+<head>
+
+<meta charset="UTF-8">
+
+
+<title>Advanced Properties - Apache Drill</title>
+
+<link href="/css/syntax.css" rel="stylesheet" type="text/css">
+<link href="/css/style.css" rel="stylesheet" type="text/css">
+<link href="/css/arrows.css" rel="stylesheet" type="text/css">
+<link href="/css/button.css" rel="stylesheet" type="text/css">
+
+<link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
+<link rel="icon" href="/favicon.ico" type="image/x-icon">
+
+<script language="javascript" type="text/javascript" src="/js/lib/jquery-1.11.1.min.js"></script>
+<script language="javascript" type="text/javascript" src="/js/lib/jquery.easing.1.3.js"></script>
+<script language="javascript" type="text/javascript" src="/js/modernizr.custom.js"></script>
+<script language="javascript" type="text/javascript" src="/js/script.js"></script>
+
+</head>
+
+<body onResize="resized();">
+
+<div class="bui"></div>
+
+<div id="search">
+<input type="text" placeholder="Enter search term here">
+</div>
+
+<div id="menu" class="mw">
+<ul>
+ <li class="logo"><a href="/"></a></li>
+ <li>
+ <a href="/overview/">Documentation</a>
+ <ul>
+ <li><a href="/overview/">Overview </a></li>
+ <li><a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+in+10+Minutes" target="_blank">Drill in 10 Minutes</a></li>
+ <li><a href="/why/">Why Drill? </a></li>
+ <li><a href="/architecture/">Architecture</a></li>
+ </ul>
+ </li>
+ <li>
+ <a href="/community/">Community</a>
+ <ul>
+ <li><a href="/team/">Team</a></li>
+ <li><a href="/community/#events">Events and Meetups</a></li>
+ <li><a href="/community/#mailinglists">Mailing Lists</a></li>
+ <li><a href="/community/#getinvolved">Get Involved</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/DRILL/" target="_blank">Issue Tracker</a></li>
+ <li><a href="https://github.com/apache/drill" target="_blank">GitHub</a></li>
+ </ul>
+ </li>
+ <li><a href="/faq/">FAQ</a></li>
+ <li><a href="/blog/">Blog</a></li>
+ <li style="width:30px; padding-left: 2px; padding-right:10px"><a href="https://twitter.com/apachedrill" target="_blank"><img src="/images/twitterbw.png" alt="" align="center" width="22" style="padding: 0px 10px 1px 0px;"></a> </li>
+ <li class="l"><span> </span></li>
+ <li class="d"><a href="/download/">Download</a></li>
+</ul>
+</div>
+
+<div class="int_title">
+<h1>Advanced Properties</h1>
+
+</div>
+
+<div class="int_text" align="left"><p>When you use advanced properties, you must separate them using a semi-colon
+(;).</p>
+
+<p>For example, the following Advanced Properties string excludes the schemas
+named <code>test</code> and <code>abc</code>; sets the timeout to 30 seconds; and sets the time zone
+to Coordinated Universal:</p>
+
+<p><code>Time:HandshakeTimeout=30;QueryTimeout=30;
+TimestampTZDisplayTimezone=utc;ExcludedSchemas=test,abc</code></p>
+
+<p>The following table lists and describes the advanced properties that you can
+set when using the MapR Drill ODBC Driver.</p>
+
+<table ><tbody><tr><td valign="top"><strong>Property Name</strong></td><td valign="top"><strong>Default Value</strong></td><td valign="top"><strong>Description</strong></td></tr><tr><td valign="top">HandshakeTimeout</td><td valign="top">5</td><td valign="top">An integer value representing the number of seconds that the driver waits before aborting an attempt to connect to a data source. When set to a value of 0, the driver does not abort connection attempts.</td></tr><tr><td valign="top">QueryTimeout</td><td valign="top">180</td><td valign="top">An integer value representing the number of seconds for the driver to wait before automatically stopping a query. When set to a value of 0, the driver does not stop queries automatically.</td></tr><tr><td valign="top">TimestampTZDisplayTimezone</td><td valign="top">local</td><td valign="top">Two values are possible:localâTimestamps are dependent on the time zone of the user.utcâTimestamps appear in Coordinated Universal Time (UTC).
</td></tr><tr><td valign="top">ExcludedSchemas</td><td valign="top">sys, INFORMATION_SCHEMA</td><td valign="top">The value of ExcludedSchemas is a list of schemas that do not appear in client applications such as Drill Explorer, Tableau, and Excel. Separate schemas in the list using a comma (,).</td></tr><tr><td colspan="1" valign="top"><span style="color: rgb(0,0,0);">CastAnyToVarchar</span></td><td colspan="1" valign="top">true</td><td colspan="1" valign="top"><span style="color: rgb(0,0,0);">Casts the âANYâ and â(VARCHAR(1), ANY) MAPâ data types returned from SQL column calls into type âVARCHARâ.</span></td></tr></tbody></table>
+</div>
+
+
+<div id="footer" class="mw">
+<div class="wrapper">
+Copyright © 2012-2014 The Apache Software Foundation, licensed under the Apache License, Version 2.0.<br>
+Apache and the Apache feather logo are trademarks of The Apache Software Foundation. Other names appearing on the site may be trademarks of their respective owners.<br/><br/>
+</div>
+</div>
+
+<script>
+(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ga('create', 'UA-53379651-1', 'auto');
+ga('send', 'pageview');
+</script>
+
+</body>
+</html>
Modified: drill/site/trunk/content/drill/docs/analyzing-yelp-json-data-with-apache-drill/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/analyzing-yelp-json-data-with-apache-drill/index.html?rev=1662344&r1=1662343&r2=1662344&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/analyzing-yelp-json-data-with-apache-drill/index.html (original)
+++ drill/site/trunk/content/drill/docs/analyzing-yelp-json-data-with-apache-drill/index.html Thu Feb 26 01:16:43 2015
@@ -90,17 +90,15 @@ example is downloadable from <a href="ht
<p><a href="http://incubator.apache.org/drill/download/">http://incubator.apache.org/drill/download/</a></p>
-<p>You can also <a href="https://cwiki.apache.org/conflue%0Ance/display/DRILL/Deploying+Apache+Drill+in+a+Clustered+Environment">deploy Drill in clustered mode</a> if you
+<p>You can also <a href="/drill/docs/deploying-apache-drill-in-a-clustered-environment">deploy Drill in clustered mode</a> if you
want to scale your environment.</p>
<h3 id="step-2-:-open-the-drill-tar-file">Step 2 : Open the Drill tar file</h3>
-
-<p><code>tar -xvf apache-drill-0.6.0-incubating.tar</code></p>
-
+<div class="highlight"><pre><code class="language-text" data-lang="text">tar -xvf apache-drill-0.6.0-incubating.tar
+</code></pre></div>
<h3 id="step-3:-launch-sqlline,-a-jdbc-application-that-ships-with-drill">Step 3: Launch sqlline, a JDBC application that ships with Drill</h3>
-
-<p><code>bin/sqlline -u jdbc:drill:zk=local</code></p>
-
+<div class="highlight"><pre><code class="language-text" data-lang="text">bin/sqlline -u jdbc:drill:zk=local
+</code></pre></div>
<p>Thatâs it! You are now ready explore the data.</p>
<p>Letâs try out some SQL examples to understand how Drill makes the raw data
@@ -111,13 +109,13 @@ analysis extremely easy.</p>
<h2 id="querying-data-with-drill">Querying Data with Drill</h2>
<h3 id="1.-view-the-contents-of-the-yelp-business-data"><strong>1. View the contents of the Yelp business data</strong></h3>
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> !set maxwidth 10000
-<p><code>0: jdbc:drill:zk=local> !set maxwidth 10000</code></p>
+0: jdbc:drill:zk=local> select * from
+ dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
+ limit 1;
-<p><code>0: jdbc:drill:zk=local> select * from
-dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
-limit 1;</code></p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">+-------------+--------------+------------+------------+------------+------------+--------------+------------+------------+------------+------------+------------+------------+------------+---------------+
++-------------+--------------+------------+------------+------------+------------+--------------+------------+------------+------------+------------+------------+------------+------------+---------------+
| business_id | full_address | hours | open | categories | city | review_count | name | longitude | state | stars | latitude | attributes | type | neighborhoods |
+-------------+--------------+------------+------------+------------+------------+--------------+------------+------------+------------+------------+------------+------------+------------+---------------+
| vcNAWiLM4dR7D2nwwJ7nCA | 4840 E Indian School Rd
@@ -130,22 +128,21 @@ Phoenix, AZ 85018 | {"Tuesday"
<h3 id="2.-explore-the-business-data-set-further"><strong>2. Explore the business data set further</strong></h3>
<h4 id="total-reviews-in-the-data-set">Total reviews in the data set</h4>
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select sum(review_count) as totalreviews
+from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`;
-<p><code>0: jdbc:drill:zk=local> select sum(review_count) as totalreviews from
-dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
-;</code></p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">+--------------+
++--------------+
| totalreviews |
+--------------+
| 1236445 |
+--------------+
</code></pre></div>
<h4 id="top-states-and-cities-in-total-number-of-reviews">Top states and cities in total number of reviews</h4>
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select state, city, count(*) totalreviews
+from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
+group by state, city order by count(*) desc limit 10;
-<p><code>0: jdbc:drill:zk=local> select state, city, count(*) totalreviews from
-dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
-group by state, city order by count(*) desc limit 10;</code></p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">+------------+------------+--------------+
++------------+------------+--------------+
| state | city | totalreviews |
+------------+------------+--------------+
| NV | Las Vegas | 12021 |
@@ -161,11 +158,11 @@ group by state, city order by count(*) d
+------------+------------+--------------+
</code></pre></div>
<h4 id="average-number-of-reviews-per-business-star-rating"><strong>Average number of reviews per business star rating</strong></h4>
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select stars,trunc(avg(review_count)) reviewsavg
+from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
+group by stars order by stars desc;``
-<p><code>0: jdbc:drill:zk=local> select stars,trunc(avg(review_count)) reviewsavg from
-dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
-group by stars order by stars desc;</code></p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">+------------+------------+
++------------+------------+
| stars | reviewsavg |
+------------+------------+
| 5.0 | 8.0 |
@@ -180,11 +177,11 @@ group by stars order by stars desc;</cod
+------------+------------+
</code></pre></div>
<h4 id="top-businesses-with-high-review-counts-(>-1000)"><strong>Top businesses with high review counts (> 1000)</strong></h4>
-
-<p><code>0: jdbc:drill:zk=local> select name, state, city, `review_count` from
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select name, state, city, `review_count` from
dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
-where review_count > 1000 order by `review_count` desc limit 10;</code></p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">+------------+------------+------------+----------------------------+
+where review_count > 1000 order by `review_count` desc limit 10;
+
++------------+------------+------------+----------------------------+
| name | state | city | review_count |
+------------+------------+------------+----------------------------+
| Mon Ami Gabi | NV | Las Vegas | 4084 |
@@ -200,13 +197,13 @@ where review_count > 1000 order by `r
+------------+------------+------------+----------------------------+
</code></pre></div>
<h4 id="saturday-open-and-close-times-for-a-few-businesses"><strong>Saturday open and close times for a few businesses</strong></h4>
-
-<p><code>0: jdbc:drill:zk=local> select b.name, b.hours.Saturday.`open`,
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select b.name, b.hours.Saturday.`open`,
b.hours.Saturday.`close`
from
dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json`
-b limit 10;</code></p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">+------------+------------+----------------------------+
+b limit 10;
+
++------------+------------+----------------------------+
| name | EXPR$1 | EXPR$2 |
+------------+------------+----------------------------+
| Eric Goldberg, MD | 08:00 | 17:00 |
@@ -221,7 +218,7 @@ b limit 10;</code></p>
| Spartan Animal Hospital | 07:30 | 18:00 |
+------------+------------+----------------------------+
</code></pre></div>
-<p>** **Note how Drill can traverse and refer through multiple levels of nesting.</p>
+<p>Note how Drill can traverse and refer through multiple levels of nesting.</p>
<h3 id="3.-get-the-amenities-of-each-business-in-the-data-set"><strong>3. Get the amenities of each business in the data set</strong></h3>
@@ -264,9 +261,9 @@ on data.</p>
+------------+------------+
| true | store.json.all_text_mode updated. |
</code></pre></div>
-<p><strong>4. Explore the restaurant businesses in the data set</strong></p>
+<h3 id="4.-explore-the-restaurant-businesses-in-the-data-set"><strong>4. Explore the restaurant businesses in the data set</strong></h3>
-<h4 id="number-of-restaurants-in-the-data-set**-**"><strong>Number of restaurants in the data set</strong>** **</h4>
+<h4 id="number-of-restaurants-in-the-data-set"><strong>Number of restaurants in the data set</strong></h4>
<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select count(*) as TotalRestaurants from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json` where true=repeated_contains(categories,'Restaurants');
+------------------+
| TotalRestaurants |
@@ -310,7 +307,9 @@ on data.</p>
+------------+---------------+------------+
</code></pre></div>
<h4 id="top-first-categories-in-number-of-review-counts"><strong>Top first categories in number of review counts</strong></h4>
-<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select categories[0], count(categories[0]) as categorycount from dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_business.json` group by categories[0]
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select categories[0], count(categories[0]) as categorycount
+from dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_business.json`
+group by categories[0]
order by count(categories[0]) desc limit 10;
+------------+---------------+
| EXPR$0 | categorycount |
@@ -327,10 +326,11 @@ order by count(categories[0]) desc limit
| Hair Salons | 901 |
+------------+---------------+
</code></pre></div>
-<p><strong>5. Explore the Yelp reviews dataset and combine with the businesses.</strong>** **</p>
+<h3 id="5.-explore-the-yelp-reviews-dataset-and-combine-with-the-businesses."><strong>5. Explore the Yelp reviews dataset and combine with the businesses.</strong></h3>
-<h4 id="take-a-look-at-the-contents-of-the-yelp-reviews-dataset.**-**"><strong>Take a look at the contents of the Yelp reviews dataset.</strong>** **</h4>
-<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select * from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_review.json` limit 1;
+<h4 id="take-a-look-at-the-contents-of-the-yelp-reviews-dataset."><strong>Take a look at the contents of the Yelp reviews dataset.</strong></h4>
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select *
+from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_review.json` limit 1;
+------------+------------+------------+------------+------------+------------+------------+-------------+
| votes | user_id | review_id | stars | date | text | type | business_id |
+------------+------------+------------+------------+------------+------------+------------+-------------+
@@ -342,8 +342,12 @@ order by count(categories[0]) desc limit
<p>Note that we are combining the Yelp business data set that has the overall
review_count to the Yelp review data, which holds additional details on each
of the reviews themselves.</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> Select b.name from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json` b where b.business_id in (SELECT r.business_id FROM dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_review.json` r
-GROUP BY r.business_id having sum(r.votes.cool) > 2000 order by sum(r.votes.cool) desc);
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> Select b.name
+from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json` b
+where b.business_id in (SELECT r.business_id
+FROM dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_review.json` r
+GROUP BY r.business_id having sum(r.votes.cool) > 2000
+order by sum(r.votes.cool) desc);
+------------+
| name |
+------------+
@@ -360,7 +364,10 @@ file system. Drill in standalone mode co
can use to create views (or you can can define your own workspaces on a local
or distributed file system). If you want to persist the data physically
instead of in a logical view, you can use CREATE TABLE AS SELECT syntax.</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> create or replace view dfs.tmp.businessreviews as Select b.name,b.stars,b.state,b.city,r.votes.funny,r.votes.useful,r.votes.cool, r.`date` from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json` b , dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_review.json` r where r.business_id=b.business_id
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> create or replace view dfs.tmp.businessreviews as
+Select b.name,b.stars,b.state,b.city,r.votes.funny,r.votes.useful,r.votes.cool, r.`date`
+from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json` b, dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_review.json` r
+where r.business_id=b.business_id
+------------+------------+
| ok | summary |
+------------+------------+
@@ -376,10 +383,10 @@ instead of in a logical view, you can us
+------------+
</code></pre></div>
<p>In addition to these queries, you can get many more deeper insights using
-Drillâs <a href="https://cwiki.apache.org/confluence/display/DRILL/%0ASQL+Reference">SQL functionality</a>. If you are not comfortable with writing queries manually, you
+Drillâs <a href="/drill/docs/sql-reference">SQL functionality</a>. If you are not comfortable with writing queries manually, you
can use a BI/Analytics tools such as Tableau/MicroStrategy to query raw
-files/Hive/HBase data or Drill-created views directly using Drill ODBC/JDBC
-drivers.</p>
+files/Hive/HBase data or Drill-created views directly using Drill <a href="/drill/docs/odbc-jdbc-interfaces">ODBC/JDBC
+drivers</a>.</p>
<p>The goal of Apache Drill is to provide the freedom and flexibility in
exploring data in ways we have never seen before with SQL technologies. The
@@ -391,7 +398,8 @@ in 0.7). This function can be used to dy
data so you can apply even deeper SQL functionality. Here is a sample query:</p>
<h4 id="get-a-flattened-list-of-categories-for-each-business"><strong>Get a flattened list of categories for each business</strong></h4>
-<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select name, flatten(categories) as category from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json` limit 20;
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select name, flatten(categories) as category
+from dfs.`/users/nrentachintala/Downloads/yelp/yelp_academic_dataset_business.json` limit 20;
+------------+------------+
| name | category |
+------------+------------+
@@ -418,7 +426,10 @@ data so you can apply even deeper SQL fu
+------------+------------+
</code></pre></div>
<p><strong>Top categories used in business reviews</strong></p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select celltbl.catl, count(celltbl.catl) categorycnt from (select flatten(categories) catl from dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_business.json` ) celltbl group by celltbl.catl order by count(celltbl.catl) desc limit 10 ;
+<div class="highlight"><pre><code class="language-text" data-lang="text">0: jdbc:drill:zk=local> select celltbl.catl, count(celltbl.catl) categorycnt
+from (select flatten(categories) catl from dfs.`/users/nrentachintala/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_business.json` ) celltbl
+group by celltbl.catl
+order by count(celltbl.catl) desc limit 10 ;
+------------+-------------+
| catl | categorycnt |
+------------+-------------+
@@ -441,8 +452,8 @@ data so you can apply even deeper SQL fu
<ul>
<li>Download Drill here:<a href="http://incubator.apache.org/drill/download/">http://incubator.apache.org/drill/download/</a></li>
<li>10 reasons we think Drill is cool:<a href="http://incubator.apache.org/drill/why-drill/">http://incubator.apache.org/drill/why-drill/</a></li>
-<li>A simple 10-minute tutorial:<a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+in+10+Minutes">https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+in+10+Minutes</a></li>
-<li>A more comprehensive tutorial:<a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+Tutorial">https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+Tutorial</a></li>
+<li><a href="/drill/docs/apache-drill-in-10-minutes">A simple 10-minute tutorial</a></li>
+<li><a href="/drill/docs/apache-drill-tutorial">A more comprehensive tutorial</a></li>
</ul>
</div>
Modified: drill/site/trunk/content/drill/docs/apache-drill-0-6-0-release-notes-apache-drill-alpha/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/apache-drill-0-6-0-release-notes-apache-drill-alpha/index.html?rev=1662344&r1=1662343&r2=1662344&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/apache-drill-0-6-0-release-notes-apache-drill-alpha/index.html (original)
+++ drill/site/trunk/content/drill/docs/apache-drill-0-6-0-release-notes-apache-drill-alpha/index.html Thu Feb 26 01:16:43 2015
@@ -82,7 +82,7 @@ JIRAs that can help you run Drill agains
<p>This release is primarily a bug fix release, with <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&vers%0Aion=12327472">more than 30 JIRAs closed</a>, but there are some notable features:</p>
<ul>
-<li>Direct ANSI SQL access to MongoDB, using the latest <a href="/confluence/display/DRILL/MongoDB+Plugin+for+Apache+Drill">MongoDB Plugin for Apache Drill</a></li>
+<li>Direct ANSI SQL access to MongoDB, using the latest <a href="/drill/docs/mongodb-plugin-for-apache-drill">MongoDB Plugin for Apache Drill</a></li>
<li>Filesystem query performance improvements with partition pruning</li>
<li>Ability to use the file system as a persistent store for query profiles and diagnostic information</li>
<li>Window function support (alpha)</li>
Modified: drill/site/trunk/content/drill/docs/apache-drill-contribution-guidelines/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/apache-drill-contribution-guidelines/index.html?rev=1662344&r1=1662343&r2=1662344&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/apache-drill-contribution-guidelines/index.html (original)
+++ drill/site/trunk/content/drill/docs/apache-drill-contribution-guidelines/index.html Thu Feb 26 01:16:43 2015
@@ -67,171 +67,240 @@
</div>
-<div class="int_text" align="left"><ul>
-<li>Fixing JIRAs</li>
-<li>SQL functions </li>
-<li>Support for new file format readers/writers</li>
-<li>Support for new data sources</li>
-<li>New query language parsers</li>
-<li>Application interfaces
+<div class="int_text" align="left"><h2 id="how-to-contribute-to-apache-drill">How to Contribute to Apache Drill</h2>
+
+<p>Disclaimer: These contribution guidelines are largely based on Apache Hive
+contribution guidelines.</p>
+
+<p>This page describes the mechanics of <em>how</em> to contribute software to Apache
+Drill. For ideas about <em>what</em> you might contribute, please see open tickets in
+<a href="https://issues.apache.org/jira/browse/DRILL">Jira</a>.</p>
+
+<p>These guidelines include the following topics:</p>
<ul>
-<li>BI Tool testing</li>
-</ul></li>
-<li>General CLI improvements </li>
-<li>Eco system integrations
+<li>Getting the source code
<ul>
-<li>MapReduce</li>
-<li>Hive views</li>
-<li>YARN</li>
-<li>Spark</li>
-<li>Hue</li>
-<li>Phoenix</li>
+<li>Making Changes</li>
+<li>Coding Convention</li>
+<li>Formatter configuration</li>
+<li>Understanding Maven</li>
+<li>Creating a patch</li>
+<li>Applying a patch</li>
+<li>Where is a good place to start contributing?</li>
+<li>Contributing your work</li>
+<li>JIRA Guidelines</li>
+<li>See Also</li>
</ul></li>
</ul>
-<h1 id="fixing-jiras">Fixing JIRAs</h1>
+<h3 id="getting-the-source-code">Getting the source code</h3>
-<p>This is a good place to begin if you are new to Drill. Feel free to pick
-issues from the Drill JIRA list. When you pick an issue, assign it to
-yourself, inform the team, and start fixing it.</p>
+<p>First, you need the Drill source code.</p>
-<p>For any questions, seek help from the team by sending email to <a href="mailto:drill-dev@incubator.apache.org">drill-
-dev@incubator.apache.org</a>.</p>
+<p>Get the source code on your local drive using <a href="https://git-wip-%0Aus.apache.org/repos/asf/incubator-drill.git">Git</a>. Most development is done on
+"master":</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">git clone https://git-wip-us.apache.org/repos/asf/drill.git
+</code></pre></div>
+<h3 id="making-changes">Making Changes</h3>
-<p><a href="https://issues.apache.org/jira/browse/DRILL/?selectedTab=com.atlassian.jira%0A.jira-projects-plugin:summary-panel">https://issues.apache.org/jira/browse/DRILL/?selectedTab=com.atlassian.jira
-.jira-projects-plugin:summary-panel</a></p>
+<p>Before you start, send a message to the <a href="http%0A://mail-archives.apache.org/mod_mbox/incubator-drill-dev/">Drill developer mailing list</a>, or file a bug
+report in <a href="https://issues.apache.org/jira/browse/DRILL">JIRA</a>. Describe your
+proposed changes and check that they fit in with what others are doing and
+have planned for the project. Be patient, it may take folks a while to
+understand your requirements.</p>
-<h1 id="sql-functions">SQL functions</h1>
+<p>Modify the source code and add some features using your favorite IDE.</p>
-<p>One of the next simple places to start is to implement a DrillFunc.â¨DrillFuncs
-is way that Drill express all scalar functions (UDF or system).⨠First you can
-put together a JIRA for one of the DrillFunc's we don't yet have but should
-(referencing the capabilities of something like Postgresâ¨or SQL Server or your
-own use case). Then try to implement one.</p>
+<h4 id="coding-convention">Coding Convention</h4>
-<p>One example DrillFunc:<br>
-<a href="https://github.com/apache/incubator-%0Adrill/blob/103072a619741d5e228fdb181501ec2f82e111a3/sandbox/prototype/exec%0A/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/ComparisonFunction%0As.java">https://github.com/apache/incubator-
-drill/blob/103072a619741d5e228fdb181501ec2f82e111a3/sandbox/prototype/exec
-/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/ComparisonFunction
-s.java</a>** **</p>
+<p>Please take care about the following points</p>
-<p><strong>Additional ideas on functions that can be added to Drill SQL support</strong></p>
+<ul>
+<li>All public classes and methods should have informative <a href="http://www.oracle.com/technetwork/java/javase/documentation/index-137868.html">Javadoc comments</a>.
<ul>
-<li>Madlib integration</li>
-<li>Machine learning functions</li>
-<li>Approximate aggregate functions (such as what is available in BlinkDB)</li>
+<li>Do not use @author tags.</li>
+</ul></li>
+<li>Code should be formatted according to <a href="http://www.oracle.com/technetwork/java/codeconv-138413.html">Sun's conventions</a>, with one exception:
+
+<ul>
+<li>Indent two (2) spaces per level, not four (4).</li>
+<li>Line length limit is 120 chars, instead of 80 chars.</li>
+</ul></li>
+<li>Contributions should not introduce new Checkstyle violations.</li>
+<li>Contributions should pass existing unit tests.</li>
+<li>New unit tests should be provided to demonstrate bugs and fixes. <a href="http://www.junit.org">JUnit</a> 4.1 is our test framework:
+
+<ul>
+<li>You must implement a class that contain test methods annotated with JUnit's 4.x @Test annotation and whose class name ends with <code>Test</code>.</li>
+<li>Define methods within your class whose names begin with <code>test</code>, and call JUnit's many assert methods to verify conditions; these methods will be executed when you run <code>mvn clean test</code>.</li>
+</ul></li>
</ul>
-<h1 id="support-for-new-file-format-readers/writers">Support for new file format readers/writers</h1>
+<h4 id="formatter-configuration">Formatter configuration</h4>
+
+<p>Setting up IDE formatters is recommended and can be done by importing the
+following settings into your browser:</p>
-<p>Currently Drill supports text, JSON and Parquet file formats natively when
-interacting with file system. More readers/writers can be introduced by
-implementing custom storage plugins. Example formats include below.</p>
+<p>IntelliJ IDEA formatter: <a href="/confluence/download/attachments/30757399/idea-%0Asettings.jar?version=1&modificationDate=1363022308000&api=v2">settings
+jar</a></p>
+
+<p>Eclipse: <a href="https://issues.apache.org/jira/secure/atta%0Achment/12474245/eclipse_formatter_apache.xml">formatter xml from HBase</a></p>
+
+<h4 id="understanding-maven">Understanding Maven</h4>
+
+<p>Drill is built by Maven, a Java build tool.</p>
<ul>
-<li>AVRO</li>
-<li>Sequence</li>
-<li>RC</li>
-<li>ORC</li>
-<li>Protobuf</li>
-<li>XML</li>
-<li>Thrift</li>
-<li>....</li>
+<li>Good Maven tutorial: <a href="http://maven.apache.org/guides/getting-started/maven-in-five-minutes.html">http://maven.apache.org/guides/getting-started/maven-in-five-minutes.html</a></li>
</ul>
-<h1 id="support-for-new-data-sources">Support for new data sources</h1>
+<p>To build Drill, run</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">mvn clean install
+</code></pre></div>
+<h4 id="creating-a-patch">Creating a patch</h4>
+
+<p>Check to see what files you have modified:</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">git status
+</code></pre></div>
+<p>Add any new files with:</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">git add .../MyNewClass.java
+git add .../TestMyNewClass.java
+git add .../XXXXXX.q
+git add .../XXXXXX.q.out
+</code></pre></div>
+<p>In order to create a patch, type (from the base directory of drill):</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">git format-patch origin/master --stdout > DRILL-1234.1.patch.txt
+</code></pre></div>
+<p>This will report all modifications done on Drill sources on your local disk
+and save them into the <em>DRILL-1234.1.patch.txt</em> file. Read the patch file.
+Make sure it includes ONLY the modifications required to fix a single issue.</p>
-<p>Implement custom storage plugins for the following non-Hadoop data sources:</p>
+<p>Please do not:</p>
<ul>
-<li>NoSQL databases (such as Mongo, Cassandra, Couch etc)</li>
-<li>Search engines (such as Solr, Lucidworks, Elastic Search etc)</li>
-<li>SQL databases (MySQL< PostGres etc)</li>
-<li>Generic JDBC/ODBC data sources</li>
-<li>HTTP URL</li>
-<li>----</li>
+<li>reformat code unrelated to the bug being fixed: formatting changes should be separate patches/commits.</li>
+<li>comment out code that is now obsolete: just remove it.</li>
+<li>insert comments around each change, marking the change: folks can use subversion to figure out what's changed and by whom.</li>
+<li>make things public which are not required by end users.</li>
</ul>
-<h1 id="new-query-language-parsers">New query language parsers</h1>
-
-<p>Drill exposes strongly typed JSON APIs for logical and physical plans (plan
-syntax at <a href="https://docs.google.com/a/maprtech.com/document/d/1QTL8warUYS2KjldQ%0ArGUse7zp8eA72VKtLOHwfXy6c7I/edit#heading=h.n9gdb1ek71hf">https://docs.google.com/a/maprtech.com/document/d/1QTL8warUYS2KjldQ
-rGUse7zp8eA72VKtLOHwfXy6c7I/edit#heading=h.n9gdb1ek71hf</a> ). Drill provides a
-SQL language parser today, but any language parser that can generate
-logical/physical plans can use Drill's power on the backend as the distributed
-low latency query execution engine along with its support for self-describing
-data and complex/multi-structured data.</p>
+<p>Please do:</p>
<ul>
-<li>Pig parser : Use Pig as the language to query data from Drill. Great for existing Pig users.</li>
-<li>Hive parser : Use HiveQL as the language to query data from Drill. Great for existing Hive users.</li>
+<li>try to adhere to the coding style of files you edit;</li>
+<li>comment code whose function or rationale is not obvious;</li>
+<li>update documentation (e.g., <em>package.html</em> files, this wiki, etc.)</li>
</ul>
-<h1 id="application-interfaces">Application interfaces</h1>
+<p>Updating a patch</p>
+
+<p>For patch updates, our convention is to number them like
+DRILL-1856.1.patch.txt, DRILL-1856.2.patch.txt, etc. And then click the
+"Submit Patch" button again when a new one is uploaded; this makes sure it
+gets back into the review queue. Appending '.txt' to the patch file name makes
+it easy to quickly view the contents of the patch in a web browser.</p>
+
+<h4 id="applying-a-patch">Applying a patch</h4>
-<p>Drill currently provides JDBC/ODBC drivers for the applications to interact
-along with a basic version of REST API and a C++ API. The following list
-provides a few possible application interface opportunities:</p>
+<p>To apply a patch either you generated or found from JIRA, you can issue</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">git am < cool_patch.patch
+</code></pre></div>
+<p>if you just want to check whether the patch applies you can run patch with
+--dry-run option.</p>
+
+<h4 id="review-process">Review Process</h4>
<ul>
-<li>Enhancements to REST APIs (<a href="https://issues.apache.org/jira/browse/DRILL-77">https://issues.apache.org/jira/browse/DRILL-77</a>)</li>
-<li>Expose Drill tables/views as REST APIs</li>
-<li>Language drivers for Drill (python etc)</li>
-<li>Thrift support</li>
-<li>....</li>
+<li>Use Hadoop's <a href="http://wiki.apache.org/hadoop/CodeReviewChecklist">code review checklist</a> as a rough guide when doing reviews.</li>
+<li>In JIRA, use attach file to notify that you've submitted a patch for that issue.</li>
+<li>Create a Review Request in <a href="https://reviews.apache.org/r/">Review Board</a>. The review request's name should start with the JIRA issue number (e.g. DRILL-XX) and should be assigned to the "drill-git" group.</li>
+<li>If a committer requests changes, set the issue status to 'Resume Progress', then once you're ready, submit an updated patch with necessary fixes and then request another round of review with 'Submit Patch' again.</li>
+<li>Once your patch is accepted, be sure to upload a final version which grants rights to the ASF.</li>
</ul>
-<h2 id="bi-tool-testing">BI Tool testing</h2>
+<h2 id="where-is-a-good-place-to-start-contributing?">Where is a good place to start contributing?</h2>
+
+<p>After getting the source code, building and running a few simple queries, one
+of the simplest places to start is to implement a DrillFunc.<br>
+DrillFuncs is way that Drill express all scalar functions (UDF or system).<br>
+First you can put together a JIRA for one of the DrillFunc's we don't yet have
+but should (referencing the capabilities of something like Postgres<br>
+or SQL Server). Then try to implement one.</p>
+
+<p>One example DrillFunc:</p>
-<p>Drill provides JDBC/ODBC drivers to connect to BI tools. We need to make sure
-Drill works with all major BI tools. Doing a quick sanity testing with your
-favorite BI tool is a good place to learn Drill and also uncover issues in
-being able to do so.</p>
+<p><a href="https://github.com/apache/incubator-%0Adrill/blob/103072a619741d5e228fdb181501ec2f82e111a3/sandbox/prototype/exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/ComparisonFunction%0As.java">https://github.com/apache/incubator-
+drill/blob/103072a619741d5e228fdb181501ec2f82e111a3/sandbox/prototype/exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/ComparisonFunction
+s.java</a></p>
-<h1 id="general-cli-improvements">General CLI improvements</h1>
+<p>Also one can visit the JIRA issues and implement one of those too. A list of
+functions which need to be implemented can be found
+<a href="https://docs.google.com/spreadsheet/ccc?key=0AgAGbQ6asvQ-%0AdDRrUUxVSVlMVXRtanRoWk9JcHgteUE&usp=sharing#gid=0">here</a> (WIP).</p>
-<p>Currently Drill uses SQLLine as the CLI. The goal of this effort is to improve
-the CLI experience by adding functionality such as execute statements from a
-file, output results to a file, display version information, and so on.</p>
+<p>More contribution ideas are located on the <a href="/drill/docs/apache-drill-contribution-ideas">Contribution Ideas</a> page.</p>
-<h1 id="eco-system-integrations">Eco system integrations</h1>
+<h3 id="contributing-your-work">Contributing your work</h3>
-<h2 id="mapreduce">MapReduce</h2>
+<p>Finally, patches should be <em>attached</em> to an issue report in
+<a href="http://issues.apache.org/jira/browse/DRILL">JIRA</a> via the <strong>Attach File</strong>
+link on the issue's JIRA. Please add a comment that asks for a code review.
+Please note that the attachment should be granted license to ASF for inclusion
+in ASF works (as per the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache
+License</a>).</p>
-<p>Allow using result set from Drill queries as input to the Hadoop/MapReduce
-jobs.</p>
+<p>Folks should run <code>mvn clean install</code> before submitting a patch. Tests should
+all pass. If your patch involves performance optimizations, they should be
+validated by benchmarks that demonstrate an improvement.</p>
-<h2 id="hive-views">Hive views</h2>
+<p>If your patch creates an incompatibility with the latest major release, then
+you must set the <strong>Incompatible change</strong> flag on the issue's JIRA 'and' fill
+in the <strong>Release Note</strong> field with an explanation of the impact of the
+incompatibility and the necessary steps users must take.</p>
-<p>Query data from existing Hive views using Drill queries. Drill needs to parse
-the HiveQL and translate them appropriately (into Drill's SQL or
-logical/physical plans) to execute the requests.</p>
+<p>If your patch implements a major feature or improvement, then you must fill in
+the <strong>Release Note</strong> field on the issue's JIRA with an explanation of the
+feature that will be comprehensible by the end user.</p>
-<h2 id="yarn">YARN</h2>
+<p>A committer should evaluate the patch within a few days and either: commit it;
+or reject it with an explanation.</p>
-<p><a href="https://issues.apache.org%0A/jira/browse/DRILL-1170">https://issues.apache.org/jira/browse/<em>DRILL</em>-1170</a></p>
+<p>Please be patient. Committers are busy people too. If no one responds to your
+patch after a few days, please make friendly reminders. Please incorporate
+other's suggestions into your patch if you think they're reasonable. Finally,
+remember that even a patch that is not committed is useful to the community.</p>
-<h2 id="spark">Spark</h2>
+<p>Should your patch receive a "-1" select the <strong>Resume Progress</strong> on the issue's
+JIRA, upload a new patch with necessary fixes, and then select the <strong>Submit
+Patch</strong> link again.</p>
-<p>Provide ability to invoke Drill queries as part of Apache Spark programs. This
-gives ability for Spark developers/users to leverage Drill richness of the
-query layer , for data source access and as low latency execution engine.</p>
+<p>Committers: for non-trivial changes, it is best to get another committer to
+review your patches before commit. Use <strong>Submit Patch</strong> link like other
+contributors, and then wait for a "+1" from another committer before
+committing. Please also try to frequently review things in the patch queue.</p>
-<h2 id="hue">Hue</h2>
+<h3 id="jira-guidelines">JIRA Guidelines</h3>
-<p>Hue is a GUI for users to interact with various Hadoop eco system components
-(such as Hive, Oozie, Pig, HBase, Impala ...). The goal of this project is to
-expose Drill as an application inside Hue so users can explore Drill metadata
-and do SQL queries.</p>
+<p>Please comment on issues in JIRA, making their concerns known. Please also
+vote for issues that are a high priority for you.</p>
-<h2 id="phoenix">Phoenix</h2>
+<p>Please refrain from editing descriptions and comments if possible, as edits
+spam the mailing list and clutter JIRA's "All" display, which is otherwise
+very useful. Instead, preview descriptions and comments using the preview
+button (on the right) before posting them. Keep descriptions brief and save
+more elaborate proposals for comments, since descriptions are included in
+JIRA's automatically sent messages. If you change your mind, note this in a
+new comment, rather than editing an older comment. The issue should preserve
+this history of the discussion.</p>
-<p>Phoenix provides a low latency query layer on HBase for operational
-applications. The goal of this effort is to explore opportunities for
-integrating Phoenix with Drill.</p>
+<h3 id="see-also">See Also</h3>
+
+<ul>
+<li><a href="http://www.apache.org/dev/contributors.html">Apache contributor documentation</a></li>
+<li><a href="http://www.apache.org/foundation/voting.html">Apache voting documentation</a></li>
+</ul>
</div>
Added: drill/site/trunk/content/drill/docs/apache-drill-contribution-ideas/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/apache-drill-contribution-ideas/index.html?rev=1662344&view=auto
==============================================================================
--- drill/site/trunk/content/drill/docs/apache-drill-contribution-ideas/index.html (added)
+++ drill/site/trunk/content/drill/docs/apache-drill-contribution-ideas/index.html Thu Feb 26 01:16:43 2015
@@ -0,0 +1,256 @@
+<!DOCTYPE html>
+<html>
+
+<head>
+
+<meta charset="UTF-8">
+
+
+<title>Apache Drill Contribution Ideas - Apache Drill</title>
+
+<link href="/css/syntax.css" rel="stylesheet" type="text/css">
+<link href="/css/style.css" rel="stylesheet" type="text/css">
+<link href="/css/arrows.css" rel="stylesheet" type="text/css">
+<link href="/css/button.css" rel="stylesheet" type="text/css">
+
+<link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
+<link rel="icon" href="/favicon.ico" type="image/x-icon">
+
+<script language="javascript" type="text/javascript" src="/js/lib/jquery-1.11.1.min.js"></script>
+<script language="javascript" type="text/javascript" src="/js/lib/jquery.easing.1.3.js"></script>
+<script language="javascript" type="text/javascript" src="/js/modernizr.custom.js"></script>
+<script language="javascript" type="text/javascript" src="/js/script.js"></script>
+
+</head>
+
+<body onResize="resized();">
+
+<div class="bui"></div>
+
+<div id="search">
+<input type="text" placeholder="Enter search term here">
+</div>
+
+<div id="menu" class="mw">
+<ul>
+ <li class="logo"><a href="/"></a></li>
+ <li>
+ <a href="/overview/">Documentation</a>
+ <ul>
+ <li><a href="/overview/">Overview </a></li>
+ <li><a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+in+10+Minutes" target="_blank">Drill in 10 Minutes</a></li>
+ <li><a href="/why/">Why Drill? </a></li>
+ <li><a href="/architecture/">Architecture</a></li>
+ </ul>
+ </li>
+ <li>
+ <a href="/community/">Community</a>
+ <ul>
+ <li><a href="/team/">Team</a></li>
+ <li><a href="/community/#events">Events and Meetups</a></li>
+ <li><a href="/community/#mailinglists">Mailing Lists</a></li>
+ <li><a href="/community/#getinvolved">Get Involved</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/DRILL/" target="_blank">Issue Tracker</a></li>
+ <li><a href="https://github.com/apache/drill" target="_blank">GitHub</a></li>
+ </ul>
+ </li>
+ <li><a href="/faq/">FAQ</a></li>
+ <li><a href="/blog/">Blog</a></li>
+ <li style="width:30px; padding-left: 2px; padding-right:10px"><a href="https://twitter.com/apachedrill" target="_blank"><img src="/images/twitterbw.png" alt="" align="center" width="22" style="padding: 0px 10px 1px 0px;"></a> </li>
+ <li class="l"><span> </span></li>
+ <li class="d"><a href="/download/">Download</a></li>
+</ul>
+</div>
+
+<div class="int_title">
+<h1>Apache Drill Contribution Ideas</h1>
+
+</div>
+
+<div class="int_text" align="left"><ul>
+<li>Fixing JIRAs</li>
+<li>SQL functions </li>
+<li>Support for new file format readers/writers</li>
+<li>Support for new data sources</li>
+<li>New query language parsers</li>
+<li>Application interfaces
+
+<ul>
+<li>BI Tool testing</li>
+</ul></li>
+<li>General CLI improvements </li>
+<li>Eco system integrations
+
+<ul>
+<li>MapReduce</li>
+<li>Hive views</li>
+<li>YARN</li>
+<li>Spark</li>
+<li>Hue</li>
+<li>Phoenix</li>
+</ul></li>
+</ul>
+
+<h2 id="fixing-jiras">Fixing JIRAs</h2>
+
+<p>This is a good place to begin if you are new to Drill. Feel free to pick
+issues from the Drill JIRA list. When you pick an issue, assign it to
+yourself, inform the team, and start fixing it.</p>
+
+<p>For any questions, seek help from the team by sending email to <a href="mailto:drill-dev@incubator.apache.org">drill-
+dev@incubator.apache.org</a>.</p>
+
+<p><a href="https://issues.apache.org/jira/browse/DRILL/?selectedTab=com.atlassian.jira%0A.jira-projects-plugin:summary-panel">https://issues.apache.org/jira/browse/DRILL/?selectedTab=com.atlassian.jira
+.jira-projects-plugin:summary-panel</a></p>
+
+<h2 id="sql-functions">SQL functions</h2>
+
+<p>One of the next simple places to start is to implement a DrillFunc.â¨DrillFuncs
+is way that Drill express all scalar functions (UDF or system).⨠First you can
+put together a JIRA for one of the DrillFunc's we don't yet have but should
+(referencing the capabilities of something like Postgresâ¨or SQL Server or your
+own use case). Then try to implement one.</p>
+
+<p>One example DrillFunc:<br>
+<a href="https://github.com/apache/incubator-%0Adrill/blob/103072a619741d5e228fdb181501ec2f82e111a3/sandbox/prototype/exec%0A/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/ComparisonFunction%0As.java">https://github.com/apache/incubator-
+drill/blob/103072a619741d5e228fdb181501ec2f82e111a3/sandbox/prototype/exec
+/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/ComparisonFunction
+s.java</a>** **</p>
+
+<p><strong>Additional ideas on functions that can be added to SQL support</strong></p>
+
+<ul>
+<li>Madlib integration</li>
+<li>Machine learning functions</li>
+<li>Approximate aggregate functions (such as what is available in BlinkDB)</li>
+</ul>
+
+<h2 id="support-for-new-file-format-readers/writers">Support for new file format readers/writers</h2>
+
+<p>Currently Drill supports text, JSON and Parquet file formats natively when
+interacting with file system. More readers/writers can be introduced by
+implementing custom storage plugins. Example formats include below.</p>
+
+<ul>
+<li>AVRO</li>
+<li>Sequence</li>
+<li>RC</li>
+<li>ORC</li>
+<li>Protobuf</li>
+<li>XML</li>
+<li>Thrift</li>
+<li>....</li>
+</ul>
+
+<h2 id="support-for-new-data-sources">Support for new data sources</h2>
+
+<p>Implement custom storage plugins for the following non-Hadoop data sources:</p>
+
+<ul>
+<li>NoSQL databases (such as Mongo, Cassandra, Couch etc)</li>
+<li>Search engines (such as Solr, Lucidworks, Elastic Search etc)</li>
+<li>SQL databases (MySQL< PostGres etc)</li>
+<li>Generic JDBC/ODBC data sources</li>
+<li>HTTP URL</li>
+<li>----</li>
+</ul>
+
+<h2 id="new-query-language-parsers">New query language parsers</h2>
+
+<p>Drill exposes strongly typed JSON APIs for logical and physical plans (plan
+syntax at <a href="https://docs.google.com/a/maprtech.com/document/d/1QTL8warUYS2KjldQ%0ArGUse7zp8eA72VKtLOHwfXy6c7I/edit#heading=h.n9gdb1ek71hf">https://docs.google.com/a/maprtech.com/document/d/1QTL8warUYS2KjldQ
+rGUse7zp8eA72VKtLOHwfXy6c7I/edit#heading=h.n9gdb1ek71hf</a> ). Drill provides a
+SQL language parser today, but any language parser that can generate
+logical/physical plans can use Drill's power on the backend as the distributed
+low latency query execution engine along with its support for self-describing
+data and complex/multi-structured data.</p>
+
+<ul>
+<li>Pig parser : Use Pig as the language to query data from Drill. Great for existing Pig users.</li>
+<li>Hive parser : Use HiveQL as the language to query data from Drill. Great for existing Hive users.</li>
+</ul>
+
+<h2 id="application-interfaces">Application interfaces</h2>
+
+<p>Drill currently provides JDBC/ODBC drivers for the applications to interact
+along with a basic version of REST API and a C++ API. The following list
+provides a few possible application interface opportunities:</p>
+
+<ul>
+<li>Enhancements to REST APIs (<a href="https://issues.apache.org/jira/browse/DRILL-77">https://issues.apache.org/jira/browse/DRILL-77</a>)</li>
+<li>Expose Drill tables/views as REST APIs</li>
+<li>Language drivers for Drill (python etc)</li>
+<li>Thrift support</li>
+<li>....</li>
+</ul>
+
+<h3 id="bi-tool-testing">BI Tool testing</h3>
+
+<p>Drill provides JDBC/ODBC drivers to connect to BI tools. We need to make sure
+Drill works with all major BI tools. Doing a quick sanity testing with your
+favorite BI tool is a good place to learn Drill and also uncover issues in
+being able to do so.</p>
+
+<h2 id="general-cli-improvements">General CLI improvements</h2>
+
+<p>Currently Drill uses SQLLine as the CLI. The goal of this effort is to improve
+the CLI experience by adding functionality such as execute statements from a
+file, output results to a file, display version information, and so on.</p>
+
+<h2 id="eco-system-integrations">Eco system integrations</h2>
+
+<h3 id="mapreduce">MapReduce</h3>
+
+<p>Allow using result set from Drill queries as input to the Hadoop/MapReduce
+jobs.</p>
+
+<h3 id="hive-views">Hive views</h3>
+
+<p>Query data from existing Hive views using Drill queries. Drill needs to parse
+the HiveQL and translate them appropriately (into Drill's SQL or
+logical/physical plans) to execute the requests.</p>
+
+<h3 id="yarn">YARN</h3>
+
+<p><a href="https://issues.apache.org%0A/jira/browse/DRILL-1170">https://issues.apache.org/jira/browse/<em>DRILL</em>-1170</a></p>
+
+<h2 id="spark">Spark</h2>
+
+<p>Provide ability to invoke Drill queries as part of Apache Spark programs. This
+gives ability for Spark developers/users to leverage Drill richness of the
+query layer , for data source access and as low latency execution engine.</p>
+
+<h3 id="hue">Hue</h3>
+
+<p>Hue is a GUI for users to interact with various Hadoop eco system components
+(such as Hive, Oozie, Pig, HBase, Impala ...). The goal of this project is to
+expose Drill as an application inside Hue so users can explore Drill metadata
+and do SQL queries.</p>
+
+<h3 id="phoenix">Phoenix</h3>
+
+<p>Phoenix provides a low latency query layer on HBase for operational
+applications. The goal of this effort is to explore opportunities for
+integrating Phoenix with Drill.</p>
+</div>
+
+
+<div id="footer" class="mw">
+<div class="wrapper">
+Copyright © 2012-2014 The Apache Software Foundation, licensed under the Apache License, Version 2.0.<br>
+Apache and the Apache feather logo are trademarks of The Apache Software Foundation. Other names appearing on the site may be trademarks of their respective owners.<br/><br/>
+</div>
+</div>
+
+<script>
+(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ga('create', 'UA-53379651-1', 'auto');
+ga('send', 'pageview');
+</script>
+
+</body>
+</html>