You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by ts...@apache.org on 2015/05/04 17:48:01 UTC
[09/19] drill git commit: Web site improvements
Web site improvements
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/efbcbc42
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/efbcbc42
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/efbcbc42
Branch: refs/heads/gh-pages
Commit: efbcbc4278a730fa38f8927c074c35ab7057f989
Parents: aea162b
Author: Tomer Shiran <ts...@gmail.com>
Authored: Sun May 3 22:45:48 2015 -0700
Committer: Tomer Shiran <ts...@gmail.com>
Committed: Sun May 3 22:45:48 2015 -0700
----------------------------------------------------------------------
_data/version.json | 5 +
_includes/head.html | 3 +-
blog/_drafts/drill-0.9-released.md | 32 -----
blog/_posts/2015-05-04-drill-0.9-released.md | 33 +++++
css/button.css | 121 ------------------
css/code.css | 69 ++++++++++
css/docpage.css | 73 -----------
css/download.css | 33 +++++
css/style.css | 118 ++----------------
download.html | 57 +++------
faq.md | 145 +++++++++++++---------
team.md | 38 +++---
12 files changed, 278 insertions(+), 449 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/_data/version.json
----------------------------------------------------------------------
diff --git a/_data/version.json b/_data/version.json
new file mode 100644
index 0000000..da9be0d
--- /dev/null
+++ b/_data/version.json
@@ -0,0 +1,5 @@
+{
+ "display_version": "0.9",
+ "full_version": "0.9.0",
+ "release_date": "May 4, 2015"
+}
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/_includes/head.html
----------------------------------------------------------------------
diff --git a/_includes/head.html b/_includes/head.html
index 338562b..528df5f 100644
--- a/_includes/head.html
+++ b/_includes/head.html
@@ -9,12 +9,11 @@
<link href="{{ site.baseurl }}/css/syntax.css" rel="stylesheet" type="text/css">
<link href="{{ site.baseurl }}/css/style.css" rel="stylesheet" type="text/css">
<link href="{{ site.baseurl }}/css/arrows.css" rel="stylesheet" type="text/css">
-<link href="{{ site.baseurl }}/css/button.css" rel="stylesheet" type="text/css">
<link href="{{ site.baseurl }}/css/breadcrumbs.css" rel="stylesheet" type="text/css">
+<link href="{{ site.baseurl }}/css/code.css" rel="stylesheet" type="text/css">
<link rel="stylesheet" href="//maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css">
<link href="{{ site.baseurl }}/css/responsive.css" rel="stylesheet" type="text/css">
-
<link rel="shortcut icon" href="{{ site.baseurl }}/favicon.ico" type="image/x-icon">
<link rel="icon" href="{{ site.baseurl }}/favicon.ico" type="image/x-icon">
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/blog/_drafts/drill-0.9-released.md
----------------------------------------------------------------------
diff --git a/blog/_drafts/drill-0.9-released.md b/blog/_drafts/drill-0.9-released.md
deleted file mode 100644
index 5291f6a..0000000
--- a/blog/_drafts/drill-0.9-released.md
+++ /dev/null
@@ -1,32 +0,0 @@
----
-layout: post
-title: "Drill 0.9 Released"
-code: drill-0.9-released
-excerpt: The community has just released Drill 0.9, which includes 199 resolved JIRAs and numerous enhancements.
-authors: ["tshiran", "jnadeau"]
----
-It has been about a month since the release of Drill 0.8, which included [more than 240 improvements]({{ site.baseurl }}/blog/drill-0.8-released/). Today we're happy to announce the availability of Drill 0.9, providing additional enhancements and bug fixes. In fact, this release includes [199 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328813). Some of the noteworthy features in Drill 0.9 are:
-
-* **Authentication** ([DRILL-2674](https://issues.apache.org/jira/browse/DRILL-2674)). Drill now supports username/password authentication through the Java and C++ clients, as well as JDBC and ODBC. On the server-side, Drill leverages Linux PAM to securely validate the credentials. Users can choose to use an external user directory such as Active Directory or LDAP. To enable authentication, set the `security.user.auth` option in `drill-override.conf`.
-* **Impersonation** ([DRILL-2363](https://issues.apache.org/jira/browse/DRILL-2363)). Queries now execute and access resources using the identity of the user who submitted the query. Previously, all queries would run as the same user (eg, `drill`). With the new impersonation capability, the query will fail if the submitting user does not have permission to read the requested file(s) in the distributed file system. To enable impersonation, set the `drill.exec.impersonation` option in `drill-override.conf`.
-* **Ownership chaining**. Drill now allows views with different owners to be chained. This represents a very flexible access control solution. For example, an administrator with access to raw, sensitive data could create a view called `masked` which would expose only a subset of the data to other users. The administrator would enable users to read the `masked` view but not the raw data. Note that Drill provides an option `max_chained_user_hops` that specifies how many ownership changed are allowed in a chain, thereby providing administrators (or data stewards) more control over sharing of data.
-* **Extended JSON datatypes**. Our friends at MongoDB invented [extended JSON](http://docs.mongodb.org/manual/reference/mongodb-extended-json/) - a set of extensions to the JSON format for supporting additional data types. We decided to embrace extended JSON in Drill. For example, standard JSON doesn't have a time type, so a time could be represented as either a string or a number: `{"foo": "19:20:30.450Z"}` is just a string. With extended JSON, the `$time` qualifier can be used to specify that `foo` is a time `{"foo": {"$time": "19:20:30.450Z"}}`.
- We now support a number of qualifiers including `$bin`, `$date`, `$time`, `$interval`, `$numberLong` and `$dateDay` (see [the example](https://github.com/apache/drill/blob/master/exec/java-exec/src/test/resources/vector/complex/extended.json)). We're in the process of adding some additional qualifiers to make sure that all of MongoDB's extended types are supported (this is particularly important when querying data in MongoDB).
-* **Avro support** ([DRILL-1512](https://issues.apache.org/jira/browse/DRILL-1512)). Drill can now read Avro files. This patch was contributed by Andrew Selden at Elastic.co (formerly known as Elasticsearch).
-* **Improved error messages** ([DRILL-2675](https://issues.apache.org/jira/browse/DRILL-2675) and more). It can be challenging for a complex distributed system like Drill to translate low-level internal conditions into actionable messages to the user. This release includes several enhancements that enable Drill to accomplish just that in a variety of cases.
-* **Parquet and Calcite enhancements** ([DRILL-1410](https://issues.apache.org/jira/browse/DRILL-1410) and [DRILL-1384](https://issues.apache.org/jira/browse/DRILL-1384)). Drill isn't a traditional query engine - it's the first analytical query engine with a JSON data model. This has required us to enhance Parquet (our columnar format) and Calcite (our SQL parser). These enhancements have now been contributed back to those projects, and Drill is using the latest versions which include these enhancements.
-* **New sys tables for memory and thread information** ([DRILL-2275](https://issues.apache.org/jira/browse/DRILL-2275)). Drill includes two new `sys` tables that provide real-time metrics about memory utilization and threads on each of the nodes in the cluster. You can run a simple `SELECT *` to see what information is available:
-
- ```sql
- SELECT * FROM sys.drillmemory;
- SELECT * FROM sys.drillbitthreads;
- ```
-
-* **Support for very wide tables** ([DRILL-2739](https://issues.apache.org/jira/browse/DRILL-2739)). Drill previously had some issues with tables that had more than 4095 colums. This limitation has been addressed.
-
-You can now [download Drill 0.9]({{ site.baseurl }}/download/). As always, you may check out the official [release notes](https://cwiki.apache.org/confluence/display/DRILL/Release+Notes) for more details.
-
-We're gearing up for Drill's 1.0 release later this month. Stay tuned!
-
-Happy Drilling!
-Tomer Shiran and Jacques Nadeau
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/blog/_posts/2015-05-04-drill-0.9-released.md
----------------------------------------------------------------------
diff --git a/blog/_posts/2015-05-04-drill-0.9-released.md b/blog/_posts/2015-05-04-drill-0.9-released.md
new file mode 100644
index 0000000..6587c85
--- /dev/null
+++ b/blog/_posts/2015-05-04-drill-0.9-released.md
@@ -0,0 +1,33 @@
+---
+layout: post
+title: "Drill 0.9 Released"
+code: drill-0.9-released
+excerpt: The community has just released Drill 0.9, which includes 199 resolved JIRAs and numerous enhancements.
+authors: ["tshiran", "jnadeau"]
+---
+It has been about a month since the release of Drill 0.8, which included [more than 240 improvements]({{ site.baseurl }}/blog/drill-0.8-released/). Today we're happy to announce the availability of Drill 0.9, providing additional enhancements and bug fixes. In fact, this release includes [200 resolved JIRAs](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12328813). Some of the noteworthy features in Drill 0.9 are:
+
+* **Authentication** ([DRILL-2674](https://issues.apache.org/jira/browse/DRILL-2674)). Drill now supports username/password authentication through the Java and C++ clients, as well as JDBC and ODBC. On the server-side, Drill leverages Linux PAM to securely validate the credentials. Users can choose to use an external user directory such as Active Directory or LDAP. To enable authentication, set the `security.user.auth` option in `drill-override.conf`.
+* **Impersonation** ([DRILL-2363](https://issues.apache.org/jira/browse/DRILL-2363)). Queries now execute and access resources using the identity of the user who submitted the query. Previously, all queries would run as the same user (eg, `drill`). With the new impersonation capability, the query will fail if the submitting user does not have permission to read the requested file(s) in the distributed file system. To enable impersonation, set the `drill.exec.impersonation` option in `drill-override.conf`.
+* **Ownership chaining**. Drill now allows views with different owners to be chained. This represents a very flexible access control solution. For example, an administrator with access to raw, sensitive data could create a view called `masked` which would expose only a subset of the data to other users. The administrator would enable users to read the `masked` view but not the raw data. Note that Drill provides an option `max_chained_user_hops` that specifies how many ownership changed are allowed in a chain, thereby providing administrators (or data stewards) more control over sharing of data.
+* **MongoDB authentication** ([DRILL-1502](https://issues.apache.org/jira/browse/DRILL-1502)). Drill can now connect to a MongoDB cluster that requires authentication.
+* **Extended JSON datatypes**. Our friends at MongoDB invented [extended JSON](http://docs.mongodb.org/manual/reference/mongodb-extended-json/) - a set of extensions to the JSON format for supporting additional data types. We decided to embrace extended JSON in Drill. For example, standard JSON doesn't have a time type, so a time could be represented as either a string or a number: `{"foo": "19:20:30.450Z"}` is just a string. With extended JSON, the `$time` qualifier can be used to specify that `foo` is a time `{"foo": {"$time": "19:20:30.450Z"}}`.
+ We now support a number of qualifiers including `$bin`, `$date`, `$time`, `$interval`, `$numberLong` and `$dateDay` (see [the example](https://github.com/apache/drill/blob/master/exec/java-exec/src/test/resources/vector/complex/extended.json)). We're in the process of adding some additional qualifiers to make sure that all of MongoDB's extended types are supported (this is particularly important when querying data in MongoDB).
+* **Avro support** ([DRILL-1512](https://issues.apache.org/jira/browse/DRILL-1512)). Drill can now read Avro files. This patch was contributed by Andrew Selden at Elastic.co (formerly known as Elasticsearch).
+* **Improved error messages** ([DRILL-2675](https://issues.apache.org/jira/browse/DRILL-2675) and more). It can be challenging for a complex distributed system like Drill to translate low-level internal conditions into actionable messages to the user. This release includes several enhancements that enable Drill to accomplish just that in a variety of cases.
+* **Parquet and Calcite enhancements** ([DRILL-1410](https://issues.apache.org/jira/browse/DRILL-1410) and [DRILL-1384](https://issues.apache.org/jira/browse/DRILL-1384)). Drill isn't a traditional query engine - it's the first analytical query engine with a JSON data model. This has required us to enhance Parquet (our columnar format) and Calcite (our SQL parser). These enhancements have now been contributed back to those projects, and Drill is using the latest versions which include these enhancements.
+* **New sys tables for memory and thread information** ([DRILL-2275](https://issues.apache.org/jira/browse/DRILL-2275)). Drill includes two new `sys` tables that provide real-time metrics about memory utilization and threads on each of the nodes in the cluster. You can run a simple `SELECT *` to see what information is available:
+
+ ```sql
+ SELECT * FROM sys.drillmemory;
+ SELECT * FROM sys.drillbitthreads;
+ ```
+
+* **Support for very wide tables** ([DRILL-2739](https://issues.apache.org/jira/browse/DRILL-2739)). Drill previously had some issues with tables that had more than 4095 colums. This limitation has been addressed.
+
+You can now [download Drill 0.9]({{ site.baseurl }}/download/). As always, you can check out the official [release notes](https://cwiki.apache.org/confluence/display/DRILL/Release+Notes) for more details.
+
+We're gearing up for Drill's 1.0 release later this month. Stay tuned!
+
+Happy Drilling!
+Tomer Shiran and Jacques Nadeau
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/css/button.css
----------------------------------------------------------------------
diff --git a/css/button.css b/css/button.css
deleted file mode 100755
index 0988bc7..0000000
--- a/css/button.css
+++ /dev/null
@@ -1,121 +0,0 @@
-@font-face {
- font-family: 'icomoon';
- src:url('../fonts/icomoon/icomoon.eot');
- src:url('../fonts/icomoon/icomoon.eot?#iefix') format('embedded-opentype'),
- url('../fonts/icomoon/icomoon.woff') format('woff'),
- url('../fonts/icomoon/icomoon.ttf') format('truetype'),
- url('../fonts/icomoon/icomoon.svg#icomoon') format('svg');
- font-weight: normal;
- font-style: normal;
-}
-
-/* General styles for all types of buttons */
-.progress-button {
- position: relative;
- display: block;
- margin:0;
- padding: 0 30px;
- outline: none;
- border: none;
- background: #4aaf4c;
- color: #fff;
- text-transform: uppercase;
- overflow:hidden;
- line-height:50px;
-}
-
-.progress-button[disabled],
-.progress-button[disabled].state-loading {
- cursor: default;
-}
-
-.progress-button .content {
- position: relative;
- display: block;
-}
-
-.progress-button .content::before,
-.progress-button .content::after {
- position: absolute;
- right: 20px;
- color: #0e7138;
- font-family: "icomoon";
- opacity: 0;
- -webkit-transition: opacity 0.3s 0.3s;
- transition: opacity 0.3s 0.3s;
-}
-
-.progress-button .content::before {
- content: "\e600"; /* Checkmark for success */
-}
-
-.progress-button .content::after {
- content: "\e601"; /* Cross for error */
-}
-
-.progress-button.state-success .content::before,
-.progress-button.state-error .content::after {
- opacity: 1;
-}
-
-.notransition {
- -webkit-transition: none !important;
- transition: none !important;
-}
-
-.progress-button .progress {
- background: #148544;
-}
-
-.progress-button .progress-inner {
- position: absolute;
- left: 0;
- top:0;
- background: #0e7138;
-}
-
-.progress-button[data-horizontal] .progress-inner {
- top: 0;
- width: 0;
- height: 100%;
- -webkit-transition: width 0.3s, opacity 0.3s;
- transition: width 0.3s, opacity 0.3s;
-}
-
-.progress-button[data-vertical] .progress-inner {
- bottom: 0;
- width: 100%;
- height: 0;
- -webkit-transition: height 0.3s, opacity 0.3s;
- transition: height 0.3s, opacity 0.3s;
-}
-
-/* Fill horizontal */
-/* ====================== */
-
-.progress-button[data-style="fill"][data-horizontal] {
- overflow: hidden;
-}
-
-.progress-button[data-style="fill"][data-horizontal] .content {
- z-index: 10;
- -webkit-transition: -webkit-transform 0.3s;
- transition: transform 0.3s;
-}
-
-.progress-button[data-style="fill"][data-horizontal] .content::before,
-.progress-button[data-style="fill"][data-horizontal] .content::after {
- top: 100%;
- right: auto;
- left: 50%;
- -webkit-transition: opacity 0.3s;
- transition: opacity 0.3s;
- -webkit-transform: translateX(-50%);
- transform: translateX(-50%);
-}
-
-.progress-button[data-style="fill"][data-horizontal].state-success .content,
-.progress-button[data-style="fill"][data-horizontal].state-error .content {
- -webkit-transform: translateY(-100%);
- transform: translateY(-100%);
-}
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/css/code.css
----------------------------------------------------------------------
diff --git a/css/code.css b/css/code.css
new file mode 100644
index 0000000..b06c8d2
--- /dev/null
+++ b/css/code.css
@@ -0,0 +1,69 @@
+div.highlight pre, code {
+ background: #f5f6f7 url(../images/code-block-bg.png) 0 0 repeat;
+ border-radius: 0;
+ border: none;
+ border-left: 5px solid #494747;
+ font-family: 'Source Code Pro', monospace;
+ font-size: 14px;
+ line-height: 24px;
+ overflow: auto;
+ word-wrap: normal;
+ white-space: pre;
+}
+
+pre {
+ padding: 24px 12px;
+ color: #222;
+ margin: 24px 0;
+}
+code {
+ background: #f5f6f7 url(../images/code-block-bg.png) 0 0 repeat;
+ border-radius: 0;
+ border: none;
+ border-left: 5px;
+ font-family: 'Source Code Pro', monospace;
+ font-size: 14px;
+ line-height: 24px;
+ overflow: auto;
+ word-wrap: normal;
+ white-space: pre;
+}
+
+div.admonition {
+ margin: 24px 0;
+ width: auto;
+ max-width: 100%;
+ padding: 2px 12px 22px 12px;
+ border-left: 5px solid transparent;
+}
+.admonition .admonition-title {
+ margin-bottom: 0;
+ font-size: 12px;
+ font-weight: bold;
+ text-transform: uppercase;
+ line-height: 24px;
+}
+.admonition > p {
+ margin: 0 0 12.5px 0;
+}
+.admonition p.first {
+ margin-top: 0 !important;
+}
+.admonition > p.last {
+ margin-bottom: 0;
+}
+.admonition .admonition-title:after {
+ content: ":";
+ font-weight: 900;
+}
+.admonition.important{
+ background-color: #fff2d5;
+ border-color: #ffb618;
+}
+.admonition.important .admonition-title {
+ color: #ffb618;
+}
+.admonition.note{
+ background-color: #edf4e8;
+ border-color: #6ba442;
+}
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/css/docpage.css
----------------------------------------------------------------------
diff --git a/css/docpage.css b/css/docpage.css
index d88ded6..47c0201 100644
--- a/css/docpage.css
+++ b/css/docpage.css
@@ -102,79 +102,6 @@ div.main-content h1, div.int_title h1 {
padding: 0;
}
-/*****************
- Code Blocks, Important
-*****************/
-div.highlight pre, code {
- background: #f5f6f7 url(../images/code-block-bg.png) 0 0 repeat;
- border-radius: 0;
- border: none;
- border-left: 5px solid #494747;
- font-family: 'Source Code Pro', monospace;
- font-size: 14px;
- line-height: 24px;
- overflow: auto;
- word-wrap: normal;
- white-space: pre;
-}
-
-pre {
- padding: 24px 12px;
- color: #222;
- margin: 24px 0;
-}
-code {
- background: #f5f6f7 url(../images/code-block-bg.png) 0 0 repeat;
- border-radius: 0;
- border: none;
- border-left: 5px;
- font-family: 'Source Code Pro', monospace;
- font-size: 14px;
- line-height: 24px;
- overflow: auto;
- word-wrap: normal;
- white-space: pre;
-}
-
-div.admonition {
- margin: 24px 0;
- width: auto;
- max-width: 100%;
- padding: 2px 12px 22px 12px;
- border-left: 5px solid transparent;
-}
-.admonition .admonition-title {
- margin-bottom: 0;
- font-size: 12px;
- font-weight: bold;
- text-transform: uppercase;
- line-height: 24px;
-}
-.admonition > p {
- margin: 0 0 12.5px 0;
-}
-.admonition p.first {
- margin-top: 0 !important;
-}
-.admonition > p.last {
- margin-bottom: 0;
-}
-.admonition .admonition-title:after {
- content: ":";
- font-weight: 900;
-}
-.admonition.important{
- background-color: #fff2d5;
- border-color: #ffb618;
-}
-.admonition.important .admonition-title {
- color: #ffb618;
-}
-.admonition.note{
- background-color: #edf4e8;
- border-color: #6ba442;
-}
-
/***************************
/* Sidebar doc menu styles
***************************/
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/css/download.css
----------------------------------------------------------------------
diff --git a/css/download.css b/css/download.css
new file mode 100644
index 0000000..0c92169
--- /dev/null
+++ b/css/download.css
@@ -0,0 +1,33 @@
+.table {
+ display: table; /* Allow the centering to work */
+ margin: 0 auto;
+}
+
+ul#download_buttons {
+ list-style: none;
+ padding-left:0px;
+ margin-bottom:100px;
+}
+
+ul#download_buttons li {
+ float: left;
+ text-align: center;
+ background-color: #4aaf4c;
+ margin:0 10px 10px 10px;
+ width: 235px;
+ line-height: 60px;
+}
+
+ul#download_buttons li a{
+ text-decoration:none;
+ color:#fff;
+ display:block;
+}
+
+ul#download_buttons li a:hover {
+ background-color: #348436;
+}
+
+div#download_bar:after{
+ clear:both;
+}
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/css/style.css
----------------------------------------------------------------------
diff --git a/css/style.css b/css/style.css
index 63cd695..a696884 100755
--- a/css/style.css
+++ b/css/style.css
@@ -92,13 +92,7 @@ a.anchor {
line-height:50px;
padding:14px 20px;
}
-/*
-#menu ul li.d, #menu ul li.d:hover {
- background:#4aaf4c;
- font-weight:bold;
- text-transform:uppercase;
-}
-*/
+
#menu ul li.d, #menu ul li.d:hover {
background-color: #4aaf4c;
font-size:12px;
@@ -530,42 +524,6 @@ table.intro a {
width:770px;
}
-.getInvolved {
- background:#f6f5f7;
- font-size:14px;
- font-weight:lighter;
- line-height:26px;
- padding:50px 0;
-}
-
-.getInvolved .wrapper {
- margin:auto;
- width:780px;
-}
-
-.getInvolved a {
- color:#1a6bc7;
- text-decoration:none;
-}
-
-.getInvolved table {
- font-size:12px;
- margin-top:10px;
- table-layout:fixed;
- width:100%;
-}
-.getInvolved table td, .getInvolved table th {
- text-align:left;
-}
-
-.getInvolved table th {
- border-bottom:1px solid #e9e9e9;
-}
-
-.getInvolved table td {
- border-top:1px solid #f0f0f0;
-}
-
#blu {
display:table;
font-size:12px;
@@ -705,24 +663,6 @@ div.post.int_text {
margin:30px auto;
}
-.int_text table {
- font-size:14px;
- margin-bottom:50px;
- width:100%;
-}
-.int_text table td, .int_text table th {
- padding:7px;
- text-align:left;
-}
-
-.int_text table tr td:first-child, .int_text table tr th:first-child {
- padding-left:0px;
-}
-
-.int_text table.ul td {
- border-top:1px solid #e9e9e9;
-}
-
ul.num {
list-style:decimal;
}
@@ -794,49 +734,6 @@ table.intro a, .int_title a {
#header .dots, .aLeft, .aRight { display:none; }
-div.download { text-align:center; }
-
-div.download table { table-layout:fixed; }
-
-div.download table a {
- background-size:16px auto;
- background-position:17px center;
- background-repeat:no-repeat;
- padding:10px 35px 10px 45px;
- line-height:40px;
- font-size:12px;
- font-weight:normal;
- color:#FFF;
-}
-
-div.download table a.dl {
- background-color:#4aaf4c;
- background-size:13px auto;
- background-image:url(../images/download-ico.png);
-}
-
-div.download table a.dl:hover {
- background-color:#348436;
-}
-
-div.download table a.find {
- background-color:#4aaf4c;
- background-image:url(../images/btn-lens.png);
-}
-
-div.download table a.find:hover {
- background-color:#348436;
-}
-
-div.download table a.tutorial {
- background-color:#1a6bc7;
- background-image:url(../images/btn-lens.png);
-}
-
-div.download table a.tutorial:hover {
- background-color:#145aa8;
-}
-
p.info {
background-color: #ffc;
border: solid 1px #cc9;
@@ -912,4 +809,15 @@ li p {
color: white;
}
-
+.int_text table{border-collapse:collapse;border-spacing:0;empty-cells:show;border:1px solid #cbcbcb}
+.int_text table caption{color:#000;font-style: italic;padding:1em 0;text-align:center}
+.int_text table td, .int_text table th{border-left:1px solid #cbcbcb;border-width:0 0 0 1px;font-size:inherit;margin:0;overflow:visible;padding:.5em 1em}
+.int_text table td:first-child, .int_text table th:first-child{border-left-width:0}
+.int_text table thead{background-color:#e0e0e0;color:#000;text-align:left;vertical-align:bottom}
+.int_text table td{background-color:transparent}
+.int_text table-odd td{background-color:#f2f2f2}
+.int_text table-striped tr:nth-child(2n-1) td{background-color:#f2f2f2}
+.int_text table-bordered td{border-bottom:1px solid #cbcbcb}
+.int_text table-bordered tbody>tr:last-child>td{border-bottom-width:0}
+.int_text table-horizontal td, .int_text table-horizontal th{border-width:0 0 1px;border-bottom:1px solid #cbcbcb}
+.int_text table-horizontal tbody>tr:last-child>td{border-bottom-width:0}
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/download.html
----------------------------------------------------------------------
diff --git a/download.html b/download.html
index 5f43bf8..8da6b13 100755
--- a/download.html
+++ b/download.html
@@ -2,49 +2,27 @@
layout: page
title: Download
---
-<div class="download">
- <h2>The latest release is Drill 0.8.0, released March 31, 2015</h2>
- <br>
+<link href="{{ site.baseurl }}/css/download.css" rel="stylesheet" type="text/css">
+<p>Drill {{ site.data.version.display_version }} was released on {{ site.data.version.release_date }}.</p>
- <table>
- <tr>
- <td><a href="http://www.apache.org/dyn/closer.cgi/drill/drill-0.8.0/apache-drill-0.8.0.tar.gz" class="find" id="apachemirror">FIND AN APACHE MIRROR</a></td>
- <!-- Or: http://archive.apache.org/dist/drill/drill-0.7.0/apache-drill-0.7.0.tar.gz, https://dist.apache.org/repos/dist/release/drill/drill-0.7.0/apache-drill-0.7.0.tar.gz -->
- <td><a href="http://getdrill.org/drill/download/apache-drill-0.8.0.tar.gz" rel="nofollow" class="dl" id="directdownload">DIRECT FILE DOWNLOAD</a></td>
- <td><a href="https://cwiki.apache.org/confluence/display/DRILL/Using+ODBC+to+Access+Apache+Drill+from+BI+Tools" class="dl">ODBC DRIVERS FOR DRILL*</a></td>
- </tr>
- </table>
+<div id="download_bar">
+<div class="table">
+<ul id="download_buttons">
+<li><a href="http://www.apache.org/dyn/closer.cgi/drill/drill-{{ site.data.version.full_version }}/apache-drill-{{ site.data.version.full_version }}.tar.gz" class="find" id="apachemirror">Find an Apache Mirror</a></li>
+<li><a href="http://getdrill.org/drill/download/apache-drill-{{ site.data.version.full_version }}.tar.gz" rel="nofollow" class="dl" id="directdownload">Direct File Download</a></li>
+<li><a href="{{ site.baseurl }}/docs/interfaces-introduction/" class="dl">Client Drivers (ODBC/JDBC)</a></li>
+</ul>
+</div>
+</div>
- <p style="margin-top:1px; padding-top:1px;">
- <strong>Release Notes: </strong><a href="https://cwiki.apache.org/confluence/display/DRILL/Release+Notes"> Click here</a> |
- <strong>Fork Drill 0.8 on GitHub: </strong><a href="https://github.com/apache/drill/tree/0.8.0" rel="nofollow">Click here</a>
- </p>
+<p>Additional resources for Drill {{ site.data.version.display_version }}:</p>
+<ul>
+<li><a href="{{ site.baseurl }}/docs/apache-drill-{{ site.data.version.full_version | handleize }}-release-notes/">Release notes</a></li>
+<li><a href="https://github.com/apache/drill/tree/{{ site.data.version.full_version }}">Source code</a></li>
+</ul>
- <br>
- <!--<div style="border-top: solid 2px #1a6bc7; border-bottom: solid 2px #1a6bc7;padding: 5px;">-->
- <!--<div style="background: #e7e7e7; padding:1px 0px 0px 0px;">-->
- <h2>Visit the Apache Drill Tutorial for sample datasets and code examples</h2><br>
- <table>
- <tr>
- <td> </td>
- <td style="padding-left: 38px"><a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+Tutorial" rel="nofollow" target="_blank" class="tutorial">DRILL TUTORIAL</a></td>
- <td> </td>
- </tr>
- <tr>
- <td> </td>
- <td></td>
- <td> </td>
- </tr>
- </table>
+<p>If you're looking for an older release, see the <a href="{{ site.baseurl }}/docs/release-notes/">release notes</a>.
- <!--</div>-->
- <!--</div>-->
- <p style="margin-top:0px; padding-top:0px;"><strong>Don't have Hadoop deployed? You can try <a href="https://www.mapr.com/products/mapr-sandbox-hadoop/download-sandbox-drill" rel="nofollow">Drill with a VM</a>*</p>
- <br>
- <p style="margin-top:1px; padding-top:1px;"><strong>Previous Drill releases: </strong><a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+0.7.0+Release+Notes" rel="nofollow">0.7.0</a> |<a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+0.6.0+Release+Notes" rel="nofollow">0.6.0</a> | <a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+0.5.0+Release+Notes" rel="nofollow">0.5.0</a> | <a href="https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+0.4.0+Release+Notes" rel="nofollow">0.4.0</a></p>
- <br><br>
- <p>*Please note that ODBC drivers and VM are provided by a third-party under a non-Apache license.</p>
-</div>
<script type="text/javascript">
$('#directdownload').click(function(event) {
ga('send', 'event', 'Downloads', 'Direct', 'Direct Download');
@@ -59,3 +37,4 @@ $('#apachemirror').click(function(event) {
});
});
</script>
+
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/faq.md
----------------------------------------------------------------------
diff --git a/faq.md b/faq.md
index 41d8ed2..1c5d625 100755
--- a/faq.md
+++ b/faq.md
@@ -2,104 +2,133 @@
layout: page
title: Frequently Asked Questions
---
-## What use cases should I consider using Drill for?
+## Overview
-Drill provides low latency SQL queries on large-scale datasets. Example use cases for Drill include
+### Why Drill?
-* Interactive data exploration/data discovery
-* Adhoc BI/reporting queries
-* Analytics on NoSQL data
-* Real time or Day zero analytics (i.e analyze data as it comes with no preparation/ETL)
+The 40-year monopoly of the RDBMS is over. With the exponential growth of data in recent years, and the shift towards rapid application development, new data is increasingly being stored in non-relational datastores including Hadoop, NoSQL and cloud storage. Apache Drill enables analysts, business users, data scientists and developers to explore and analyze this data without sacrificing the flexibility and agility offered by these datastores. Drill processes the data in-situ without requiring users to define schemas or transform data.
-We expect Drill to be used in lot more use cases where low latency is required.
+### What are some of Drill's key features?
-## Does Drill replace Hive for batch processing? What about my OLTP applications?
+Drill is an innovative distributed SQL engine designed to enable data exploration and analytics on non-relational datastores. Users can query the data using standard SQL and BI tools without having to create and manage schemas. Some of the key features are:
-Drill complements batch-processing frameworks such as Hive, Pig, MapReduce to support low latency queries. Drill at this point doesn't make an optimal choice for OLTP/operational applications that require sub-second response times.
+* Schema-free JSON document model similar to MongoDB and Elasticsearch
+* Industry-standard APIs: ANSI SQL, ODBC/JDBC, RESTful APIs
+* Extremely user and developer friendly
+* Pluggable architecture enables connectivity to multiple datastores
-## There are lots of SQL on Hadoop technologies out there. How is Drill different?
+### How does Drill achieve performance?
-Drill takes a different approach to SQL-on-Hadoop than Hive and other related technologies. The goal for Drill is to bring the SQL ecosystem and performance of the relational systems to Hadoop-scale data without compromising on the flexibility of Hadoop/NoSQL systems. Drill provides a flexible query environment for users with the key capabilities as below.
+Drill is built from the ground up to achieve high throughput and low latency. The following capabilities help accomplish that:
-* Self-describing data support without centralized schema definitions/management
-* Support for complex/multi-structured data types
-* ANSI SQL support (not SQL "Like") & BI tool integration
-* Extensibility to go beyond Hadoop environments
+* **Distributed query optimization and execution**: Drill is designed to scale from a single node (your laptop) to large clusters with thousands of servers.
+* **Columnar execution**: Drill is the world's only columnar execution engine that supports complex data and schema-free data. It uses a shredded, in-memory, columnar data representation.
+* **Runtime compilation and code generation**: Drill is the world's only query engine that compiles and re-compiles queries at runtime. This allows Drill to achieve high performance without knowing the structure of the data in advance. Drill leverages multiple compilers as well as ASM-based bytecode rewriting to optimize the code.
+* **Vectorization**: Drill takes advantage of the latest SIMD instructions available in modern processors.
+* **Optimistic/pipelined execution**: Drill is able to stream data in memory between operators. Drill minimizes the use of disks unless needed to complete the query.
-## What is self-describing data?
+### What datastores does Drill support?
-Self-describing data is where schema is specified as part of the data itself. File formats such as Parquet, JSON, ProtoBuf, XML, AVRO and NoSQL databases are all examples of self-describing data. Some of these data formats also dynamic and complex in that every record in the data can have its own set of columns/attributes and each column can be semi-structured/nested.
+Drill is primarily focused on non-relational datastores, including Hadoop, NoSQL and cloud storage. The following datastores are currently supported:
-## How does Drill support queries on self-describing data?
+* **Hadoop**: All Hadoop distributions (HDFS API 2.3+), including Apache Hadoop, MapR, CDH and Amazon EMR
+* **NoSQL**: MongoDB, HBase
+* **Cloud storage**: Amazon S3, Google Cloud Storage, Azure Blog Storage, Swift
-Drill enables queries on self-describing data using the fundamental architectural foundations:
+A new datastore can be added by developing a storage plugin. Drill's unique schema-free JSON data model enables it to query non-relational datastores in-situ (many of these systems store complex or schema-free data).
-* Dynamic schema discovery or late binding: Drill allows performing queries directly on self-describing data such as Files, HBase without defining overlay schema definitions in Hive metastore. The schema is discovered on the fly at the query time. With the dynamic schema discovery, Drill makes it easy to support dynamic and rapidly evolving data models.
-* Flexible data model: Drill is built from the ground up for complex/semi-structured data commonly seen in Hadoop/NoSQL systems. Drill provides intuitive extensions to SQL to represent and operate on complex data. The internal data model of Drill is hierarchical and columnar with which it can represent and perform efficient SQL processing on complex data natively without flattening into rows either at the design time or runtime.
+### What clients are supported?
-Together with the dynamic data discovery and a flexible data model that can handle complex data types, Drill allows users to get fast and complete value from all their data.
+* **BI tools** via the ODBC and JDBC drivers (eg, Tableau, Excel, MicroStrategy, Spotfire, QlikView, Business Objects)
+* **Custom applications** via the REST API
+* **Java and C applications** via the dedicated Java and C libraries
-## But I already have schemas defined in Hive metastore? Can I use that with Drill?
+## Comparisons
-Yes, Hive also serves as data source for Drill. So you can simply point to the Hive metastore from Drill and start performing low latency queries on Hive tables with no modifications.
+### Is Drill a 'SQL-on-Hadoop' engine?
-## Is Drill trying to be "anti-schema" or "anti-DBA"?
+Drill supports a variety of non-relational datastores in addition to Hadoop. Drill takes a different approach compared to traditional SQL-on-Hadoop technologies like Hive and Impala. For example, users can directly query self-describing data (eg, JSON, Parquet) without having to create and manage schemas.
-Of course not! Central EDW schemas work great if data models are not changing often, value of data is well understood and is ready to be operationalized for regular reporting purposes. However, during data exploration and discovery phase, rigid modeling requirement poses challenges and delays value from data, especially in the Hadoop/NoSQL environments where the data is highly complex, dynamic and evolving fast. Few challenges include
+The following table provides a more detailed comparison between Drill and traditional SQL-on-Hadoop technologies:
-* Complex data models (eg: JSON) are hard to map to relational paradigms
-* Centralized schemas are hard to keep up with when data models evolve fast
-* Static models defined for known questions are not enough for the diversity and volumes of big data
-* Non-repetitive/ad hoc queries and short-term data exploration needs may not justify modeling costs
+| | Drill | SQL-on-Hadoop (Hive, Impala, etc.) |
+|---|-------|------------------------------------|
+| Use case | Self-service, in-situ, SQL-based analytics | Data warehouse offload |
+| Data sources | Hadoop, NoSQL, cloud storage (including multiple instances)| A single Hadoop cluster |
+| Data model | Schema-free JSON (like MongoDB) | Relational |
+| User experience | Point-and-query | Ingest data → define schemas → query |
+| Deployment model | Standalone service or co-located with Hadoop or NoSQL | Co-located with Hadoop |
+| Data management | Self-service | IT-driven |
+| SQL | ANSI SQL | SQL-like |
+| 1.0 availability | Q2 2015 | Q2 2013 or earlier |
-Drill is all about flexibility. The flexible schema management capabilities in Drill lets users explore the data in its native format as it comes in directly and create models/structure if needed in Hive metastore or using the CREATE TABLE/CREATE VIEW syntax within Drill.
+### Is Spark SQL similar to Drill?
-## What does a Drill query look like?
+No. Spark SQL is primarily designed to enable developers to incorporate SQL statements in Spark programs. Drill does not depend on Spark, and is targeted at business users, analysts, data scientists and developers.
-Drill uses a de-centralized metadata model and relies on its storage plugins to provide with the metadata. Drill supports queries on file system (distributed and local), HBase and Hive tables. There is a storage plugin associated with each data source that is supported by Drill.
+### Does Drill replace Hive?
-Here is the anatomy of a Drill query.
+Hive is a batch processing framework most suitable for long-running jobs. For data exploration and BI, Drill provides a much better experience than Hive.
-
+In addition, Drill is not limited to Hadoop. For example, it can query NoSQL databases (eg, MongoDB, HBase) and cloud storage (eg, Amazon S3, Google Cloud Storage, Azure Blob Storage, Swift).
-## Can I connect to Drill from my BI tools (Tableau, MicroStrategy, etc.)?
+## Metadata
-Yes, Drill provides JDBC/ODBC drivers for integrating with BI/SQL based tools.
+### How does Drill support queries on self-describing data?
-## What SQL functionality can Drill support?
+Drill's flexible JSON data model and on-the-fly schema discovery enable it to query self-describing data.
-Drill provides ANSI standard SQL (not SQL "Like" or Hive QL) with support for all key analytics functionality such as SQL data types, joins, aggregations, filters, sort, sub-queries (including correlated), joins in where clause etc. [Click here](https://cwiki.apache.org/confluence/display/DRILL/SQL+Reference) for reference on SQL functionality in Drill.
+* **JSON data model**: Traditional query engines have a relational data model, which is limited to flat records with a fixed structure. Drill is built from the ground up to support modern complex/semi-structured data commonly seen in non-relational datastores such as Hadoop, NoSQL and cloud storage. Drill's internal in-memory data representation is hierarchical and columnar, allowing it to perform efficient SQL processing on complex data without flattening into rows.
+* **On-the-fly schema discovery (or late binding)**: Traditional query engines (eg, relational databases, Hive, Impala, Spark SQL) need to know the structure of the data before query execution. Drill, on the other hand, features a fundamentally different architecture, which enables execution to begin without knowing the structure of the data. The query is automatically compiled and re-compiled during the execution phase, based on the actual data flowing through the system. As a result, Drill can handle data with evolving schema or even no schema at all (eg, JSON files, MongoDB collections, HBase tables).
-## What Hadoop distributions does Drill work with?
+### But I already have schemas defined in Hive Metastore? Can I use that with Drill?
-Drill is not designed with a particular Hadoop distribution in mind and we expect it to work with all Hadoop distributions that support Hadoop 2.3.x+ API. We have validated it so far with Apache Hadoop/MapR/CDH/Amazon EMR distributions (Amazon EMR requires a custom configuration required - contact <us...@drill.apache.org> for questions.
+Absolutely. Drill has a storage plugin for Hive tables, so you can simply point Drill to the Hive Metastore and start performing low-latency queries on Hive tables. In fact, a single Drill cluster can query data from multiple Hive Metastores, and even perform joins across these datasets.
-## How does Drill achieve performance?
+### Is Drill "anti-schema" or "anti-DBA"?
-Drill is built from the ground up for performance on large-scale datasets. The key architectural components that help in achieving performance include.
+Not at all. Drill actually takes advantage of schemas when available. For example, Drill leverages the schema information in Hive when querying Hive tables. However, when querying schema-free datastores like MongoDB, or raw files on S3 or Hadoop, schemas are not available, and Drill is still able to query that data.
-* Distributed query optimization & execution
-* Columnar execution
-* Vectorization
-* Runtime compilation & code generation
-* Optimistic/pipelined execution
+Centralized schemas work well if the data structure is static, and the value of data is well understood and ready to be operationalized for regular reporting purposes. However, during data exploration, discovery and interactive analysis, requiring rigid modeling poses significant challenges. For example:
-## Does Drill support multi-tenant/high concurrency environments?
+* Complex data (eg, JSON) is hard to map to relational tables
+* Centralized schemas are hard to keep in sync when the data structure is changing rapidly
+* Non-repetitive/ad-hoc queries and data exploration needs may not justify modeling costs
-Drill is built to support several 100s of queries at any given point. Clients can submit requests to any node running Drillbit service in the cluster (no master-slave concept). To support more users, you simply have to add more nodes to the cluster.
+Drill is all about flexibility. The flexible schema management capabilities in Drill allow users to explore raw data and then create models/structure with `CREATE TABLE` or `CREATE VIEW` statements, or with Hive Metastore.
-## Do I need to load data into Drill to start querying it?
+### What does a Drill query look like?
-No. Drill can query data "in situ".
+Drill uses a decentralized metadata model and relies on its storage plugins to provide metadata. There is a storage plugin associated with each data source that is supported by Drill.
-## What is the best way to get started with Drill?
+The name of the table in a query tells Drill where to get the data:
-The best way to get started is to just try it out. It just takes a few minutes even if you do not have a cluster. Here is a good place to start: [Apache Drill in 10 minutes](https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+in+10+Minutes).
+```sql
+SELECT * FROM dfs1.root.`/my/log/files/`;
+SELECT * FROM dfs2.root.`/home/john/log.json`;
+SELECT * FROM mongodb1.website.users;
+SELECT * FROM hive1.logs.frontend;
+SELECT * FROM hbase1.events.clicks;
+```
-## How can I ask questions and provide feedback?
+### What SQL functionality does Drill support?
-Please post your questions and feedback on <us...@drill.apache.org>. We are happy to have you try out Drill and help with any questions!
+Drill supports standard SQL (aka ANSI SQL). In addition, it features several extensions that help with complex data, such as the `KVGEN` and `FLATTEN` functions. For more details, refer to the [SQL Reference]({{ site.baseurl }}/docs/sql-reference/).
-## How can I contribute to Drill?
+### Do I need to load data into Drill to start querying it?
-Please refer to the [Get Involved]({{ site.baseurl }}/community/#getinvolved) page on how to get involved with Drill.
+No. Drill can query data 'in-situ'.
+
+## Getting Started
+
+### What is the best way to get started with Drill?
+
+The best way to get started is to try it out. It only takes a few minutes and all you need is a laptop (Mac, Windows or Linux). We've compiled [several tutorials]({{ site.baseurl }}/docs/tutorials-introduction/) to help you get started.
+
+### How can I ask questions and provide feedback?
+
+Please post your questions and feedback to <us...@drill.apache.org>. We are happy to help!
+
+### How can I contribute to Drill?
+
+The documentation has information on [how to contribute]({{ site.baseurl }}/docs/contribute-to-drill/).
http://git-wip-us.apache.org/repos/asf/drill/blob/efbcbc42/team.md
----------------------------------------------------------------------
diff --git a/team.md b/team.md
index 68c5cc2..a42189a 100755
--- a/team.md
+++ b/team.md
@@ -8,22 +8,22 @@ We welcome contributions to the project. If you're interested in contributing, t
## Drill Committers
-| Name | Alias (email is <alias>@apache.org) | |
-|------|-------|------|
-| Jacques Nadeau (PMC Chair and VP Apache Drill) | jacques | |
-| Tomer Shiran | tshiran | |
-| Ted Dunning | tdunning | |
-| Jason Frantz | jason | |
-| MC Srivas | srivas | |
-| Julian Hyde | jhyde | |
-| Tim Chen | tnachen | |
-| Mehant Baid | mehant | |
-| Jinfeng Ni | jni | |
-| Venki Korukanti | venki | |
-| Jason Altekruse | json | |
-| Aditya Kishore | adi | |
-| Parth Chandra | parthc | |
-| Aman Sinha | amansinha | |
-| Steven Phillips | smp | |
-| Bridget Bevens | bridgetb | |
-| Hanifi Gunes | hg | |
+| Name | Alias (email is <alias>@apache.org) |
+|------|-------|
+| **Jacques Nadeau (PMC Chair and VP Apache Drill)** | **jacques** |
+| Tomer Shiran | tshiran |
+| Ted Dunning | tdunning |
+| Jason Frantz | jason |
+| MC Srivas | srivas |
+| Julian Hyde | jhyde |
+| Tim Chen | tnachen |
+| Mehant Baid | mehant |
+| Jinfeng Ni | jni |
+| Venki Korukanti | venki |
+| Jason Altekruse | json |
+| Aditya Kishore | adi |
+| Parth Chandra | parthc |
+| Aman Sinha | amansinha |
+| Steven Phillips | smp |
+| Bridget Bevens | bridgetb |
+| Hanifi Gunes | hg |