You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by ts...@apache.org on 2015/05/21 00:00:26 UTC
[1/6] drill git commit: upper to lowercase png, DRILL-3134
Repository: drill
Updated Branches:
refs/heads/gh-pages 0120d252a -> c77a3122d
upper to lowercase png, DRILL-3134
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/e45f60c3
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/e45f60c3
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/e45f60c3
Branch: refs/heads/gh-pages
Commit: e45f60c33b8cf0660a485e7ab924078269e0361c
Parents: 0120d25
Author: Kristine Hahn <kh...@maprtech.com>
Authored: Wed May 20 10:05:06 2015 -0700
Committer: Kristine Hahn <kh...@maprtech.com>
Committed: Wed May 20 10:05:06 2015 -0700
----------------------------------------------------------------------
.../050-json-data-model.md | 2 +-
_docs/img/execution-tree.PNG | Bin 13849 -> 16724 bytes
.../data-types/010-supported-data-types.md | 10 +++++++---
3 files changed, 8 insertions(+), 4 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/e45f60c3/_docs/data-sources-and-file-formats/050-json-data-model.md
----------------------------------------------------------------------
diff --git a/_docs/data-sources-and-file-formats/050-json-data-model.md b/_docs/data-sources-and-file-formats/050-json-data-model.md
index a793dbf..183ea17 100644
--- a/_docs/data-sources-and-file-formats/050-json-data-model.md
+++ b/_docs/data-sources-and-file-formats/050-json-data-model.md
@@ -56,7 +56,7 @@ When you set this option, Drill reads all numbers from the JSON files as DOUBLE.
* Cast JSON values to [SQL types]({{ site.baseurl }}/docs/json-data-model/#data-type-mapping), such as BIGINT, FLOAT, and INTEGER.
* Cast JSON strings to [Drill Date/Time Data Type Formats]({{ site.baseurl }}/docs/date-time-and-timestamp).
-Drill uses [map and array data types]({{ site.baseurl }}/docs/handling-different-data-types/#handling-json-and-parquet-data) internally for reading complex and nested data structures from JSON. You can cast data in a map or array of data to return a value from the structure, as shown in [“Create a view on a MapR-DB table”] ({{ site.baseurl }}/docs/lesson-2-run-queries-with-ansi-sql/#create-a-view-on-a-mapr-db-table). [“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) shows how to access nested arrays.
+Drill uses [map and array data types]({{ site.baseurl }}/docs/handling-different-data-types/#handling-json-and-parquet-data) internally for reading complex and nested data structures from data sources such as JSON. You can cast data in a map or array of data to return a value from the structure, as shown in [“Create a view on a MapR-DB table”] ({{ site.baseurl }}/docs/lesson-2-run-queries-with-ansi-sql/#create-a-view-on-a-mapr-db-table). [“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) shows how to access nested arrays.
## Reading JSON
To read JSON data using Drill, use a [file system storage plugin]({{ site.baseurl }}/docs/file-system-storage-plugin/) that defines the JSON format. You can use the `dfs` storage plugin, which includes the definition.
http://git-wip-us.apache.org/repos/asf/drill/blob/e45f60c3/_docs/img/execution-tree.PNG
----------------------------------------------------------------------
diff --git a/_docs/img/execution-tree.PNG b/_docs/img/execution-tree.PNG
index 9fb8026..18e7cc4 100755
Binary files a/_docs/img/execution-tree.PNG and b/_docs/img/execution-tree.PNG differ
http://git-wip-us.apache.org/repos/asf/drill/blob/e45f60c3/_docs/sql-reference/data-types/010-supported-data-types.md
----------------------------------------------------------------------
diff --git a/_docs/sql-reference/data-types/010-supported-data-types.md b/_docs/sql-reference/data-types/010-supported-data-types.md
index c3f7ff8..17fcedb 100644
--- a/_docs/sql-reference/data-types/010-supported-data-types.md
+++ b/_docs/sql-reference/data-types/010-supported-data-types.md
@@ -44,11 +44,15 @@ To enable the DECIMAL type, set the `planner.enable_decimal_data_type` option to
Drill supports the following composite types:
* Array
- Array element references, for example `a[1]` is the primary type-specific operation.
* Map
- Drill supports constructs in the form `m['k']`
-For more information about array and map types, see the section, ["Handling Different Data Types"]({{site.baseurl}}/docs/handling-different-data-types/#handling-json-and-parquet-data), [KVGEN]({{site.baseurl}}/docs/kvgen/), and [FLATTEN]({{site.baseurl}}/docs/flatten/).
+In this release of Drill, you cannot reference a composite type by name in a query, but Drill supports array values coming from data sources. For example, you can use the index syntax to query data and get the value of an array element.
+
+`a[1]`
+
+Drill uses [map and array data types]({{ site.baseurl }}/docs/handling-different-data-types/#handling-json-and-parquet-data) internally for reading complex and nested data structures from data sources such as JSON. You can cast data in a map or array of data to return a value from the structure, as shown in [“Create a view on a MapR-DB table”] ({{ site.baseurl }}/docs/lesson-2-run-queries-with-ansi-sql/#create-a-view-on-a-mapr-db-table). [“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) shows how to access nested arrays.
+
+For more information about using array and map types, see the sections, [KVGEN]({{site.baseurl}}/docs/kvgen/), and [FLATTEN]({{site.baseurl}}/docs/flatten/).
## Casting and Converting Data Types
[3/6] drill git commit: fix ripple effect of DRILL-3134
Posted by ts...@apache.org.
fix ripple effect of DRILL-3134
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/3b79623a
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/3b79623a
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/3b79623a
Branch: refs/heads/gh-pages
Commit: 3b79623ae1a90f2a35e59ca9db7e6e45e1b9f491
Parents: 72c054b
Author: Kristine Hahn <kh...@maprtech.com>
Authored: Wed May 20 10:39:33 2015 -0700
Committer: Kristine Hahn <kh...@maprtech.com>
Committed: Wed May 20 10:39:33 2015 -0700
----------------------------------------------------------------------
_docs/data-sources-and-file-formats/050-json-data-model.md | 4 +++-
_docs/sql-reference/data-types/010-supported-data-types.md | 6 +++++-
.../data-types/030-handling-different-data-types.md | 4 +---
3 files changed, 9 insertions(+), 5 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/3b79623a/_docs/data-sources-and-file-formats/050-json-data-model.md
----------------------------------------------------------------------
diff --git a/_docs/data-sources-and-file-formats/050-json-data-model.md b/_docs/data-sources-and-file-formats/050-json-data-model.md
index 183ea17..70ccf94 100644
--- a/_docs/data-sources-and-file-formats/050-json-data-model.md
+++ b/_docs/data-sources-and-file-formats/050-json-data-model.md
@@ -56,7 +56,9 @@ When you set this option, Drill reads all numbers from the JSON files as DOUBLE.
* Cast JSON values to [SQL types]({{ site.baseurl }}/docs/json-data-model/#data-type-mapping), such as BIGINT, FLOAT, and INTEGER.
* Cast JSON strings to [Drill Date/Time Data Type Formats]({{ site.baseurl }}/docs/date-time-and-timestamp).
-Drill uses [map and array data types]({{ site.baseurl }}/docs/handling-different-data-types/#handling-json-and-parquet-data) internally for reading complex and nested data structures from data sources such as JSON. You can cast data in a map or array of data to return a value from the structure, as shown in [“Create a view on a MapR-DB table”] ({{ site.baseurl }}/docs/lesson-2-run-queries-with-ansi-sql/#create-a-view-on-a-mapr-db-table). [“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) shows how to access nested arrays.
+[“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) show how to use [composite types]({{site.baseurl}}/docs/supported-data-types/#composite-types) to access nested arrays.
+
+Drill uses these types internally for reading complex and nested data structures from data sources such as JSON.
## Reading JSON
To read JSON data using Drill, use a [file system storage plugin]({{ site.baseurl }}/docs/file-system-storage-plugin/) that defines the JSON format. You can use the `dfs` storage plugin, which includes the definition.
http://git-wip-us.apache.org/repos/asf/drill/blob/3b79623a/_docs/sql-reference/data-types/010-supported-data-types.md
----------------------------------------------------------------------
diff --git a/_docs/sql-reference/data-types/010-supported-data-types.md b/_docs/sql-reference/data-types/010-supported-data-types.md
index e0fa02e..8008f76 100644
--- a/_docs/sql-reference/data-types/010-supported-data-types.md
+++ b/_docs/sql-reference/data-types/010-supported-data-types.md
@@ -46,6 +46,10 @@ Drill supports the following composite types:
* Array
* Map
+A map is a set of name/value pairs. A value in a map can be a scalar type, such as string or int, or a complex type, such as an array or another map. An array is a repeated list of values. A value in an array can be a scalar type, such as string or int, or an array can be a complex type, such as a map or another array.
+
+Drill uses map and array data types internally for reading complex and nested data structures from data sources. For more information, see examples of [handling JSON maps and arrays]({{ site.baseurl }}/docs/handling-different-data-types/#handling-json-and-parquet-data).
+
In this release of Drill, you cannot reference a composite type by name in a query, but Drill supports array values coming from data sources. For example, you can use the index syntax to query data and get the value of an array element:
`a[1]`
@@ -54,7 +58,7 @@ You can refer to the value for a key in a map using this syntax:
`m['k']`
-Drill uses [map and array data types]({{ site.baseurl }}/docs/handling-different-data-types/#handling-json-and-parquet-data) internally for reading complex and nested data structures from data sources such as JSON. You can cast data in a map or array of data to return a value from the structure, as shown in [“Create a view on a MapR-DB table”] ({{ site.baseurl }}/docs/lesson-2-run-queries-with-ansi-sql/#create-a-view-on-a-mapr-db-table). [“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) shows how to access nested arrays.
+The section [“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) show how to use [composite types]({{site.baseurl}}/docs/supported-data-types/#composite-types) to access nested arrays.
For more information about using array and map types, see the sections, ["KVGEN"]({{site.baseurl}}/docs/kvgen/) and ["FLATTEN"]({{site.baseurl}}/docs/flatten/).
http://git-wip-us.apache.org/repos/asf/drill/blob/3b79623a/_docs/sql-reference/data-types/030-handling-different-data-types.md
----------------------------------------------------------------------
diff --git a/_docs/sql-reference/data-types/030-handling-different-data-types.md b/_docs/sql-reference/data-types/030-handling-different-data-types.md
index ca72082..c14e795 100644
--- a/_docs/sql-reference/data-types/030-handling-different-data-types.md
+++ b/_docs/sql-reference/data-types/030-handling-different-data-types.md
@@ -9,9 +9,7 @@ To query HBase data in Drill, convert every column of an HBase table to/from byt
In a textual file, such as CSV, Drill interprets every field as a VARCHAR, as previously mentioned. In addition to using the CAST function, you can also use TO_CHAR, TO_DATE, TO_NUMBER, and TO_TIMESTAMP. If the SELECT statement includes a WHERE clause that compares a column of an unknown data type, cast both the value of the column and the comparison value in the WHERE clause.
## Handling JSON and Parquet Data
-Complex and nested data structures in JSON and Parquet files are of map and array types.
-
-A map is a set of name/value pairs. A value in a map can be a scalar type, such as string or int, or a complex type, such as an array or another map. An array is a repeated list of values. A value in an array can be a scalar type, such as string or int, or an array can be a complex type, such as a map or another array.
+Complex and nested data structures in JSON and Parquet files are [composite types](({{site.baseurl}}/docs/supported-data-types/#composite-types)): map and array.
Drill reads/writes maps and arrays from/to JSON and Parquet files. In Drill, you do not cast a map or array to another type.
[4/6] drill git commit: typo reported by tweet
Posted by ts...@apache.org.
typo reported by tweet
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/135d645b
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/135d645b
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/135d645b
Branch: refs/heads/gh-pages
Commit: 135d645ba4eb00762e661fe4d2393644e7ffa340
Parents: 3b79623
Author: Kristine Hahn <kh...@maprtech.com>
Authored: Wed May 20 13:06:53 2015 -0700
Committer: Kristine Hahn <kh...@maprtech.com>
Committed: Wed May 20 13:06:53 2015 -0700
----------------------------------------------------------------------
index.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/135d645b/index.html
----------------------------------------------------------------------
diff --git a/index.html b/index.html
index 653d87a..b1de264 100755
--- a/index.html
+++ b/index.html
@@ -72,7 +72,7 @@ $(document).ready(function() {
</td>
<td class="fl">
<h1>Flexibility</h1>
- <p>Analyze the multi-structured and nested data in non-relational datatastores directly without transforming or restricting the data</p>
+ <p>Analyze the multi-structured and nested data in non-relational datastores directly without transforming or restricting the data</p>
</td>
<td class="fam">
<h1>Familiarity</h1>
[2/6] drill git commit: DRILL-3134 add map construct example
Posted by ts...@apache.org.
DRILL-3134 add map construct example
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/72c054b5
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/72c054b5
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/72c054b5
Branch: refs/heads/gh-pages
Commit: 72c054b562161ebfef0b6b48fea2b87fa2757727
Parents: e45f60c
Author: Kristine Hahn <kh...@maprtech.com>
Authored: Wed May 20 10:09:30 2015 -0700
Committer: Kristine Hahn <kh...@maprtech.com>
Committed: Wed May 20 10:09:30 2015 -0700
----------------------------------------------------------------------
_docs/sql-reference/data-types/010-supported-data-types.md | 8 ++++++--
1 file changed, 6 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/72c054b5/_docs/sql-reference/data-types/010-supported-data-types.md
----------------------------------------------------------------------
diff --git a/_docs/sql-reference/data-types/010-supported-data-types.md b/_docs/sql-reference/data-types/010-supported-data-types.md
index 17fcedb..e0fa02e 100644
--- a/_docs/sql-reference/data-types/010-supported-data-types.md
+++ b/_docs/sql-reference/data-types/010-supported-data-types.md
@@ -46,13 +46,17 @@ Drill supports the following composite types:
* Array
* Map
-In this release of Drill, you cannot reference a composite type by name in a query, but Drill supports array values coming from data sources. For example, you can use the index syntax to query data and get the value of an array element.
+In this release of Drill, you cannot reference a composite type by name in a query, but Drill supports array values coming from data sources. For example, you can use the index syntax to query data and get the value of an array element:
`a[1]`
+You can refer to the value for a key in a map using this syntax:
+
+`m['k']`
+
Drill uses [map and array data types]({{ site.baseurl }}/docs/handling-different-data-types/#handling-json-and-parquet-data) internally for reading complex and nested data structures from data sources such as JSON. You can cast data in a map or array of data to return a value from the structure, as shown in [“Create a view on a MapR-DB table”] ({{ site.baseurl }}/docs/lesson-2-run-queries-with-ansi-sql/#create-a-view-on-a-mapr-db-table). [“Query Complex Data”]({{ site.baseurl }}/docs/querying-complex-data-introduction) shows how to access nested arrays.
-For more information about using array and map types, see the sections, [KVGEN]({{site.baseurl}}/docs/kvgen/), and [FLATTEN]({{site.baseurl}}/docs/flatten/).
+For more information about using array and map types, see the sections, ["KVGEN"]({{site.baseurl}}/docs/kvgen/) and ["FLATTEN"]({{site.baseurl}}/docs/flatten/).
## Casting and Converting Data Types
[5/6] drill git commit: Typo
Posted by ts...@apache.org.
Typo
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/f72d4681
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/f72d4681
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/f72d4681
Branch: refs/heads/gh-pages
Commit: f72d468131361f6817ae072b63cab5e4e549cecb
Parents: 0120d25
Author: Tomer Shiran <ts...@gmail.com>
Authored: Wed May 20 14:59:37 2015 -0700
Committer: Tomer Shiran <ts...@gmail.com>
Committed: Wed May 20 14:59:37 2015 -0700
----------------------------------------------------------------------
index.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/f72d4681/index.html
----------------------------------------------------------------------
diff --git a/index.html b/index.html
index 653d87a..b1de264 100755
--- a/index.html
+++ b/index.html
@@ -72,7 +72,7 @@ $(document).ready(function() {
</td>
<td class="fl">
<h1>Flexibility</h1>
- <p>Analyze the multi-structured and nested data in non-relational datatastores directly without transforming or restricting the data</p>
+ <p>Analyze the multi-structured and nested data in non-relational datastores directly without transforming or restricting the data</p>
</td>
<td class="fam">
<h1>Familiarity</h1>
[6/6] drill git commit: Merge branch 'gh-pages' of
https://github.com/tshiran/drill into gh-pages
Posted by ts...@apache.org.
Merge branch 'gh-pages' of https://github.com/tshiran/drill into gh-pages
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/c77a3122
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/c77a3122
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/c77a3122
Branch: refs/heads/gh-pages
Commit: c77a3122d16e656e4e308f39ea5213831dbd245b
Parents: f72d468 135d645
Author: Tomer Shiran <ts...@gmail.com>
Authored: Wed May 20 15:00:15 2015 -0700
Committer: Tomer Shiran <ts...@gmail.com>
Committed: Wed May 20 15:00:15 2015 -0700
----------------------------------------------------------------------
.../050-json-data-model.md | 4 +++-
_docs/img/execution-tree.PNG | Bin 13849 -> 16724 bytes
.../data-types/010-supported-data-types.md | 18 +++++++++++++++---
.../030-handling-different-data-types.md | 4 +---
4 files changed, 19 insertions(+), 7 deletions(-)
----------------------------------------------------------------------