You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by kr...@apache.org on 2016/01/07 19:57:30 UTC
drill git commit: MD-643 review
Repository: drill
Updated Branches:
refs/heads/gh-pages 3f0a7d609 -> f853694df
MD-643 review
address doc issue in DRILL-4130
refine 1.4 release desc
DRILL-3739 note per Rahul
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/f853694d
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/f853694d
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/f853694d
Branch: refs/heads/gh-pages
Commit: f853694dff92680a083a114b8f664ed6a606d51c
Parents: 3f0a7d6
Author: Kris Hahn <kr...@apache.org>
Authored: Thu Jan 7 10:41:51 2016 -0800
Committer: Kris Hahn <kr...@apache.org>
Committed: Thu Jan 7 10:57:10 2016 -0800
----------------------------------------------------------------------
.../plugins/070-hive-storage-plugin.md | 4 ++--
.../050-json-data-model.md | 8 ++++----
_docs/getting-started/010-drill-introduction.md | 19 +++++++++++++++----
_docs/rn/007-1.4.0-rn.md | 4 +++-
4 files changed, 24 insertions(+), 11 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
----------------------------------------------------------------------
diff --git a/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md b/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
index 4c6b699..76cf4dc 100644
--- a/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
+++ b/_docs/connect-a-data-source/plugins/070-hive-storage-plugin.md
@@ -35,7 +35,7 @@ metastore service communicates with the Hive database over JDBC.
Follow the steps in the next section to point Drill
to the Hive metastore service address. Provide the connection parameters
-in a Hive storage plugin configuration to configure a connection to Drill. At this point, if you query data sources that Drill supports other than HBase (or MapR), you are finished configuring the Hive storage plugin. If you query HBase using Hive, you need to add ZooKeeper quorum and port properties. The HBaseStorageHandler requires these properties. Drill discovers HBase services using these properties. If you use the HBase storage plugin, the ZooKeeper quorum and port properties in the Hive storage plugin are the same as those in the HBase storage plugin, assuming you want to use the same HBase database.
+in a Hive storage plugin configuration to configure a connection to Drill. At this point, if you your Hive queries do not use the HBaseStorageHandler, you are finished configuring the Hive storage plugin; otherwise, you need to add ZooKeeper quorum and port properties. The HBaseStorageHandler requires these properties. Drill discovers HBase services using these properties. If you use the HBase storage plugin, use the same ZooKeeper quorum and port properties in the Hive storage plugin and the HBase storage plugin, assuming you want the Hive query access the same HBase source.
{% include startnote.html %}Verify that the Hive metastore service is running before you register the Hive metastore.{% include endnote.html %}
@@ -66,7 +66,7 @@ To connect Drill to a remote Hive metastore:
}
}
-6. If you do not query HBase, skip this step. If you query HBase, in the configuration window, add the names of the ZooKeeper quorum hosts and the ZooKeeper port, for example 2181.
+6. If you do not use the HBaseStorageHandler in your queries, skip this step; otherwise, add the names of the ZooKeeper quorum hosts and the ZooKeeper port, for example 2181.
{
"type": "hive",
http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/data-sources-and-file-formats/050-json-data-model.md
----------------------------------------------------------------------
diff --git a/_docs/data-sources-and-file-formats/050-json-data-model.md b/_docs/data-sources-and-file-formats/050-json-data-model.md
index 0452288..00b54e9 100644
--- a/_docs/data-sources-and-file-formats/050-json-data-model.md
+++ b/_docs/data-sources-and-file-formats/050-json-data-model.md
@@ -1,6 +1,6 @@
---
title: "JSON Data Model"
-date:
+date: 2016-01-07
parent: "Data Sources and File Formats"
---
Drill supports [JSON (JavaScript Object Notation)](http://www.json.org/), a self-describing data format. The data itself implies its schema and has the following characteristics:
@@ -50,7 +50,7 @@ The default setting of `store.json.all_text_mode` and `store.json.read_numbers_a
### Handling Type Differences
Set the `store.json.read_numbers_as_double` property to true.
- ALTER SYSTEM SET `store.json.read_numbers_as_double` = true;
+ ALTER SESSION SET `store.json.read_numbers_as_double` = true;
When you set this option, Drill reads all numbers from the JSON files as DOUBLE. After reading the data, use a SELECT statement in Drill to cast data as follows:
@@ -230,7 +230,7 @@ FLATTEN breaks the list of key-value pairs into separate rows on which you can a
### Example: Aggregate Loosely Structured Data
Use flatten and kvgen together to aggregate the data from the [previous example]({{site.baseurl}}/docs/json-data-model/#example:-flatten-and-generate-key-values-for-complex-json). Make sure all text mode is set to false to sum numbers. Drill returns an error if you attempt to sum data in all text mode.
- ALTER SYSTEM SET `store.json.all_text_mode` = false;
+ ALTER SESSION SET `store.json.all_text_mode` = false;
Sum the ticket sales by combining the `SUM`, `FLATTEN`, and `KVGEN` functions in a single query.
@@ -529,7 +529,7 @@ Drill interprets numbers that do not have a decimal point as BigInt values. In t
Workaround: Set the `store.json.read_numbers_as_double` property, described earlier, to true.
- ALTER SYSTEM SET `store.json.read_numbers_as_double` = true;
+ ALTER SESSION SET `store.json.read_numbers_as_double` = true;
### Selecting all in a JSON directory query
Drill currently returns only fields common to all the files in a [directory query]({{ site.baseurl }}/docs/querying-directories) that selects all (SELECT *) JSON files.
http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/getting-started/010-drill-introduction.md
----------------------------------------------------------------------
diff --git a/_docs/getting-started/010-drill-introduction.md b/_docs/getting-started/010-drill-introduction.md
index 32217ce..cafcfe5 100644
--- a/_docs/getting-started/010-drill-introduction.md
+++ b/_docs/getting-started/010-drill-introduction.md
@@ -1,6 +1,6 @@
---
title: "Drill Introduction"
-date:
+date: 2016-01-07
parent: "Getting Started"
---
Drill is an Apache open-source SQL query engine for Big Data exploration.
@@ -8,10 +8,21 @@ Drill is designed from the ground up to support high-performance analysis on
the semi-structured and rapidly evolving data coming from modern Big Data
applications, while still providing the familiarity and ecosystem of ANSI SQL,
the industry-standard query language. Drill provides plug-and-play integration
-with existing Apache Hive and Apache HBase deployments.
+with existing Apache Hive and Apache HBase deployments.
-## What's New in Apache Drill 1.3 and 1.4
-These releases fix issues and add a number of enhancements, including the following ones:
+## What's New in Apache Drill 1.4
+
+Drill 1.4 introduces the following improvements:
+
+* [select with options]({{site.baseurl}}/docs/plugin-configuration-basics/#using-the-formats-attributes-as-table-function-parameters) that you use in queries to change storage plugin settings
+* Improved behavior when parsing CSV file header names
+* A variable to set non-pretty, such as compact, printing of JSON
+* Better drillbit.log files that include query text
+
+Drill 1.4 fixes an error that occurred when using the HBaseStorageHandler in a Hive query ([DRILL-3739](https://issues.apache.org/jira/browse/DRILL-3739)). To successfully use the HBaseStorageHandler in a Hive query, you need to configure the Hive storage plugin as described in the [Hive storage plugin documentation]({{site.baseurl}}/docs/hive-storage-plugin/#connect-drill-to-the-hive-remote-metastore).
+
+## What's New in Apache Drill 1.3
+This releases fix issues and add a number of enhancements, including the following ones:
* [Enhanced Amazon S3 support]({{site.baseurl}}/docs/s3-storage-plugin/)
* Hetrogeneous types
http://git-wip-us.apache.org/repos/asf/drill/blob/f853694d/_docs/rn/007-1.4.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/007-1.4.0-rn.md b/_docs/rn/007-1.4.0-rn.md
index 717e80b..74a792c 100644
--- a/_docs/rn/007-1.4.0-rn.md
+++ b/_docs/rn/007-1.4.0-rn.md
@@ -6,6 +6,8 @@ parent: "Release Notes"
**Release date:** December 14, 2015
Today, we're happy to announce the availability of Drill 1.4.0, providing the following bug fixes and improvements.
+
+Drill 1.4 fixes an error that occurred when using the HBaseStorageHandler in a Hive query ([DRILL-3739](https://issues.apache.org/jira/browse/DRILL-3739)). To successfully use the HBaseStorageHandler in a Hive query, you need to configure the Hive storage plugin as described in the [Hive storage plugin documentation]({{site.baseurl}}/docs/hive-storage-plugin/#connect-drill-to-the-hive-remote-metastore).
<h2> Sub-task
</h2>
@@ -100,4 +102,4 @@ Today, we're happy to announce the availability of Drill 1.4.0, providing the fo
<ul>
<li>[<a href='https://issues.apache.org/jira/browse/DRILL-3791'>DRILL-3791</a>] - Test JDBC plugin with MySQL
</li>
-</ul>
\ No newline at end of file
+</ul>