You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by br...@apache.org on 2016/11/29 22:42:43 UTC
[05/19] drill git commit: 1.9 doc edits
1.9 doc edits
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/67878f23
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/67878f23
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/67878f23
Branch: refs/heads/gh-pages
Commit: 67878f23cb2d43492d7cef454527f0fe27df54fb
Parents: e8714c4
Author: Bridget Bevens <bb...@maprtech.com>
Authored: Mon Nov 21 12:45:53 2016 -0800
Committer: Bridget Bevens <bb...@maprtech.com>
Committed: Mon Nov 21 12:45:53 2016 -0800
----------------------------------------------------------------------
_docs/getting-started/010-drill-introduction.md | 2 +-
.../024-aynchronous-parquet-reader.md | 6 ++---
.../026-parquet-filter-pushdown.md | 6 ++---
_docs/rn/002-1.9.0-rn.md | 8 +++---
blog/_posts/2016-11-17-drill-1.9-released.md | 26 --------------------
blog/_posts/2016-11-22-drill-1.9-released.md | 26 ++++++++++++++++++++
6 files changed, 37 insertions(+), 37 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/67878f23/_docs/getting-started/010-drill-introduction.md
----------------------------------------------------------------------
diff --git a/_docs/getting-started/010-drill-introduction.md b/_docs/getting-started/010-drill-introduction.md
index c29ef0c..3da32a0 100644
--- a/_docs/getting-started/010-drill-introduction.md
+++ b/_docs/getting-started/010-drill-introduction.md
@@ -1,6 +1,6 @@
---
title: "Drill Introduction"
-date: 2016-11-18 21:59:17 UTC
+date: 2016-11-21 20:45:56 UTC
parent: "Getting Started"
---
Drill is an Apache open-source SQL query engine for Big Data exploration.
http://git-wip-us.apache.org/repos/asf/drill/blob/67878f23/_docs/performance-tuning/024-aynchronous-parquet-reader.md
----------------------------------------------------------------------
diff --git a/_docs/performance-tuning/024-aynchronous-parquet-reader.md b/_docs/performance-tuning/024-aynchronous-parquet-reader.md
index 4905921..be84fe1 100644
--- a/_docs/performance-tuning/024-aynchronous-parquet-reader.md
+++ b/_docs/performance-tuning/024-aynchronous-parquet-reader.md
@@ -1,6 +1,6 @@
---
title: "Asynchronous Parquet Reader"
-date: 2016-02-08 21:57:13 UTC
+date: 2016-11-21 20:45:57 UTC
parent: "Performance Tuning"
---
@@ -11,7 +11,7 @@ When the asynchronous parquet reader option is enabled, the speed at which the P
Typically, the Drill default settings provide the best performance for a wide variety of use cases. However, specific cases that require a high level of performance can benefit from tuning the Parquet Scan operator.
##Tuning the Parquet Scan Operator
-The `store.parquet.reader.pagereader.async` option turns the asynchronous Parquet reader on or off. The option is turned off by default. You can use the [ALTER SESSION command]({{site.baseurl}}/docs/alter-session-command/) to enable the asynchronous Parquet reader option, as well as the options that control buffering and parallel decoding.
+The `store.parquet.reader.pagereader.async` option turns the asynchronous Parquet reader on or off. The option is turned on by default. You can use the [ALTER SESSION SET command]({{site.baseurl}}/docs/alter-session-command/) to enable the asynchronous Parquet reader option, as well as the options that control buffering and parallel decoding.
When the asynchronous Page reader option is enabled, the Parquet Scan operator no longer reports operator wait time. Instead, it reports additional operator metrics that you can view in the query profile in the Drill Web Console.
@@ -23,7 +23,7 @@ The following sections provide the configuration options and details:
###Asynchronous Parquet Reader Options
-The following table lists and describes the asynchronous Parquet reader options that you can enable or disable using the ALTER SESSION SET command:
+The following table lists and describes the asynchronous Parquet reader options that you can enable or disable using the [ALTER SESSION SET command]({{site.baseurl}}/docs/alter-session-command/):
| Option | Description | Type | Default |
|----------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------|-------------|
http://git-wip-us.apache.org/repos/asf/drill/blob/67878f23/_docs/performance-tuning/026-parquet-filter-pushdown.md
----------------------------------------------------------------------
diff --git a/_docs/performance-tuning/026-parquet-filter-pushdown.md b/_docs/performance-tuning/026-parquet-filter-pushdown.md
index 3155ba6..7c1ade3 100644
--- a/_docs/performance-tuning/026-parquet-filter-pushdown.md
+++ b/_docs/performance-tuning/026-parquet-filter-pushdown.md
@@ -1,12 +1,12 @@
---
title: "Parquet Filter Pushdown"
-date: 2016-02-02 23:56:57 UTC
+date: 2016-11-21 20:45:57 UTC
parent: "Performance Tuning"
---
Drill 1.9 introduces the Parquet filter pushdown option. Parquet filter pushdown is a performance optimization that prunes extraneous data from a Parquet file to reduce the amount of data that Drill scans and reads when a query on a Parquet file contains a filter expression. Pruning data reduces the I/O, CPU, and network overhead to optimize Drill\u2019s performance.
-Parquet filter pushdown is enabled by default. When a query contains a filter expression, you can run the EXPLAIN PLAN command to see if Drill applies Parquet filter pushdown to the query. You can enable and disable this feature using the [ALTER SYSTEM|SESSION SET]({{site.baseurl}}/docs/alter-system/) command with the `planner.store.parquet.rowgroup.filter.pushdown` option.
+Parquet filter pushdown is enabled by default. When a query contains a filter expression, you can run the [EXPLAIN PLAN command]({{site.baseurl}}/docs/explain-commands/) to see if Drill applies Parquet filter pushdown to the query. You can enable and disable this feature using the [ALTER SYSTEM|SESSION SET]({{site.baseurl}}/docs/alter-system/) command with the `planner.store.parquet.rowgroup.filter.pushdown` option.
##How Parquet Filter Pushdown Works
Drill applies Parquet filter pushdown during the query planning phase. The query planner in Drill performs Parquet filter pushdown by evaluating the filter expressions in the query. If no filter expression exists, the underlying scan operator reads all of the data in a Parquet file and then sends the data to operators downstream. When filter expressions exist, the planner applies each filter and prunes the data, reducing the amount of data that the scanner and Parquet reader must read.
@@ -42,7 +42,7 @@ The following table lists the supported and unsupported clauses, operators, data
|----------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------|
| Clauses | WHERE, HAVING (HAVING is supported if Drill can pass the filter through GROUP BY.) | |
| Operators | AND, OR, IN (An IN list is converted to OR if the number in the IN list is within a certain threshold, for example 20. If greater than the threshold, pruning cannot occur.) | NOT, ITEM (Drill does not push the filter past the ITEM operator, which is used for complex fields.) |
-| Comparison Operators | <>, <, >, <=, >=, = (Filters are of the form "column = value".) | IS [NOT] NULL |
+| Comparison Operators | <>, <, >, <=, >=, = | IS [NOT] NULL |
| Data Types | INT, BIGINT, FLOAT, DOUBLE, DATE, TIMESTAMP, TIME | CHAR, VARCHAR columns, Hive TIMESTAMP |
| Function | CAST is supported among these four numeric types only: int, bigint, float, double | |
| Other | -- | Joins, Files with multiple row groups, Enabled Native Hive reader |
http://git-wip-us.apache.org/repos/asf/drill/blob/67878f23/_docs/rn/002-1.9.0-rn.md
----------------------------------------------------------------------
diff --git a/_docs/rn/002-1.9.0-rn.md b/_docs/rn/002-1.9.0-rn.md
index 2519c97..b04ff9f 100644
--- a/_docs/rn/002-1.9.0-rn.md
+++ b/_docs/rn/002-1.9.0-rn.md
@@ -3,16 +3,16 @@ title: "Apache Drill 1.9.0 Release Notes"
parent: "Release Notes"
---
-**Release date:** November 17, 2016
+**Release date:** November 22, 2016
Today, we're happy to announce the availability of Drill 1.9.0. You can download it [here](https://drill.apache.org/download/).
## New Features
This release of Drill provides the following new features:
-- Asynchronous Parquet reader
-- Parquet filter pushdown
-- Dynamic UDF support
+- Asynchronous Parquet reader
+- Parquet filter pushdown
+- Dynamic UDF support
- HTTPD format plugin
The following sections list additional bug fixes and improvements:
http://git-wip-us.apache.org/repos/asf/drill/blob/67878f23/blog/_posts/2016-11-17-drill-1.9-released.md
----------------------------------------------------------------------
diff --git a/blog/_posts/2016-11-17-drill-1.9-released.md b/blog/_posts/2016-11-17-drill-1.9-released.md
deleted file mode 100644
index f97b51c..0000000
--- a/blog/_posts/2016-11-17-drill-1.9-released.md
+++ /dev/null
@@ -1,26 +0,0 @@
----
-layout: post
-title: "Drill 1.9 Released"
-code: drill-1.9-released
-excerpt: Apache Drill 1.9's highlights are: asynchronous Parquet reader, Parquet filter pushdown, and dynamic UDF support.
-authors: ["bbevens"]
----
-
-Today, we're happy to announce the availability of Drill 1.9.0. You can download it [here](https://drill.apache.org/download/).
-
-The release provides the following bug fixes and improvements:
-
-## Asynchronous Parquet Reader
-The new asynchronous Parquet reader feature improves the performance of the Parquet Scan operator by increasing the speed at which the Parquet reader scans, decompresses, and decodes data. See Asynchronous Parquet Reader.
-
-## Parquet Filter Pushdown
-The new Parquet filter pushdown feature optimizes Drill\u2019s performance by pruning extraneous data from a Parquet file to reduce the amount of data that Drill scans and reads when a query on a Parquet file contains a filter expression. See Parquet Filter Pushdown.
-
-## Dynamic UDF Support
-The new Dynamic UDF feature enables users to register and unregister UDFs on their own using the new CREATE FUNCTION USING JAR and DROP FUNCTION USING JAR commands. See Dynamic UDFs.
-
-## HTTPD Format Plugin
-The new HTTPD format plugin adds the capability to query HTTP web server logs natively and also includes parse_url() and parse_query() UDFs. The parse_url() UDF returns maps of the URL. The parse_query() UDF returns the query string.
-
-A complete list of JIRAs resolved in the 1.9.0 release can be found [here](https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12337861&styleName=Html&projectId=12313820&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Ce3f48e86b488db564d324462cd5233d775c28018%7Clin).
-
http://git-wip-us.apache.org/repos/asf/drill/blob/67878f23/blog/_posts/2016-11-22-drill-1.9-released.md
----------------------------------------------------------------------
diff --git a/blog/_posts/2016-11-22-drill-1.9-released.md b/blog/_posts/2016-11-22-drill-1.9-released.md
new file mode 100644
index 0000000..1c1e251
--- /dev/null
+++ b/blog/_posts/2016-11-22-drill-1.9-released.md
@@ -0,0 +1,26 @@
+---
+layout: post
+title: "Drill 1.9 Released"
+code: drill-1.9-released
+excerpt: Apache Drill 1.9's highlights are: asynchronous Parquet reader, Parquet filter pushdown, and dynamic UDF support.
+authors: ["bbevens"]
+---
+
+Today, we're happy to announce the availability of Drill 1.9.0. You can download it [here](https://drill.apache.org/download/).
+
+The release provides the following bug fixes and improvements:
+
+## Asynchronous Parquet Reader
+The new asynchronous Parquet reader feature improves the performance of the Parquet Scan operator by increasing the speed at which the Parquet reader scans, decompresses, and decodes data. See [Asynchronous Parquet Reader]({{site.baseurl}}/docs/asynchronous-parquet-reader/).
+
+## Parquet Filter Pushdown
+The new Parquet filter pushdown feature optimizes Drill\u2019s performance by pruning extraneous data from a Parquet file to reduce the amount of data that Drill scans and reads when a query on a Parquet file contains a filter expression. See [Parquet Filter Pushdown]({{site.baseurl}}/docs/parquet-filter-pushdown/).
+
+## Dynamic UDF Support
+The new Dynamic UDF feature enables users to register and unregister UDFs on their own using the new CREATE FUNCTION USING JAR and DROP FUNCTION USING JAR commands. See [Dynamic UDFs]({{site.baseurl}}/docs/dynamic-udfs/).
+
+## HTTPD Format Plugin
+The new HTTPD format plugin adds the capability to query HTTP web server logs natively and also includes parse_url() and parse_query() UDFs. The parse_url() UDF returns maps of the URL. The parse_query() UDF returns the query string.
+
+A complete list of JIRAs resolved in the 1.9.0 release can be found [here](https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12337861&styleName=Html&projectId=12313820&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Ce3f48e86b488db564d324462cd5233d775c28018%7Clin).
+