You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by br...@apache.org on 2018/01/30 05:10:44 UTC
drill git commit: update docs for NaN infinity type support and
bounds checking behavior change
Repository: drill
Updated Branches:
refs/heads/gh-pages 83baaab6f -> f883ad51f
update docs for NaN infinity type support and bounds checking behavior change
Project: http://git-wip-us.apache.org/repos/asf/drill/repo
Commit: http://git-wip-us.apache.org/repos/asf/drill/commit/f883ad51
Tree: http://git-wip-us.apache.org/repos/asf/drill/tree/f883ad51
Diff: http://git-wip-us.apache.org/repos/asf/drill/diff/f883ad51
Branch: refs/heads/gh-pages
Commit: f883ad51f8401285c709bbeb7066f95e96299b64
Parents: 83baaab
Author: Bridget Bevens <bb...@maprtech.com>
Authored: Mon Jan 29 21:08:10 2018 -0800
Committer: Bridget Bevens <bb...@maprtech.com>
Committed: Mon Jan 29 21:08:10 2018 -0800
----------------------------------------------------------------------
.../020-configuring-drill-memory.md | 20 +++++++++++++++++---
.../050-json-data-model.md | 14 +++++++++++---
2 files changed, 28 insertions(+), 6 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/drill/blob/f883ad51/_docs/configure-drill/020-configuring-drill-memory.md
----------------------------------------------------------------------
diff --git a/_docs/configure-drill/020-configuring-drill-memory.md b/_docs/configure-drill/020-configuring-drill-memory.md
index 4b5c48c..7b36cac 100644
--- a/_docs/configure-drill/020-configuring-drill-memory.md
+++ b/_docs/configure-drill/020-configuring-drill-memory.md
@@ -1,6 +1,6 @@
---
title: "Configuring Drill Memory"
-date: 2017-08-18 17:47:31 UTC
+date: 2018-01-30 05:08:15 UTC
parent: "Configure Drill"
---
@@ -30,7 +30,7 @@ You can modify memory for each drillbit node in your cluster. To modify the memo
After you edit `<drill_installation_directory>/conf/drill-env.sh`, [restart the drillbit]({{ site.baseurl }}/docs/starting-drill-in-distributed-mode) on the node.
-## About the Drillbit Startup Script
+### About the Drillbit Startup Script
The `drill-env.sh` file contains the following options:
@@ -47,4 +47,18 @@ DRILL_MAX_DIRECT_MEMORY is the Java direct memory limit per node.
If performance is an issue, add -Dbounds=false, as shown in the following example:
- export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Dbounds=false"
+ export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Dbounds=false"
+
+As of Drill 1.13, bounds checking for direct memory is disabled by default. To enable bounds checking for direct memory, use the DRILLBIT_JAVA_OPTS variable to pass the `drill.exec.memory.enable_unsafe_bounds_check` parameter in $DRILL_HOME/conf/drill-env.sh, as shown:
+
+ export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Ddrill.exec.memory.enable_unsafe_bounds_check=true
+
+
+For earlier versions of Drill (prior to 1.13), bounds checking is enabled by default. To disable bounds checking, set the `drill.enable_unsafe_memory_access property` to true, as shown:
+
+
+ export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Ddrill.enable_unsafe_memory_access =true
+
+
+
+
http://git-wip-us.apache.org/repos/asf/drill/blob/f883ad51/_docs/data-sources-and-file-formats/050-json-data-model.md
----------------------------------------------------------------------
diff --git a/_docs/data-sources-and-file-formats/050-json-data-model.md b/_docs/data-sources-and-file-formats/050-json-data-model.md
index 00b54e9..eef256e 100644
--- a/_docs/data-sources-and-file-formats/050-json-data-model.md
+++ b/_docs/data-sources-and-file-formats/050-json-data-model.md
@@ -1,6 +1,6 @@
---
title: "JSON Data Model"
-date: 2016-01-07
+date: 2018-01-30 05:08:16 UTC
parent: "Data Sources and File Formats"
---
Drill supports [JSON (JavaScript Object Notation)](http://www.json.org/), a self-describing data format. The data itself implies its schema and has the following characteristics:
@@ -22,12 +22,20 @@ JSON data consists of the following types:
* Array: ordered values, separated by commas, enclosed in square brackets
* Boolean: true or false
-* Number: double-precision floating point number, including exponential numbers. No octal, hexadecimal, NaN, or Infinity
* null: empty value
* Object: unordered key/value collection enclosed in curly braces
* String: Unicode enclosed in double quotation marks
* Value: a string, number, true, false, null
-* Whitespace: used between tokens
+* Whitespace: used between tokens
+* Number: double-precision floating point number, including exponential numbers, NaN, and Infinity. Octal and hexadecimal are not supported.
+
+Drill 1.13 and later supports NaN (Not-a-Number) and Infinity as numeric values. This support introduces the following options, which are set to “true” by default:
+
+ store.json.writer.allow_nan_inf
+ store.json.reader.allow_nan_inf
+
+Drill writes NaN and Infinity values as literals to a JSON file when `store.json.writer.allow_nan_inf` is set to true. When set to false, Drill writes NaN and Infinity values as string values to a JSON file. If a query selects NaN or Infinity values in a JSON file, and `store.json.reader.allow_nan_inf` is set to false, Drill returns an error message.
+
The following table shows SQL-JSON data type mapping: