You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by br...@apache.org on 2015/04/13 22:20:51 UTC
svn commit: r1673272 - in /drill/site/trunk/content/drill:
docs/data-type-conversion/index.html docs/mapr-db-format/index.html
docs/math-and-trig/index.html docs/overview/index.html
docs/sql-functions/index.html feed.xml
Author: bridgetb
Date: Mon Apr 13 20:20:50 2015
New Revision: 1673272
URL: http://svn.apache.org/r1673272
Log:
DRILL-2720: SQL functions doc review comments, config options doc
Modified:
drill/site/trunk/content/drill/docs/data-type-conversion/index.html
drill/site/trunk/content/drill/docs/mapr-db-format/index.html
drill/site/trunk/content/drill/docs/math-and-trig/index.html
drill/site/trunk/content/drill/docs/overview/index.html
drill/site/trunk/content/drill/docs/sql-functions/index.html
drill/site/trunk/content/drill/feed.xml
Modified: drill/site/trunk/content/drill/docs/data-type-conversion/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/data-type-conversion/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/data-type-conversion/index.html (original)
+++ drill/site/trunk/content/drill/docs/data-type-conversion/index.html Mon Apr 13 20:20:50 2015
@@ -77,14 +77,14 @@
<h2 id="cast">CAST</h2>
-<p>The CAST function converts an entity having a single data value, such as a column name, from one type to another.</p>
+<p>The CAST function converts an expression from one type to another.</p>
<h3 id="syntax">Syntax</h3>
<div class="highlight"><pre><code class="language-text" data-lang="text">cast (<expression> AS <data type>)
</code></pre></div>
<p><em>expression</em></p>
-<p>An entity that evaluates to one or more values, such as a column name or literal</p>
+<p>A combination of one or more values, operators, and SQL functions that evaluate to a value</p>
<p><em>data type</em></p>
@@ -529,12 +529,8 @@ FROM tmp.`json2parquet2`;
+------------+
1 row selected (1.199 seconds)
</code></pre></div></li>
-<li><p>Configure the default time zone format in the drill-override.conf. For example:</p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">drill.exec: {
- cluster-id: âxyz",
- zk.connect: âabc:5181",
- user.timezone: "UTC"
-}
+<li><p>Configure the default time zone format in <drill installation directory>/conf/drill-env.sh by adding <code>-Duser.timezone=UTC</code> to DRILL_JAVA_OPTS. For example:</p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">export DRILL_JAVA_OPTS="-Xms1G -Xmx$DRILL_MAX_HEAP -XX:MaxDirectMemorySize=$DRILL_MAX_DIRECT_MEMORY -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=1G -ea -Duser.timezone=UTC"
</code></pre></div></li>
<li><p>Restart sqlline.</p></li>
<li><p>Confirm that Drill is now set to UTC:</p>
@@ -592,7 +588,7 @@ use in your Drill queries as described i
</tr>
</tbody></table>
-<p>Use the âzâ option to identify the time zone in TO_TIMESTAMP to make sure the timestamp has the timezone in it. Also, use the âzâ option to identify the time zone in a timestamp using the TO_CHAR function. For example:</p>
+<p>You can use the âzâ option to identify the time zone in TO_TIMESTAMP to make sure the timestamp has the timezone in it. Also, use the âzâ option to identify the time zone in a timestamp using the TO_CHAR function. For example:</p>
<div class="highlight"><pre><code class="language-text" data-lang="text">SELECT TO_TIMESTAMP('2015-03-30 20:49:59.0 UTC', 'YYYY-MM-dd HH:mm:ss.s z') AS Original,
TO_CHAR(TO_TIMESTAMP('2015-03-30 20:49:59.0 UTC', 'YYYY-MM-dd HH:mm:ss.s z'), 'z') AS TimeZone
FROM sys.version;
Modified: drill/site/trunk/content/drill/docs/mapr-db-format/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/mapr-db-format/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/mapr-db-format/index.html (original)
+++ drill/site/trunk/content/drill/docs/mapr-db-format/index.html Mon Apr 13 20:20:50 2015
@@ -67,7 +67,7 @@
</div>
-<div class="int_text" align="left"><p>Drill includes a <code>maprdb</code> format plugin for handling MapR-DB and HBase data. The Drill Sandbox also includes the following <code>maprdb</code> format plugin on a MapR node:</p>
+<div class="int_text" align="left"><p>Drill includes a <code>maprdb</code> format plugin for accessing data stored in MapR-DB. The Drill Sandbox also includes the following <code>maprdb</code> format plugin on a MapR node:</p>
<div class="highlight"><pre><code class="language-text" data-lang="text">{
"type": "hbase",
"config": {
Modified: drill/site/trunk/content/drill/docs/math-and-trig/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/math-and-trig/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/math-and-trig/index.html (original)
+++ drill/site/trunk/content/drill/docs/math-and-trig/index.html Mon Apr 13 20:20:50 2015
@@ -227,7 +227,7 @@
<p>Examples in this section use the <code>input2.json</code> file. Download the <code>input2.json</code> file from the <a href="https://github.com/apache/drill/tree/master/exec/java-exec/src/test/resources/jsoninput">Drill source code</a> page. </p>
-<p>You need to use a FROM clause in Drill queries. This document often uses the sys.version table in the FROM clause of the query for example purposes.</p>
+<p>You need to use a FROM clause in Drill queries. In addition to using <code>input2.json</code>, examples in this documentation often use <code>FROM sys.version</code> in the query for example purposes.</p>
<h4 id="abs-example">ABS Example</h4>
Modified: drill/site/trunk/content/drill/docs/overview/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/overview/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/overview/index.html (original)
+++ drill/site/trunk/content/drill/docs/overview/index.html Mon Apr 13 20:20:50 2015
@@ -67,7 +67,7 @@
</div>
-<div class="int_text" align="left"><p>The sys.options table in Drill contains information about boot and system options described in the following tables. You configure some of the options to tune performance. You can configure the options using the ALTER SESSION or ALTER SYSTEM command.</p>
+<div class="int_text" align="left"><p>The sys.options table in Drill contains information about boot and system options listed in the following tables. To tune performance, you adjust some of the options to suit your application. Configure the options using the ALTER SESSION or ALTER SYSTEM command.</p>
<h2 id="boot-options">Boot Options</h2>
@@ -75,7 +75,7 @@
<tr>
<th>Name</th>
<th>Default</th>
- <th>Description</th>
+ <th>Comments</th>
</tr>
<tr>
<td>drill.exec.buffer.impl</td>
@@ -193,9 +193,9 @@
<table>
<tr>
- <th>name</th>
+ <th>Name</th>
<th>Default</th>
- <th>Description</th>
+ <th>Comments</th>
</tr>
<tr>
<td>drill.exec.functions.cast_empty_string_to_null</td>
@@ -205,12 +205,7 @@
<tr>
<td>drill.exec.storage.file.partition.column.label</td>
<td>dir</td>
- <td></td>
- </tr>
- <tr>
- <td>drill.exec.testing.exception-injections</td>
- <td></td>
- <td></td>
+ <td>Accepts a string input.</td>
</tr>
<tr>
<td>exec.errors.verbose</td>
@@ -220,27 +215,27 @@
<tr>
<td>exec.java_compiler</td>
<td>DEFAULT</td>
- <td></td>
+ <td>Switches between DEFAULT, JDK, and JANINO mode for the current session. Uses Janino by default for generated source code of less than exec.java_compiler_janino_maxsize; otherwise, switches to the JDK compiler.</td>
</tr>
<tr>
<td>exec.java_compiler_debug</td>
<td>TRUE</td>
- <td></td>
+ <td>Toggles the output of debug-level compiler error messages in runtime generated code.</td>
</tr>
<tr>
<td>exec.java_compiler_janino_maxsize</td>
<td>262144</td>
- <td></td>
+ <td>See the exec.java_compiler option comment. Accepts inputs of type LONG.</td>
</tr>
<tr>
<td>exec.max_hash_table_size</td>
<td>1073741824</td>
- <td>Starting size for hash tables. Increase according to available memory to improve performance.</td>
+ <td>Ending size for hash tables. Range: 0 - 1073741824</td>
</tr>
<tr>
<td>exec.min_hash_table_size</td>
<td>65536</td>
- <td></td>
+ <td>Starting size for hash tables. Increase according to available memory to improve performance. Range: 0 - 1073741824</td>
</tr>
<tr>
<td>exec.queue.enable</td>
@@ -250,27 +245,22 @@
<tr>
<td>exec.queue.large</td>
<td>10</td>
- <td></td>
+ <td>Range: 0-1000</td>
</tr>
<tr>
<td>exec.queue.small</td>
<td>100</td>
- <td></td>
+ <td>Range: 0-1001</td>
</tr>
<tr>
<td>exec.queue.threshold</td>
<td>30000000</td>
- <td></td>
+ <td>Range: 0-9223372036854775807</td>
</tr>
<tr>
<td>exec.queue.timeout_millis</td>
<td>300000</td>
- <td></td>
- </tr>
- <tr>
- <td>org.apache.drill.exec.compile.ClassTransformer.scalar_replacement</td>
- <td>try</td>
- <td></td>
+ <td>Range: 0-9223372036854775807</td>
</tr>
<tr>
<td>planner.add_producer_consumer</td>
@@ -280,7 +270,7 @@
<tr>
<td>planner.affinity_factor</td>
<td>1.2</td>
- <td></td>
+ <td>Accepts inputs of type DOUBLE.</td>
</tr>
<tr>
<td>planner.broadcast_factor</td>
@@ -290,22 +280,22 @@
<tr>
<td>planner.broadcast_threshold</td>
<td>10000000</td>
- <td></td>
+ <td>Threshold in number of rows that triggers a broadcast join for a query if the right side of the join contains fewer rows than the threshold. Avoids broadcasting too many rows to join. Range: 0-2147483647</td>
</tr>
<tr>
<td>planner.disable_exchanges</td>
<td>FALSE</td>
- <td></td>
+ <td>Toggles the state of hashing to a random exchange.</td>
</tr>
<tr>
<td>planner.enable_broadcast_join</td>
<td>TRUE</td>
- <td></td>
+ <td>Changes the state of aggregation and join operators. Do not disable.</td>
</tr>
<tr>
<td>planner.enable_demux_exchange</td>
<td>FALSE</td>
- <td></td>
+ <td>Toggles the state of hashing to a demulitplexed exchange.</td>
</tr>
<tr>
<td>planner.enable_hash_single_key</td>
@@ -315,12 +305,12 @@
<tr>
<td>planner.enable_hashagg</td>
<td>TRUE</td>
- <td></td>
+ <td>Enable hash aggregation; otherwise, Drill does a sort-based aggregation. Does not write to disk. Enable is recommended.</td>
</tr>
<tr>
<td>planner.enable_hashjoin</td>
<td>TRUE</td>
- <td></td>
+ <td>Enable the memory hungry hash join. Does not write to disk.</td>
</tr>
<tr>
<td>planner.enable_hashjoin_swap</td>
@@ -330,7 +320,7 @@
<tr>
<td>planner.enable_mergejoin</td>
<td>TRUE</td>
- <td></td>
+ <td>Sort-based operation. Writes to disk.</td>
</tr>
<tr>
<td>planner.enable_multiphase_agg</td>
@@ -340,12 +330,12 @@
<tr>
<td>planner.enable_mux_exchange</td>
<td>TRUE</td>
- <td></td>
+ <td>Toggles the state of hashing to a multiplexed exchange.</td>
</tr>
<tr>
<td>planner.enable_streamagg</td>
<td>TRUE</td>
- <td></td>
+ <td>Sort-based operation. Writes to disk.</td>
</tr>
<tr>
<td>planner.identifier_max_length</td>
@@ -390,7 +380,7 @@
<tr>
<td>planner.memory.non_blocking_operators_memory</td>
<td>64</td>
- <td></td>
+ <td>Range: 0-2048</td>
</tr>
<tr>
<td>planner.partitioner_sender_max_threads</td>
@@ -410,27 +400,27 @@
<tr>
<td>planner.producer_consumer_queue_size</td>
<td>10</td>
- <td></td>
+ <td>How much data to prefetch from disk (in record batches) out of band of query execution</td>
</tr>
<tr>
<td>planner.slice_target</td>
<td>100000</td>
- <td></td>
+ <td>The number of records manipulated within a fragment before Drill parallelizes operations.</td>
</tr>
<tr>
<td>planner.width.max_per_node</td>
<td>3</td>
- <td></td>
+ <td>The maximum degree of distribution of a query across cores and cluster nodes.</td>
</tr>
<tr>
<td>planner.width.max_per_query</td>
<td>1000</td>
- <td></td>
+ <td>Same as planner but applies to the query as executed by the entire cluster.</td>
</tr>
<tr>
<td>store.format</td>
<td>parquet</td>
- <td></td>
+ <td>Output format for data written to tables with the CREATE TABLE AS (CTAS) command. Allowed values are parquet, json, or text. Allowed values: 0, -1, 1000000</td>
</tr>
<tr>
<td>store.json.all_text_mode</td>
@@ -440,17 +430,17 @@
<tr>
<td>store.mongo.all_text_mode</td>
<td>FALSE</td>
- <td></td>
+ <td>Similar to store.json.all_text_mode for MongoDB.</td>
</tr>
<tr>
<td>store.parquet.block-size</td>
<td>536870912</td>
- <td></td>
+ <td>Sets the size of a Parquet row group to the number of bytes less than or equal to the block size of MFS, HDFS, or the file system.</td>
</tr>
<tr>
<td>store.parquet.compression</td>
<td>snappy</td>
- <td></td>
+ <td>Compression type for storing Parquet output. Allowed values: snappy, gzip, none</td>
</tr>
<tr>
<td>store.parquet.enable_dictionary_encoding</td>
@@ -463,22 +453,14 @@
<td></td>
</tr>
<tr>
- <td>store.parquet.vector_fill_check_threshold</td>
- <td>10</td>
- <td></td>
- </tr>
- <tr>
- <td>store.parquet.vector_fill_threshold</td>
- <td>85</td>
- <td></td>
- </tr>
- <tr>
<td>window.enable</td>
<td>FALSE</td>
<td></td>
</tr>
</table>
+<h2 id="memory-allocation">Memory Allocation</h2>
+
<p>You can configure the amount of direct memory allocated to a Drillbit for
query processing. The default limit is 8G, but Drill prefers 16G or more
depending on the workload. The total amount of direct memory that a Drillbit
Modified: drill/site/trunk/content/drill/docs/sql-functions/index.html
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/docs/sql-functions/index.html?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/docs/sql-functions/index.html (original)
+++ drill/site/trunk/content/drill/docs/sql-functions/index.html Mon Apr 13 20:20:50 2015
@@ -78,6 +78,8 @@
<li><a href="/docs/nested-data-functions/">Nested Data</a></li>
<li><a href="/docs/functions-for-handling-nulls">Functions for Handling Nulls</a></li>
</ul>
+
+<p>You need to use a FROM clause in Drill queries. Examples in this documentation often use <code>FROM sys.version</code> in the query for example purposes.</p>
</div>
Modified: drill/site/trunk/content/drill/feed.xml
URL: http://svn.apache.org/viewvc/drill/site/trunk/content/drill/feed.xml?rev=1673272&r1=1673271&r2=1673272&view=diff
==============================================================================
--- drill/site/trunk/content/drill/feed.xml (original)
+++ drill/site/trunk/content/drill/feed.xml Mon Apr 13 20:20:50 2015
@@ -6,8 +6,8 @@
</description>
<link>/</link>
<atom:link href="/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Tue, 07 Apr 2015 18:45:47 -0700</pubDate>
- <lastBuildDate>Tue, 07 Apr 2015 18:45:47 -0700</lastBuildDate>
+ <pubDate>Mon, 13 Apr 2015 13:19:06 -0700</pubDate>
+ <lastBuildDate>Mon, 13 Apr 2015 13:19:06 -0700</lastBuildDate>
<generator>Jekyll v2.5.2</generator>
<item>