You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by jr...@apache.org on 2017/11/13 23:26:53 UTC
[3/7] incubator-impala git commit: Update Impala docs for 2.10 release
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/ca9005be/docs/build/html/topics/impala_min_spillable_buffer_size.html
----------------------------------------------------------------------
diff --git a/docs/build/html/topics/impala_min_spillable_buffer_size.html b/docs/build/html/topics/impala_min_spillable_buffer_size.html
new file mode 100644
index 0000000..d0aa371
--- /dev/null
+++ b/docs/build/html/topics/impala_min_spillable_buffer_size.html
@@ -0,0 +1,87 @@
+<!DOCTYPE html
+ SYSTEM "about:legacy-compat">
+<html lang="en"><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><meta charset="UTF-8"><meta name="copyright" content="(C) Copyright 2017"><meta name="DC.rights.owner" content="(C) Copyright 2017"><meta name="DC.Type" content="concept"><meta name="DC.Relation" scheme="URI" content="../topics/impala_query_options.html"><meta name="prodname" content="Impala"><meta name="prodname" content="Impala"><meta name="version" content="Impala 2.8.x"><meta name="version" content="Impala 2.8.x"><meta name="DC.Format" content="XHTML"><meta name="DC.Identifier" content="min_spillable_buffer_size"><link rel="stylesheet" type="text/css" href="../commonltr.css"><title>MIN_SPILLABLE_BUFFER_SIZE Query Option</title></head><body id="min_spillable_buffer_size"><main role="main"><article role="article" aria-labelledby="ariaid-title1">
+
+ <h1 class="title topictitle1" id="ariaid-title1">MIN_SPILLABLE_BUFFER_SIZE Query Option</h1>
+
+
+
+ <div class="body conbody">
+
+ <p class="p">
+
+ Specifies the minimum size for a memory buffer used when the
+ spill-to-disk mechanism is activated, for example for queries against
+ a large table with no statistics, or large join operations.
+ </p>
+
+ <p class="p">
+ <strong class="ph b">Type:</strong> integer
+ </p>
+
+
+
+ <p class="p">
+ <strong class="ph b">Default:</strong>
+ </p>
+ <p class="p">
+ <code class="ph codeph">65536</code> (64 KB)
+ </p>
+
+ <p class="p">
+ <strong class="ph b">Units:</strong> A numeric argument represents a size in bytes; you can also use a suffix of <code class="ph codeph">m</code>
+ or <code class="ph codeph">mb</code> for megabytes, or <code class="ph codeph">g</code> or <code class="ph codeph">gb</code> for gigabytes. If you
+ specify a value with unrecognized formats, subsequent queries fail with an error.
+ </p>
+
+ <p class="p">
+ <strong class="ph b">Added in:</strong> <span class="keyword">Impala 2.10.0</span>
+ </p>
+
+ <p class="p">
+ <strong class="ph b">Usage notes:</strong>
+ </p>
+ <p class="p">
+ This query option sets a lower bound on the size of the internal
+ buffer size that can be used during spill-to-disk operations. The
+ actual size of the buffer is chosen by the query planner.
+ </p>
+ <p class="p">
+ If overall query performance is limited by the time needed for spilling,
+ consider increasing the <code class="ph codeph">MIN_SPILLABLE_BUFFER_SIZE</code> setting.
+ Larger buffer sizes result in Impala issuing larger I/O requests to storage
+ devices, which might result in higher throughput, particularly on rotational
+ disks.
+ </p>
+ <p class="p">
+ The tradeoff with a large value for this setting is increased memory usage during
+ spill-to-disk operations. Reducing this value may reduce memory consumption.
+ </p>
+ <p class="p">
+ To determine if the value for this setting is having an effect by capping the
+ spillable buffer size, you can see the buffer size chosen by the query planner for
+ a particular query. <code class="ph codeph">EXPLAIN</code> the query while the setting
+ <code class="ph codeph">EXPLAIN_LEVEL=2</code> is in effect.
+ </p>
+
+ <p class="p">
+ <strong class="ph b">Examples:</strong>
+ </p>
+
+<pre class="pre codeblock"><code>
+set min_spillable_buffer_size=128KB;
+
+</code></pre>
+
+ <p class="p">
+ <strong class="ph b">Related information:</strong>
+ </p>
+ <p class="p">
+ <a class="xref" href="impala_buffer_pool_limit.html">BUFFER_POOL_LIMIT Query Option</a>,
+ <a class="xref" href="impala_default_spillable_buffer_size.html">DEFAULT_SPILLABLE_BUFFER_SIZE Query Option</a>,
+ <a class="xref" href="impala_max_row_size.html">MAX_ROW_SIZE Query Option</a>,
+ <a class="xref" href="impala_scalability.html">Scalability Considerations for Impala</a>
+ </p>
+
+ </div>
+<nav role="navigation" class="related-links"><div class="familylinks"><div class="parentlink"><strong>Parent topic:</strong> <a class="link" href="../topics/impala_query_options.html">Query Options for the SET Statement</a></div></div></nav></article></main></body></html>
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/ca9005be/docs/build/html/topics/impala_new_features.html
----------------------------------------------------------------------
diff --git a/docs/build/html/topics/impala_new_features.html b/docs/build/html/topics/impala_new_features.html
index 7413a22..4db2258 100644
--- a/docs/build/html/topics/impala_new_features.html
+++ b/docs/build/html/topics/impala_new_features.html
@@ -18,15 +18,32 @@
- <nav role="navigation" class="related-links"><div class="familylinks"><div class="parentlink"><strong>Parent topic:</strong> <a class="link" href="../topics/impala_release_notes.html">Impala Release Notes</a></div></div></nav><article class="topic concept nested1" aria-labelledby="ariaid-title2" id="new_features__new_features_290">
+ <nav role="navigation" class="related-links"><div class="familylinks"><div class="parentlink"><strong>Parent topic:</strong> <a class="link" href="../topics/impala_release_notes.html">Impala Release Notes</a></div></div></nav><article class="topic concept nested1" aria-labelledby="ariaid-title2" id="new_features__new_features_2100">
- <h2 class="title topictitle2" id="ariaid-title2">New Features in <span class="keyword">Impala 2.9</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title2">New Features in <span class="keyword">Impala 2.10</span></h2>
<div class="body conbody">
<p class="p">
For the full list of issues closed in this release, including the issues
- marked as <span class="q">"new features"</span>, see the
+ marked as <span class="q">"new features"</span> or <span class="q">"improvements"</span>, see the
+ <a class="xref" href="https://impala.incubator.apache.org/docs/changelog-2.10.html" target="_blank">changelog for <span class="keyword">Impala 2.10</span></a>.
+ </p>
+
+ </div>
+ </article>
+
+
+
+ <article class="topic concept nested1" aria-labelledby="ariaid-title3" id="new_features__new_features_290">
+
+ <h2 class="title topictitle2" id="ariaid-title3">New Features in <span class="keyword">Impala 2.9</span></h2>
+
+ <div class="body conbody">
+
+ <p class="p">
+ For the full list of issues closed in this release, including the issues
+ marked as <span class="q">"new features"</span> or <span class="q">"improvements"</span>, see the
<a class="xref" href="https://impala.incubator.apache.org/docs/changelog-2.9.html" target="_blank">changelog for <span class="keyword">Impala 2.9</span></a>.
</p>
@@ -59,9 +76,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title3" id="new_features__new_features_280">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title4" id="new_features__new_features_280">
- <h2 class="title topictitle2" id="ariaid-title3">New Features in <span class="keyword">Impala 2.8</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title4">New Features in <span class="keyword">Impala 2.8</span></h2>
<div class="body conbody">
@@ -430,9 +447,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title4" id="new_features__new_features_270">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title5" id="new_features__new_features_270">
- <h2 class="title topictitle2" id="ariaid-title4">New Features in <span class="keyword">Impala 2.7</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title5">New Features in <span class="keyword">Impala 2.7</span></h2>
<div class="body conbody">
@@ -551,9 +568,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title5" id="new_features__new_features_260">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title6" id="new_features__new_features_260">
- <h2 class="title topictitle2" id="ariaid-title5">New Features in <span class="keyword">Impala 2.6</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title6">New Features in <span class="keyword">Impala 2.6</span></h2>
<div class="body conbody">
@@ -871,9 +888,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title6" id="new_features__new_features_250">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title7" id="new_features__new_features_250">
- <h2 class="title topictitle2" id="ariaid-title6">New Features in <span class="keyword">Impala 2.5</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title7">New Features in <span class="keyword">Impala 2.5</span></h2>
<div class="body conbody">
@@ -1277,9 +1294,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title7" id="new_features__new_features_240">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title8" id="new_features__new_features_240">
- <h2 class="title topictitle2" id="ariaid-title7">New Features in <span class="keyword">Impala 2.4</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title8">New Features in <span class="keyword">Impala 2.4</span></h2>
<div class="body conbody">
@@ -1299,9 +1316,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title8" id="new_features__new_features_230">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title9" id="new_features__new_features_230">
- <h2 class="title topictitle2" id="ariaid-title8">New Features in <span class="keyword">Impala 2.3</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title9">New Features in <span class="keyword">Impala 2.3</span></h2>
<div class="body conbody">
@@ -1670,9 +1687,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title9" id="new_features__new_features_220">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title10" id="new_features__new_features_220">
- <h2 class="title topictitle2" id="ariaid-title9">New Features in <span class="keyword">Impala 2.8</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title10">New Features in <span class="keyword">Impala 2.8</span></h2>
<div class="body conbody">
@@ -1916,9 +1933,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title10" id="new_features__new_features_210">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title11" id="new_features__new_features_210">
- <h2 class="title topictitle2" id="ariaid-title10">New Features in <span class="keyword">Impala 2.1</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title11">New Features in <span class="keyword">Impala 2.1</span></h2>
<div class="body conbody">
@@ -1972,9 +1989,9 @@
- <article class="topic concept nested1" aria-labelledby="ariaid-title11" id="new_features__new_features_200">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title12" id="new_features__new_features_200">
- <h2 class="title topictitle2" id="ariaid-title11">New Features in <span class="keyword">Impala 2.0</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title12">New Features in <span class="keyword">Impala 2.0</span></h2>
<div class="body conbody">
@@ -2283,9 +2300,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title12" id="new_features__new_features_140">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title13" id="new_features__new_features_140">
- <h2 class="title topictitle2" id="ariaid-title12">New Features in <span class="keyword">Impala 1.4</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title13">New Features in <span class="keyword">Impala 1.4</span></h2>
<div class="body conbody">
@@ -2529,9 +2546,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title13" id="new_features__new_features_132">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title14" id="new_features__new_features_132">
- <h2 class="title topictitle2" id="ariaid-title13">New Features in <span class="keyword">Impala 1.3.2</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title14">New Features in <span class="keyword">Impala 1.3.2</span></h2>
<div class="body conbody">
@@ -2544,9 +2561,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title14" id="new_features__new_features_131">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title15" id="new_features__new_features_131">
- <h2 class="title topictitle2" id="ariaid-title14">New Features in Impala 1.3.1</h2>
+ <h2 class="title topictitle2" id="ariaid-title15">New Features in Impala 1.3.1</h2>
<div class="body conbody">
@@ -2598,9 +2615,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title15" id="new_features__new_features_130">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title16" id="new_features__new_features_130">
- <h2 class="title topictitle2" id="ariaid-title15">New Features in <span class="keyword">Impala 1.3</span></h2>
+ <h2 class="title topictitle2" id="ariaid-title16">New Features in <span class="keyword">Impala 1.3</span></h2>
<div class="body conbody">
@@ -2722,9 +2739,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title16" id="new_features__new_features_124">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title17" id="new_features__new_features_124">
- <h2 class="title topictitle2" id="ariaid-title16">New Features in Impala 1.2.4</h2>
+ <h2 class="title topictitle2" id="ariaid-title17">New Features in Impala 1.2.4</h2>
<div class="body conbody">
@@ -2796,9 +2813,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title17" id="new_features__new_features_123">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title18" id="new_features__new_features_123">
- <h2 class="title topictitle2" id="ariaid-title17">New Features in Impala 1.2.3</h2>
+ <h2 class="title topictitle2" id="ariaid-title18">New Features in Impala 1.2.3</h2>
<div class="body conbody">
@@ -2813,9 +2830,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title18" id="new_features__new_features_122">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title19" id="new_features__new_features_122">
- <h2 class="title topictitle2" id="ariaid-title18">New Features in Impala 1.2.2</h2>
+ <h2 class="title topictitle2" id="ariaid-title19">New Features in Impala 1.2.2</h2>
<div class="body conbody">
@@ -2944,9 +2961,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title19" id="new_features__new_features_121">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title20" id="new_features__new_features_121">
- <h2 class="title topictitle2" id="ariaid-title19">New Features in Impala 1.2.1</h2>
+ <h2 class="title topictitle2" id="ariaid-title20">New Features in Impala 1.2.1</h2>
<div class="body conbody">
@@ -3135,9 +3152,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title20" id="new_features__new_features_120">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title21" id="new_features__new_features_120">
- <h2 class="title topictitle2" id="ariaid-title20">New Features in Impala 1.2.0 (Beta)</h2>
+ <h2 class="title topictitle2" id="ariaid-title21">New Features in Impala 1.2.0 (Beta)</h2>
<div class="body conbody">
@@ -3300,9 +3317,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title21" id="new_features__new_features_111">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title22" id="new_features__new_features_111">
- <h2 class="title topictitle2" id="ariaid-title21">New Features in Impala 1.1.1</h2>
+ <h2 class="title topictitle2" id="ariaid-title22">New Features in Impala 1.1.1</h2>
<div class="body conbody">
@@ -3340,9 +3357,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title22" id="new_features__new_features_11">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title23" id="new_features__new_features_11">
- <h2 class="title topictitle2" id="ariaid-title22">New Features in Impala 1.1</h2>
+ <h2 class="title topictitle2" id="ariaid-title23">New Features in Impala 1.1</h2>
<div class="body conbody">
@@ -3474,9 +3491,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title23" id="new_features__new_features_101">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title24" id="new_features__new_features_101">
- <h2 class="title topictitle2" id="ariaid-title23">New Features in Impala 1.0.1</h2>
+ <h2 class="title topictitle2" id="ariaid-title24">New Features in Impala 1.0.1</h2>
<div class="body conbody">
@@ -3511,9 +3528,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title24" id="new_features__new_features_10">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title25" id="new_features__new_features_10">
- <h2 class="title topictitle2" id="ariaid-title24">New Features in Impala 1.0</h2>
+ <h2 class="title topictitle2" id="ariaid-title25">New Features in Impala 1.0</h2>
<div class="body conbody">
@@ -3547,9 +3564,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title25" id="new_features__new_features_07">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title26" id="new_features__new_features_07">
- <h2 class="title topictitle2" id="ariaid-title25">New Features in Version 0.7 of the Impala Beta Release</h2>
+ <h2 class="title topictitle2" id="ariaid-title26">New Features in Version 0.7 of the Impala Beta Release</h2>
<div class="body conbody">
@@ -3602,9 +3619,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title26" id="new_features__new_features_06">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title27" id="new_features__new_features_06">
- <h2 class="title topictitle2" id="ariaid-title26">New Features in Version 0.6 of the Impala Beta Release</h2>
+ <h2 class="title topictitle2" id="ariaid-title27">New Features in Version 0.6 of the Impala Beta Release</h2>
<div class="body conbody">
@@ -3640,9 +3657,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title27" id="new_features__new_features_05">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title28" id="new_features__new_features_05">
- <h2 class="title topictitle2" id="ariaid-title27">New Features in Version 0.5 of the Impala Beta Release</h2>
+ <h2 class="title topictitle2" id="ariaid-title28">New Features in Version 0.5 of the Impala Beta Release</h2>
<div class="body conbody">
@@ -3663,9 +3680,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title28" id="new_features__new_features_04">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title29" id="new_features__new_features_04">
- <h2 class="title topictitle2" id="ariaid-title28">New Features in Version 0.4 of the Impala Beta Release</h2>
+ <h2 class="title topictitle2" id="ariaid-title29">New Features in Version 0.4 of the Impala Beta Release</h2>
<div class="body conbody">
@@ -3695,9 +3712,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title29" id="new_features__new_features_03">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title30" id="new_features__new_features_03">
- <h2 class="title topictitle2" id="ariaid-title29">New Features in Version 0.3 of the Impala Beta Release</h2>
+ <h2 class="title topictitle2" id="ariaid-title30">New Features in Version 0.3 of the Impala Beta Release</h2>
<div class="body conbody">
@@ -3720,9 +3737,9 @@
</article>
- <article class="topic concept nested1" aria-labelledby="ariaid-title30" id="new_features__new_features_02">
+ <article class="topic concept nested1" aria-labelledby="ariaid-title31" id="new_features__new_features_02">
- <h2 class="title topictitle2" id="ariaid-title30">New Features in Version 0.2 of the Impala Beta Release</h2>
+ <h2 class="title topictitle2" id="ariaid-title31">New Features in Version 0.2 of the Impala Beta Release</h2>
<div class="body conbody">
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/ca9005be/docs/build/html/topics/impala_partitioning.html
----------------------------------------------------------------------
diff --git a/docs/build/html/topics/impala_partitioning.html b/docs/build/html/topics/impala_partitioning.html
index b361083..9a90836 100644
--- a/docs/build/html/topics/impala_partitioning.html
+++ b/docs/build/html/topics/impala_partitioning.html
@@ -650,4 +650,152 @@ explain select s from yy2 where year in (select year from yy where year between
</article>
+ <article class="topic concept nested1" aria-labelledby="ariaid-title15" id="partitioning__partition_stats">
+ <h2 class="title topictitle2" id="ariaid-title15">Keeping Statistics Up to Date for Partitioned Tables</h2>
+ <div class="body conbody">
+
+ <p class="p">
+ Because the <code class="ph codeph">COMPUTE STATS</code> statement can be resource-intensive to run on a partitioned table
+ as new partitions are added, Impala includes a variation of this statement that allows computing statistics
+ on a per-partition basis such that stats can be incrementally updated when new partitions are added.
+ </p>
+
+ <div class="note important note_important"><span class="note__title importanttitle">Important:</span>
+ <p class="p">
+ For a particular table, use either <code class="ph codeph">COMPUTE STATS</code> or
+ <code class="ph codeph">COMPUTE INCREMENTAL STATS</code>, but never combine the two or alternate
+ between them. If you switch from <code class="ph codeph">COMPUTE STATS</code> to
+ <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> during the lifetime of a table, or vice
+ versa, drop all statistics (by running both <code class="ph codeph">DROP STATS</code> and
+ <code class="ph codeph">DROP INCREMENTAL STATS</code>) before making the switch.
+ </p>
+ <p class="p">
+ When you run <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> on a table for the first time,
+ the statistics are computed again from scratch regardless of whether the table already
+ has statistics. Therefore, expect a one-time resource-intensive operation
+ for scanning the entire table when running <code class="ph codeph">COMPUTE INCREMENTAL STATS</code>
+ for the first time on a given table.
+ </p>
+ <p class="p">
+ For a table with a huge number of partitions and many columns, the approximately 400 bytes
+ of metadata per column per partition can add up to significant memory overhead, as it must
+ be cached on the <span class="keyword cmdname">catalogd</span> host and on every <span class="keyword cmdname">impalad</span> host
+ that is eligible to be a coordinator. If this metadata for all tables combined exceeds 2 GB,
+ you might experience service downtime.
+ </p>
+ </div>
+
+ <p class="p">
+ The <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> variation computes statistics only for partitions that were
+ added or changed since the last <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> statement, rather than the entire
+ table. It is typically used for tables where a full <code class="ph codeph">COMPUTE STATS</code>
+ operation takes too long to be practical each time a partition is added or dropped. See
+ <a class="xref" href="impala_perf_stats.html#perf_stats_incremental">Overview of Incremental Statistics</a> for full usage details.
+ </p>
+
+<pre class="pre codeblock"><code>-- Initially the table has no incremental stats, as indicated
+-- 'false' under Incremental stats.
+show table stats item_partitioned;
++-------------+-------+--------+----------+--------------+---------+------------------
+| i_category | #Rows | #Files | Size | Bytes Cached | Format | Incremental stats
++-------------+-------+--------+----------+--------------+---------+------------------
+| Books | -1 | 1 | 223.74KB | NOT CACHED | PARQUET | false
+| Children | -1 | 1 | 230.05KB | NOT CACHED | PARQUET | false
+| Electronics | -1 | 1 | 232.67KB | NOT CACHED | PARQUET | false
+| Home | -1 | 1 | 232.56KB | NOT CACHED | PARQUET | false
+| Jewelry | -1 | 1 | 223.72KB | NOT CACHED | PARQUET | false
+| Men | -1 | 1 | 231.25KB | NOT CACHED | PARQUET | false
+| Music | -1 | 1 | 237.90KB | NOT CACHED | PARQUET | false
+| Shoes | -1 | 1 | 234.90KB | NOT CACHED | PARQUET | false
+| Sports | -1 | 1 | 227.97KB | NOT CACHED | PARQUET | false
+| Women | -1 | 1 | 226.27KB | NOT CACHED | PARQUET | false
+| Total | -1 | 10 | 2.25MB | 0B | |
++-------------+-------+--------+----------+--------------+---------+------------------
+
+-- After the first COMPUTE INCREMENTAL STATS,
+-- all partitions have stats. The first
+-- COMPUTE INCREMENTAL STATS scans the whole
+-- table, discarding any previous stats from
+-- a traditional COMPUTE STATS statement.
+compute incremental stats item_partitioned;
++-------------------------------------------+
+| summary |
++-------------------------------------------+
+| Updated 10 partition(s) and 21 column(s). |
++-------------------------------------------+
+show table stats item_partitioned;
++-------------+-------+--------+----------+--------------+---------+------------------
+| i_category | #Rows | #Files | Size | Bytes Cached | Format | Incremental stats
++-------------+-------+--------+----------+--------------+---------+------------------
+| Books | 1733 | 1 | 223.74KB | NOT CACHED | PARQUET | true
+| Children | 1786 | 1 | 230.05KB | NOT CACHED | PARQUET | true
+| Electronics | 1812 | 1 | 232.67KB | NOT CACHED | PARQUET | true
+| Home | 1807 | 1 | 232.56KB | NOT CACHED | PARQUET | true
+| Jewelry | 1740 | 1 | 223.72KB | NOT CACHED | PARQUET | true
+| Men | 1811 | 1 | 231.25KB | NOT CACHED | PARQUET | true
+| Music | 1860 | 1 | 237.90KB | NOT CACHED | PARQUET | true
+| Shoes | 1835 | 1 | 234.90KB | NOT CACHED | PARQUET | true
+| Sports | 1783 | 1 | 227.97KB | NOT CACHED | PARQUET | true
+| Women | 1790 | 1 | 226.27KB | NOT CACHED | PARQUET | true
+| Total | 17957 | 10 | 2.25MB | 0B | |
++-------------+-------+--------+----------+--------------+---------+------------------
+
+-- Add a new partition...
+alter table item_partitioned add partition (i_category='Camping');
+-- Add or replace files in HDFS outside of Impala,
+-- rendering the stats for a partition obsolete.
+!import_data_into_sports_partition.sh
+refresh item_partitioned;
+drop incremental stats item_partitioned partition (i_category='Sports');
+-- Now some partitions have incremental stats
+-- and some do not.
+show table stats item_partitioned;
++-------------+-------+--------+----------+--------------+---------+------------------
+| i_category | #Rows | #Files | Size | Bytes Cached | Format | Incremental stats
++-------------+-------+--------+----------+--------------+---------+------------------
+| Books | 1733 | 1 | 223.74KB | NOT CACHED | PARQUET | true
+| Camping | -1 | 1 | 408.02KB | NOT CACHED | PARQUET | false
+| Children | 1786 | 1 | 230.05KB | NOT CACHED | PARQUET | true
+| Electronics | 1812 | 1 | 232.67KB | NOT CACHED | PARQUET | true
+| Home | 1807 | 1 | 232.56KB | NOT CACHED | PARQUET | true
+| Jewelry | 1740 | 1 | 223.72KB | NOT CACHED | PARQUET | true
+| Men | 1811 | 1 | 231.25KB | NOT CACHED | PARQUET | true
+| Music | 1860 | 1 | 237.90KB | NOT CACHED | PARQUET | true
+| Shoes | 1835 | 1 | 234.90KB | NOT CACHED | PARQUET | true
+| Sports | -1 | 1 | 227.97KB | NOT CACHED | PARQUET | false
+| Women | 1790 | 1 | 226.27KB | NOT CACHED | PARQUET | true
+| Total | 17957 | 11 | 2.65MB | 0B | |
++-------------+-------+--------+----------+--------------+---------+------------------
+
+-- After another COMPUTE INCREMENTAL STATS,
+-- all partitions have incremental stats, and only the 2
+-- partitions without incremental stats were scanned.
+compute incremental stats item_partitioned;
++------------------------------------------+
+| summary |
++------------------------------------------+
+| Updated 2 partition(s) and 21 column(s). |
++------------------------------------------+
+show table stats item_partitioned;
++-------------+-------+--------+----------+--------------+---------+------------------
+| i_category | #Rows | #Files | Size | Bytes Cached | Format | Incremental stats
++-------------+-------+--------+----------+--------------+---------+------------------
+| Books | 1733 | 1 | 223.74KB | NOT CACHED | PARQUET | true
+| Camping | 5328 | 1 | 408.02KB | NOT CACHED | PARQUET | true
+| Children | 1786 | 1 | 230.05KB | NOT CACHED | PARQUET | true
+| Electronics | 1812 | 1 | 232.67KB | NOT CACHED | PARQUET | true
+| Home | 1807 | 1 | 232.56KB | NOT CACHED | PARQUET | true
+| Jewelry | 1740 | 1 | 223.72KB | NOT CACHED | PARQUET | true
+| Men | 1811 | 1 | 231.25KB | NOT CACHED | PARQUET | true
+| Music | 1860 | 1 | 237.90KB | NOT CACHED | PARQUET | true
+| Shoes | 1835 | 1 | 234.90KB | NOT CACHED | PARQUET | true
+| Sports | 1783 | 1 | 227.97KB | NOT CACHED | PARQUET | true
+| Women | 1790 | 1 | 226.27KB | NOT CACHED | PARQUET | true
+| Total | 17957 | 11 | 2.65MB | 0B | |
++-------------+-------+--------+----------+--------------+---------+------------------
+</code></pre>
+
+ </div>
+ </article>
+
</article></main></body></html>
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/ca9005be/docs/build/html/topics/impala_perf_joins.html
----------------------------------------------------------------------
diff --git a/docs/build/html/topics/impala_perf_joins.html b/docs/build/html/topics/impala_perf_joins.html
index 064a8c5..cb9713a 100644
--- a/docs/build/html/topics/impala_perf_joins.html
+++ b/docs/build/html/topics/impala_perf_joins.html
@@ -30,8 +30,9 @@
<p class="p">
If statistics are not available for all the tables in the join query, or if Impala chooses a join order that
is not the most efficient, you can override the automatic join order optimization by specifying the
- <code class="ph codeph">STRAIGHT_JOIN</code> keyword immediately after the <code class="ph codeph">SELECT</code> keyword. In this case,
- Impala uses the order the tables appear in the query to guide how the joins are processed.
+ <code class="ph codeph">STRAIGHT_JOIN</code> keyword immediately after the <code class="ph codeph">SELECT</code> and any <code class="ph codeph">DISTINCT</code>
+ or <code class="ph codeph">ALL</code> keywords. In this case, Impala uses the order the tables appear in the query to guide how the
+ joins are processed.
</p>
<p class="p">
@@ -118,12 +119,22 @@
<p class="p">
If an Impala join query is inefficient because of outdated statistics or unexpected data distribution, you
can keep Impala from reordering the joined tables by using the <code class="ph codeph">STRAIGHT_JOIN</code> keyword
- immediately after the <code class="ph codeph">SELECT</code> keyword. The <code class="ph codeph">STRAIGHT_JOIN</code> keyword turns off
+ immediately after the <code class="ph codeph">SELECT</code> and any <code class="ph codeph">DISTINCT</code> or <code class="ph codeph">ALL</code>
+ keywords. The <code class="ph codeph">STRAIGHT_JOIN</code> keyword turns off
the reordering of join clauses that Impala does internally, and produces a plan that relies on the join
clauses being ordered optimally in the query text. In this case, rewrite the query so that the largest
table is on the left, followed by the next largest, and so on until the smallest table is on the right.
</p>
+ <div class="note note note_note"><span class="note__title notetitle">Note:</span>
+ <p class="p">
+ The <code class="ph codeph">STRAIGHT_JOIN</code> hint affects the join order of table references in the query
+ block containing the hint. It does not affect the join order of nested queries, such as views,
+ inline views, or <code class="ph codeph">WHERE</code>-clause subqueries. To use this hint for performance
+ tuning of complex queries, apply the hint to all query blocks that need a fixed join order.
+ </p>
+ </div>
+
<p class="p">
In this example, the subselect from the <code class="ph codeph">BIG</code> table produces a very small result set, but
the table might still be treated as if it were the biggest and placed first in the join order. Using
@@ -132,6 +143,10 @@
</p>
<pre class="pre codeblock"><code>select straight_join x from medium join small join (select * from big where c1 < 10) as big
+ where medium.id = small.id and small.id = big.id;
+
+-- If the query contains [DISTINCT | ALL], the hint goes after those keywords.
+select distinct straight_join x from medium join small join (select * from big where c1 < 10) as big
where medium.id = small.id and small.id = big.id;</code></pre>
</div>
</article>
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/ca9005be/docs/build/html/topics/impala_perf_stats.html
----------------------------------------------------------------------
diff --git a/docs/build/html/topics/impala_perf_stats.html b/docs/build/html/topics/impala_perf_stats.html
index 7ad1fb0..4d7d17e 100644
--- a/docs/build/html/topics/impala_perf_stats.html
+++ b/docs/build/html/topics/impala_perf_stats.html
@@ -300,15 +300,6 @@ show column stats year_month_day;
+-----------+---------+------------------+--------+----------+-------------------+
</code></pre>
- <div class="note note note_note"><span class="note__title notetitle">Note:</span>
- Partitioned tables can grow so large that scanning the entire table, as the <code class="ph codeph">COMPUTE STATS</code>
- statement does, is impractical just to update the statistics for a new partition. The standard
- <code class="ph codeph">COMPUTE STATS</code> statement might take hours, or even days. That situation is where you switch
- to using incremental statistics, a feature available in <span class="keyword">Impala 2.1</span> and higher.
- See <a class="xref" href="impala_perf_stats.html#perf_stats_incremental">Overview of Incremental Statistics</a> for details about this feature
- and the <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> syntax.
- </div>
-
<p class="p">
If you run the Hive statement <code class="ph codeph">ANALYZE TABLE COMPUTE STATISTICS FOR COLUMNS</code>,
Impala can only use the resulting column statistics if the table is unpartitioned.
@@ -337,6 +328,31 @@ show column stats year_month_day;
entire table each time.
</p>
+ <div class="note important note_important"><span class="note__title importanttitle">Important:</span>
+ <p class="p">
+ For a particular table, use either <code class="ph codeph">COMPUTE STATS</code> or
+ <code class="ph codeph">COMPUTE INCREMENTAL STATS</code>, but never combine the two or alternate
+ between them. If you switch from <code class="ph codeph">COMPUTE STATS</code> to
+ <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> during the lifetime of a table, or vice
+ versa, drop all statistics (by running both <code class="ph codeph">DROP STATS</code> and
+ <code class="ph codeph">DROP INCREMENTAL STATS</code>) before making the switch.
+ </p>
+ <p class="p">
+ When you run <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> on a table for the first time,
+ the statistics are computed again from scratch regardless of whether the table already
+ has statistics. Therefore, expect a one-time resource-intensive operation
+ for scanning the entire table when running <code class="ph codeph">COMPUTE INCREMENTAL STATS</code>
+ for the first time on a given table.
+ </p>
+ <p class="p">
+ For a table with a huge number of partitions and many columns, the approximately 400 bytes
+ of metadata per column per partition can add up to significant memory overhead, as it must
+ be cached on the <span class="keyword cmdname">catalogd</span> host and on every <span class="keyword cmdname">impalad</span> host
+ that is eligible to be a coordinator. If this metadata for all tables combined exceeds 2 GB,
+ you might experience service downtime.
+ </p>
+ </div>
+
<p class="p">
You can also compute or drop statistics for a single partition by including a <code class="ph codeph">PARTITION</code>
clause in the <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> or <code class="ph codeph">DROP INCREMENTAL STATS</code>
@@ -350,9 +366,9 @@ show column stats year_month_day;
<ul class="ul">
<li class="li">
<p class="p">
- If you have an existing partitioned table for which you have already computed statistics, issuing
- <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> without a partition clause causes Impala to rescan the
- entire table. Once the incremental statistics are computed, any future <code class="ph codeph">COMPUTE INCREMENTAL
+ If you have a partitioned table for which you have already run a regular <code class="ph codeph">COMPUTE STATS</code>
+ statement, issuing <code class="ph codeph">COMPUTE INCREMENTAL STATS</code> without a partition clause causes Impala
+ to rescan the entire table. Once the incremental statistics are computed, any future <code class="ph codeph">COMPUTE INCREMENTAL
STATS</code> statements only scan any new partitions and any partitions where you performed
<code class="ph codeph">DROP INCREMENTAL STATS</code>.
</p>
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/ca9005be/docs/build/html/topics/impala_query_options.html
----------------------------------------------------------------------
diff --git a/docs/build/html/topics/impala_query_options.html b/docs/build/html/topics/impala_query_options.html
index 2fbda3f..2d52cff 100644
--- a/docs/build/html/topics/impala_query_options.html
+++ b/docs/build/html/topics/impala_query_options.html
@@ -1,6 +1,6 @@
<!DOCTYPE html
SYSTEM "about:legacy-compat">
-<html lang="en"><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><meta charset="UTF-8"><meta name="copyright" content="(C) Copyright 2017"><meta name="DC.rights.owner" content="(C) Copyright 2017"><meta name="DC.Type" content="concept"><meta name="DC.Relation" scheme="URI" content="../topics/impala_set.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_abort_on_default_limit_exceeded.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_abort_on_error.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_allow_unsupported_formats.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_appx_count_distinct.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_batch_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_compression_codec.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_debug_action.html"><meta name="DC.Relation" scheme="URI"
content="../topics/impala_default_join_distribution_mode.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_default_order_by_limit.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_codegen.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_decimal_v2.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_row_runtime_filtering.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_streaming_preaggregations.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_unsafe_spills.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_exec_single_node_rows_threshold.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_explain_level.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_hbase_cache_blocks.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_hbase_caching.html"><meta name="DC.Rela
tion" scheme="URI" content="../topics/impala_live_progress.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_live_summary.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_errors.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_io_buffers.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_scan_range_length.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_num_runtime_filters.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_mem_limit.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_mt_dop.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_num_nodes.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_num_scanner_threads.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_optimize_partition_key_scans.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet
_compression_codec.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet_annotate_strings_utf8.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet_fallback_schema_resolution.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet_file_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_prefetch_mode.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_query_timeout_s.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_request_pool.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_replica_preference.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_reservation_request_timeout.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_bloom_filter_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_filter_max_size.html"><meta name="DC.Relation" scheme="URI" content="..
/topics/impala_runtime_filter_min_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_filter_mode.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_filter_wait_time_ms.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_s3_skip_insert_staging.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_scan_node_codegen_threshold.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_scratch_limit.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_schedule_random_replica.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_support_start_over.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_sync_ddl.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_v_cpu_cores.html"><meta name="prodname" content="Impala"><meta name="prodname" content="Impala"><meta name="version" content="Impala 2.8.x"><meta name="version" co
ntent="Impala 2.8.x"><meta name="DC.Format" content="XHTML"><meta name="DC.Identifier" content="query_options"><link rel="stylesheet" type="text/css" href="../commonltr.css"><title>Query Options for the SET Statement</title></head><body id="query_options"><main role="main"><article role="article" aria-labelledby="ariaid-title1">
+<html lang="en"><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><meta charset="UTF-8"><meta name="copyright" content="(C) Copyright 2017"><meta name="DC.rights.owner" content="(C) Copyright 2017"><meta name="DC.Type" content="concept"><meta name="DC.Relation" scheme="URI" content="../topics/impala_set.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_abort_on_default_limit_exceeded.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_abort_on_error.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_allow_unsupported_formats.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_appx_count_distinct.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_batch_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_buffer_pool_limit.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_compression_codec.html"><meta name="DC.Relation" scheme="
URI" content="../topics/impala_debug_action.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_decimal_v2.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_default_join_distribution_mode.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_default_order_by_limit.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_default_spillable_buffer_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_codegen.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_row_runtime_filtering.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_streaming_preaggregations.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_disable_unsafe_spills.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_exec_single_node_rows_threshold.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_explain_level.html"><met
a name="DC.Relation" scheme="URI" content="../topics/impala_hbase_cache_blocks.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_hbase_caching.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_live_progress.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_live_summary.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_errors.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_io_buffers.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_row_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_num_runtime_filters.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_max_scan_range_length.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_mem_limit.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_min_spillable_buffer_size.html"><meta name="DC.Relation" scheme="URI" content="../
topics/impala_mt_dop.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_num_nodes.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_num_scanner_threads.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_optimize_partition_key_scans.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet_compression_codec.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet_annotate_strings_utf8.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet_fallback_schema_resolution.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_parquet_file_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_prefetch_mode.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_query_timeout_s.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_request_pool.html"><meta name="DC.Relation" scheme="URI" content="../topics/im
pala_replica_preference.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_reservation_request_timeout.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_bloom_filter_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_filter_max_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_filter_min_size.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_filter_mode.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_runtime_filter_wait_time_ms.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_s3_skip_insert_staging.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_scan_node_codegen_threshold.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_schedule_random_replica.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_scratch_limit.html"><meta name="DC.Relation" sch
eme="URI" content="../topics/impala_support_start_over.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_sync_ddl.html"><meta name="DC.Relation" scheme="URI" content="../topics/impala_v_cpu_cores.html"><meta name="prodname" content="Impala"><meta name="prodname" content="Impala"><meta name="version" content="Impala 2.8.x"><meta name="version" content="Impala 2.8.x"><meta name="DC.Format" content="XHTML"><meta name="DC.Identifier" content="query_options"><link rel="stylesheet" type="text/css" href="../commonltr.css"><title>Query Options for the SET Statement</title></head><body id="query_options"><main role="main"><article role="article" aria-labelledby="ariaid-title1">
<h1 class="title topictitle1" id="ariaid-title1">Query Options for the SET Statement</h1>
@@ -46,4 +46,4 @@
<a class="xref" href="impala_set.html#set">SET Statement</a>
</p>
</div>
-<nav role="navigation" class="related-links"><ul class="ullinks"><li class="link ulchildlink"><strong><a href="../topics/impala_abort_on_default_limit_exceeded.html">ABORT_ON_DEFAULT_LIMIT_EXCEEDED Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_abort_on_error.html">ABORT_ON_ERROR Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_allow_unsupported_formats.html">ALLOW_UNSUPPORTED_FORMATS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_appx_count_distinct.html">APPX_COUNT_DISTINCT Query Option (Impala 2.0 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_batch_size.html">BATCH_SIZE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_compression_codec.html">COMPRESSION_CODEC Query Option (Impala 2.0 or higher only)</a></strong><br></li><li class="lin
k ulchildlink"><strong><a href="../topics/impala_debug_action.html">DEBUG_ACTION Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_default_join_distribution_mode.html">DEFAULT_JOIN_DISTRIBUTION_MODE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_default_order_by_limit.html">DEFAULT_ORDER_BY_LIMIT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_disable_codegen.html">DISABLE_CODEGEN Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_decimal_v2.html">DECIMAL_V2 Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_disable_row_runtime_filtering.html">DISABLE_ROW_RUNTIME_FILTERING Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_disable_streaming_preaggregations.html">DISABLE_STREAM
ING_PREAGGREGATIONS Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_disable_unsafe_spills.html">DISABLE_UNSAFE_SPILLS Query Option (Impala 2.0 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_exec_single_node_rows_threshold.html">EXEC_SINGLE_NODE_ROWS_THRESHOLD Query Option (Impala 2.1 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_explain_level.html">EXPLAIN_LEVEL Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_hbase_cache_blocks.html">HBASE_CACHE_BLOCKS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_hbase_caching.html">HBASE_CACHING Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_live_progress.html">LIVE_PROGRESS Query Option (Impala 2.3 or higher only)</a><
/strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_live_summary.html">LIVE_SUMMARY Query Option (Impala 2.3 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_errors.html">MAX_ERRORS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_io_buffers.html">MAX_IO_BUFFERS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_scan_range_length.html">MAX_SCAN_RANGE_LENGTH Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_num_runtime_filters.html">MAX_NUM_RUNTIME_FILTERS Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_mem_limit.html">MEM_LIMIT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_mt_dop.html">MT_DOP Query Option</a></strong><br></li
><li class="link ulchildlink"><strong><a href="../topics/impala_num_nodes.html">NUM_NODES Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_num_scanner_threads.html">NUM_SCANNER_THREADS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_optimize_partition_key_scans.html">OPTIMIZE_PARTITION_KEY_SCANS Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_compression_codec.html">PARQUET_COMPRESSION_CODEC Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_annotate_strings_utf8.html">PARQUET_ANNOTATE_STRINGS_UTF8 Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_fallback_schema_resolution.html">PARQUET_FALLBACK_SCHEMA_RESOLUTION Query Option (Impala 2.6 or higher only)</a></strong><br
></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_file_size.html">PARQUET_FILE_SIZE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_prefetch_mode.html">PREFETCH_MODE Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_query_timeout_s.html">QUERY_TIMEOUT_S Query Option (Impala 2.0 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_request_pool.html">REQUEST_POOL Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_replica_preference.html">REPLICA_PREFERENCE Query Option (Impala 2.7 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_reservation_request_timeout.html">RESERVATION_REQUEST_TIMEOUT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_bl
oom_filter_size.html">RUNTIME_BLOOM_FILTER_SIZE Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_max_size.html">RUNTIME_FILTER_MAX_SIZE Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_min_size.html">RUNTIME_FILTER_MIN_SIZE Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_mode.html">RUNTIME_FILTER_MODE Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_wait_time_ms.html">RUNTIME_FILTER_WAIT_TIME_MS Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_s3_skip_insert_staging.html">S3_SKIP_INSERT_STAGING Query Option (Impala 2.6 or higher only)</a></strong><br
></li><li class="link ulchildlink"><strong><a href="../topics/impala_scan_node_codegen_threshold.html">SCAN_NODE_CODEGEN_THRESHOLD Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_scratch_limit.html">SCRATCH_LIMIT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_schedule_random_replica.html">SCHEDULE_RANDOM_REPLICA Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_support_start_over.html">SUPPORT_START_OVER Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_sync_ddl.html">SYNC_DDL Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_v_cpu_cores.html">V_CPU_CORES Query Option</a></strong><br></li></ul><div class="familylinks"><div class="parentlink"><strong>Parent topic:</strong> <a class="link" href
="../topics/impala_set.html">SET Statement</a></div></div></nav></article></main></body></html>
\ No newline at end of file
+<nav role="navigation" class="related-links"><ul class="ullinks"><li class="link ulchildlink"><strong><a href="../topics/impala_abort_on_default_limit_exceeded.html">ABORT_ON_DEFAULT_LIMIT_EXCEEDED Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_abort_on_error.html">ABORT_ON_ERROR Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_allow_unsupported_formats.html">ALLOW_UNSUPPORTED_FORMATS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_appx_count_distinct.html">APPX_COUNT_DISTINCT Query Option (Impala 2.0 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_batch_size.html">BATCH_SIZE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_buffer_pool_limit.html">BUFFER_POOL_LIMIT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a hr
ef="../topics/impala_compression_codec.html">COMPRESSION_CODEC Query Option (Impala 2.0 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_debug_action.html">DEBUG_ACTION Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_decimal_v2.html">DECIMAL_V2 Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_default_join_distribution_mode.html">DEFAULT_JOIN_DISTRIBUTION_MODE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_default_order_by_limit.html">DEFAULT_ORDER_BY_LIMIT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_default_spillable_buffer_size.html">DEFAULT_SPILLABLE_BUFFER_SIZE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_disable_codegen.html">DISABLE_CODEGEN Query Option</a></strong><br></li><li cl
ass="link ulchildlink"><strong><a href="../topics/impala_disable_row_runtime_filtering.html">DISABLE_ROW_RUNTIME_FILTERING Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_disable_streaming_preaggregations.html">DISABLE_STREAMING_PREAGGREGATIONS Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_disable_unsafe_spills.html">DISABLE_UNSAFE_SPILLS Query Option (Impala 2.0 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_exec_single_node_rows_threshold.html">EXEC_SINGLE_NODE_ROWS_THRESHOLD Query Option (Impala 2.1 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_explain_level.html">EXPLAIN_LEVEL Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_hbase_cache_blocks.html">HBASE_CACHE_BLOCKS Query
Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_hbase_caching.html">HBASE_CACHING Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_live_progress.html">LIVE_PROGRESS Query Option (Impala 2.3 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_live_summary.html">LIVE_SUMMARY Query Option (Impala 2.3 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_errors.html">MAX_ERRORS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_io_buffers.html">MAX_IO_BUFFERS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_row_size.html">MAX_ROW_SIZE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_num_runtime_filters.html">MAX_NUM_RUNTIME_FILTERS Query Option (Imp
ala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_max_scan_range_length.html">MAX_SCAN_RANGE_LENGTH Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_mem_limit.html">MEM_LIMIT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_min_spillable_buffer_size.html">MIN_SPILLABLE_BUFFER_SIZE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_mt_dop.html">MT_DOP Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_num_nodes.html">NUM_NODES Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_num_scanner_threads.html">NUM_SCANNER_THREADS Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_optimize_partition_key_scans.html">OPTIMIZE_PARTITION_KEY_SCANS Query Option (Imp
ala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_compression_codec.html">PARQUET_COMPRESSION_CODEC Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_annotate_strings_utf8.html">PARQUET_ANNOTATE_STRINGS_UTF8 Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_fallback_schema_resolution.html">PARQUET_FALLBACK_SCHEMA_RESOLUTION Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_parquet_file_size.html">PARQUET_FILE_SIZE Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_prefetch_mode.html">PREFETCH_MODE Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_query_timeout_s.html">QUERY_TIMEOUT_S Query
Option (Impala 2.0 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_request_pool.html">REQUEST_POOL Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_replica_preference.html">REPLICA_PREFERENCE Query Option (Impala 2.7 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_reservation_request_timeout.html">RESERVATION_REQUEST_TIMEOUT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_bloom_filter_size.html">RUNTIME_BLOOM_FILTER_SIZE Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_max_size.html">RUNTIME_FILTER_MAX_SIZE Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_min_size.html">RUNTIME_FILTER_MIN_SIZE Query
Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_mode.html">RUNTIME_FILTER_MODE Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_runtime_filter_wait_time_ms.html">RUNTIME_FILTER_WAIT_TIME_MS Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_s3_skip_insert_staging.html">S3_SKIP_INSERT_STAGING Query Option (Impala 2.6 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_scan_node_codegen_threshold.html">SCAN_NODE_CODEGEN_THRESHOLD Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_schedule_random_replica.html">SCHEDULE_RANDOM_REPLICA Query Option (Impala 2.5 or higher only)</a></strong><br></li><li class="link ulchildlink"><strong><a
href="../topics/impala_scratch_limit.html">SCRATCH_LIMIT Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_support_start_over.html">SUPPORT_START_OVER Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_sync_ddl.html">SYNC_DDL Query Option</a></strong><br></li><li class="link ulchildlink"><strong><a href="../topics/impala_v_cpu_cores.html">V_CPU_CORES Query Option</a></strong><br></li></ul><div class="familylinks"><div class="parentlink"><strong>Parent topic:</strong> <a class="link" href="../topics/impala_set.html">SET Statement</a></div></div></nav></article></main></body></html>
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/ca9005be/docs/build/html/topics/impala_reserved_words.html
----------------------------------------------------------------------
diff --git a/docs/build/html/topics/impala_reserved_words.html b/docs/build/html/topics/impala_reserved_words.html
index 2516a6d..dc92593 100644
--- a/docs/build/html/topics/impala_reserved_words.html
+++ b/docs/build/html/topics/impala_reserved_words.html
@@ -193,6 +193,7 @@ string
symbol
table
tables
+<span class="ph">tablesample</span>
tblproperties
terminated
textfile
@@ -333,7 +334,6 @@ shutdown
some
statistics
system_user
-tablesample
textsize
then
top