You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by ta...@apache.org on 2021/01/26 23:35:29 UTC
[impala] 01/02: IMPALA-10404: Update docs to reflect RLE_DICTIONARY
support
This is an automated email from the ASF dual-hosted git repository.
tarmstrong pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit f4584dd2763edda9a24e4466b2d0a8f4bb065437
Author: Tim Armstrong <ta...@cloudera.com>
AuthorDate: Mon Jan 25 14:41:53 2021 -0800
IMPALA-10404: Update docs to reflect RLE_DICTIONARY support
Fix references to PLAIN_DICTIONARY to reflect that
RLE_DICTIONARY is supported too.
Change-Id: Iee98abfd760396cf43302c9077c6165eb3623335
Reviewed-on: http://gerrit.cloudera.org:8080/16982
Reviewed-by: Tim Armstrong <ta...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
docs/shared/impala_common.xml | 5 +++--
docs/topics/impala_parquet_dictionary_filtering.xml | 8 +++++---
2 files changed, 8 insertions(+), 5 deletions(-)
diff --git a/docs/shared/impala_common.xml b/docs/shared/impala_common.xml
index 6b0e812..f18ca00 100644
--- a/docs/shared/impala_common.xml
+++ b/docs/shared/impala_common.xml
@@ -3175,8 +3175,9 @@ flight_num: INT32 SNAPPY DO:83456393 FPO:83488603 SZ:10216514/11474301
<p id="impala_parquet_encodings_caveat">
Impala can query Parquet files that use the <codeph>PLAIN</codeph>,
- <codeph>PLAIN_DICTIONARY</codeph>, <codeph>BIT_PACKED</codeph>, and <codeph>RLE</codeph>
- encodings. Currently, Impala does not support <codeph>RLE_DICTIONARY</codeph> encoding.
+ <codeph>PLAIN_DICTIONARY</codeph>, <codeph>BIT_PACKED</codeph>, <codeph>RLE</codeph>
+ and <codeph>RLE_DICTIONARY</codeph> encodings. <codeph>RLE_DICTIONARY</codeph> is supported
+ only in <keyword keyref="impala40"/> and up.
When creating files outside of Impala for use by Impala, make sure to use one of the
supported encodings. In particular, for MapReduce jobs,
<codeph>parquet.writer.version</codeph> must not be defined (especially as
diff --git a/docs/topics/impala_parquet_dictionary_filtering.xml b/docs/topics/impala_parquet_dictionary_filtering.xml
index 3460f2a..2d68b4d 100644
--- a/docs/topics/impala_parquet_dictionary_filtering.xml
+++ b/docs/topics/impala_parquet_dictionary_filtering.xml
@@ -58,7 +58,8 @@ under the License.
<li>
If the <codeph>encoding_stats</codeph> is in the Parquet file, dictionary filtering
uses it to determine if there are only dictionary encoded pages (i.e. there are no
- data pages with an encoding other than PLAIN_DICTIONARY).
+ data pages with an encoding other than <codeph>RLE_DICTIONARY</codeph> or
+ <codeph>PLAIN_DICTIONARY</codeph>).
</li>
<li>
@@ -66,11 +67,12 @@ under the License.
The column is purely dictionary encoded if both of the conditions satisfy:
<ul>
<li>
- PLAIN_DICTIONARY is present.
+ <codeph>PLAIN_DICTIONARY</codeph> or <codeph>RLE_DICTIONARY</codeph> is present.
</li>
<li>
- Only PLAIN_DICTIONARY, RLE, or BIT_PACKED encodings are listed.
+ Only <codeph>PLAIN_DICTIONARY</codeph>, <codeph>RLE_DICTIONARY</codeph>,
+ <codeph>RLE</codeph>, or <codeph>BIT_PACKED</codeph> encodings are listed.
</li>
</ul>
</li>