You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by jr...@apache.org on 2017/07/07 06:16:24 UTC
[1/2] incubator-impala git commit: IMPALA-4431: [DOCS] Document
max_audit_event_log_files startup option
Repository: incubator-impala
Updated Branches:
refs/heads/master 924066a4f -> bc1feb34d
IMPALA-4431: [DOCS] Document max_audit_event_log_files startup option
Change-Id: I6777624e2139fdc062efaa778063e89e7d6d5772
Reviewed-on: http://gerrit.cloudera.org:8080/7369
Reviewed-by: Tim Armstrong <ta...@cloudera.com>
Tested-by: Impala Public Jenkins
Project: http://git-wip-us.apache.org/repos/asf/incubator-impala/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-impala/commit/da893308
Tree: http://git-wip-us.apache.org/repos/asf/incubator-impala/tree/da893308
Diff: http://git-wip-us.apache.org/repos/asf/incubator-impala/diff/da893308
Branch: refs/heads/master
Commit: da89330823f7559a57a68338fdf34c055c84d2fc
Parents: 924066a
Author: John Russell <jr...@cloudera.com>
Authored: Thu Jul 6 16:46:29 2017 -0700
Committer: Impala Public Jenkins <im...@gerrit.cloudera.org>
Committed: Fri Jul 7 05:48:21 2017 +0000
----------------------------------------------------------------------
docs/topics/impala_auditing.xml | 16 +++++++++++++---
docs/topics/impala_logging.xml | 12 ++++++++++--
2 files changed, 23 insertions(+), 5 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/da893308/docs/topics/impala_auditing.xml
----------------------------------------------------------------------
diff --git a/docs/topics/impala_auditing.xml b/docs/topics/impala_auditing.xml
index ae64c5e..10d9268 100644
--- a/docs/topics/impala_auditing.xml
+++ b/docs/topics/impala_auditing.xml
@@ -52,13 +52,23 @@ under the License.
</li>
<li>
- Decide how many queries will be represented in each log file. By default,
- Impala starts a new log file every 5000 queries. To specify a different number,
+ Decide how many queries will be represented in each audit event log file. By default,
+ Impala starts a new audit event log file every 5000 queries. To specify a different number,
<ph audience="standalone">include
- the option <codeph>-max_audit_event_log_file_size=<varname>number_of_queries</varname></codeph>
+ the option <codeph>--max_audit_event_log_file_size=<varname>number_of_queries</varname></codeph>
in the <cmdname>impalad</cmdname> startup options</ph>.
</li>
+ <li rev="2.9.0 IMPALA-4431">
+ In <keyword keyref="impala29_full"/> and higher, you can control how many
+ audit event log files are kept on each host. Specify the option
+ <codeph>--max_audit_event_log_files=<varname>number_of_log_files</varname></codeph>
+ in the <cmdname>impalad</cmdname> startup options. Once the limit is reached, older
+ files are rotated out using the same mechanism as for other Impala log files.
+ The default value for this setting is 0, representing an unlimited number of audit
+ event log files.
+ </li>
+
<li>
Use a cluster manager with governance capabilities to filter, visualize,
and produce reports based on the audit logs collected
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/da893308/docs/topics/impala_logging.xml
----------------------------------------------------------------------
diff --git a/docs/topics/impala_logging.xml b/docs/topics/impala_logging.xml
index 5238e8b..1d7e762 100644
--- a/docs/topics/impala_logging.xml
+++ b/docs/topics/impala_logging.xml
@@ -70,6 +70,14 @@ under the License.
enabled. See <xref href="impala_auditing.xml#auditing"/> for details.
</p>
+ <p rev="2.9.0 IMPALA-4431">
+ In <keyword keyref="impala29_full"/> and higher, you can control how many
+ audit event log files are kept on each host through the
+ <codeph>--max_audit_event_log_files</codeph> startup option for the
+ <cmdname>impalad</cmdname> daemon, similar to the <codeph>--max_log_files</codeph>
+ option for regular log files.
+ </p>
+
<p rev="2.2.0">
The lineage feature introduced in Impala 2.2.0 produces a separate lineage log file when
enabled. See <xref href="impala_lineage.xml#lineage"/> for details.
@@ -159,7 +167,7 @@ under the License.
</li>
<li>
- The <codeph>-logbuflevel</codeph> startup flag for the <cmdname>impalad</cmdname> daemon specifies how
+ The <codeph>--logbuflevel</codeph> startup flag for the <cmdname>impalad</cmdname> daemon specifies how
often the log information is written to disk. The default is 0, meaning that the log is immediately
flushed to disk when Impala outputs an important messages such as a warning or an error, but less
important messages such as informational ones are buffered in memory rather than being flushed to disk
@@ -215,7 +223,7 @@ under the License.
</p>
<p>
- In Impala 2.2 and higher, the <codeph>-max_log_files</codeph> configuration option specifies how many log
+ In Impala 2.2 and higher, the <codeph>--max_log_files</codeph> configuration option specifies how many log
files to keep at each severity level. You can specify an appropriate setting for each Impala-related daemon
(<cmdname>impalad</cmdname>, <cmdname>statestored</cmdname>, and <cmdname>catalogd</cmdname>). The default
value is 10, meaning that Impala preserves the latest 10 log files for each severity level
[2/2] incubator-impala git commit: IMPALA-5030: [DOCS] Document
nvl2() function
Posted by jr...@apache.org.
IMPALA-5030: [DOCS] Document nvl2() function
Change-Id: I8497e69d0f6db3c5e17b04e49a875c3efb43fab0
Reviewed-on: http://gerrit.cloudera.org:8080/7365
Reviewed-by: Tim Armstrong <ta...@cloudera.com>
Tested-by: Impala Public Jenkins
Project: http://git-wip-us.apache.org/repos/asf/incubator-impala/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-impala/commit/bc1feb34
Tree: http://git-wip-us.apache.org/repos/asf/incubator-impala/tree/bc1feb34
Diff: http://git-wip-us.apache.org/repos/asf/incubator-impala/diff/bc1feb34
Branch: refs/heads/master
Commit: bc1feb34d0df37d38b6c718d65d654637e9bb525
Parents: da89330
Author: John Russell <jr...@cloudera.com>
Authored: Thu Jul 6 14:40:41 2017 -0700
Committer: Impala Public Jenkins <im...@gerrit.cloudera.org>
Committed: Fri Jul 7 05:50:47 2017 +0000
----------------------------------------------------------------------
docs/shared/impala_common.xml | 6 +++
docs/topics/impala_conditional_functions.xml | 50 +++++++++++++++++++++++
docs/topics/impala_string_functions.xml | 1 +
3 files changed, 57 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/bc1feb34/docs/shared/impala_common.xml
----------------------------------------------------------------------
diff --git a/docs/shared/impala_common.xml b/docs/shared/impala_common.xml
index 4522c9b..8a10c9f 100644
--- a/docs/shared/impala_common.xml
+++ b/docs/shared/impala_common.xml
@@ -2457,6 +2457,12 @@ flight_num: INT32 SNAPPY DO:83456393 FPO:83488603 SZ:10216514/11474301
each value.
</p>
+ <p rev="2.9.0" id="added_in_290">
+ <b>Added in:</b> <keyword keyref="impala290"/>
+ </p>
+ <p rev="2.8.0" id="added_in_280">
+ <b>Added in:</b> <keyword keyref="impala280"/>
+ </p>
<p rev="2.7.0" id="added_in_270">
<b>Added in:</b> <keyword keyref="impala270"/>
</p>
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/bc1feb34/docs/topics/impala_conditional_functions.xml
----------------------------------------------------------------------
diff --git a/docs/topics/impala_conditional_functions.xml b/docs/topics/impala_conditional_functions.xml
index 9006a54..889294e 100644
--- a/docs/topics/impala_conditional_functions.xml
+++ b/docs/topics/impala_conditional_functions.xml
@@ -436,6 +436,56 @@ END</codeblock>
</dlentry>
+ <dlentry id="nvl2" rev="2.9.0 IMPALA-5030">
+
+ <dt>
+ <codeph>nvl2(type a, type ifNull, type ifNotNull)</codeph>
+ </dt>
+
+ <dd>
+ <indexterm audience="hidden">nvl2() function</indexterm>
+ <b>Purpose:</b> Enhanced variant of the <codeph>nvl()</codeph> function. Tests an expression
+ and returns different result values depending on whether it is <codeph>NULL</codeph> or not.
+ If the first argument is <codeph>NULL</codeph>, returns the second argument.
+ If the first argument is not <codeph>NULL</codeph>, returns the third argument.
+ Equivalent to the <codeph>nvl2()</codeph> function from Oracle Database.
+ <p>
+ <b>Return type:</b> Same as the first argument value
+ </p>
+ <p conref="../shared/impala_common.xml#common/added_in_290"/>
+ <p conref="../shared/impala_common.xml#common/example_blurb"/>
+ <p>
+ The following examples show how a query can use special indicator values
+ to represent null and not-null expression values. The first example tests
+ an <codeph>INT</codeph> column and so uses special integer values.
+ The second example tests a <codeph>STRING</codeph> column and so uses
+ special string values.
+ </p>
+<codeblock>
+select x, nvl2(x, 999, 0) from nvl2_demo;
++------+---------------------------+
+| x | if(x is not null, 999, 0) |
++------+---------------------------+
+| NULL | 0 |
+| 1 | 999 |
+| NULL | 0 |
+| 2 | 999 |
++------+---------------------------+
+
+select s, nvl2(s, 'is not null', 'is null') from nvl2_demo;
++------+---------------------------------------------+
+| s | if(s is not null, 'is not null', 'is null') |
++------+---------------------------------------------+
+| NULL | is null |
+| one | is not null |
+| NULL | is null |
+| two | is not null |
++------+---------------------------------------------+
+</codeblock>
+ </dd>
+
+ </dlentry>
+
<dlentry rev="1.3.0" id="zeroifnull">
<dt>
http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/bc1feb34/docs/topics/impala_string_functions.xml
----------------------------------------------------------------------
diff --git a/docs/topics/impala_string_functions.xml b/docs/topics/impala_string_functions.xml
index 60b28fc..5758c52 100644
--- a/docs/topics/impala_string_functions.xml
+++ b/docs/topics/impala_string_functions.xml
@@ -874,6 +874,7 @@ Returned 1 row(s) in 0.12s</codeblock>
string, the expansion is only performed once, instead of
applying again to the newly constructed string.
</p>
+ <p conref="../shared/impala_common.xml#common/added_in_290"/>
<p conref="../shared/impala_common.xml#common/example_blurb"/>
<codeblock>-- Replace one string with another.
select replace('hello world','world','earth');