You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by jr...@apache.org on 2018/01/12 20:13:05 UTC

[1/2] impala git commit: IMPALA-6387: Increase wait for Breakpad crash handling

Repository: impala
Updated Branches:
  refs/heads/master 5842c8406 -> e0c993003


IMPALA-6387: Increase wait for Breakpad crash handling

It seems that a recent slowdown of our test infrastructure might have
caused Breakpad to take a longer time to write Minidumps. There could
also be a more fundamental issue leading to hangs. To rule this out,
this change increases the default timeout to something larger to allow
the tests to complete.

Change-Id: I84742be9af9444607fde4baf8ea1c0092ff181fe
Reviewed-on: http://gerrit.cloudera.org:8080/9018
Tested-by: Lars Volker <lv...@cloudera.com>
Reviewed-by: Tim Armstrong <ta...@cloudera.com>


Project: http://git-wip-us.apache.org/repos/asf/impala/repo
Commit: http://git-wip-us.apache.org/repos/asf/impala/commit/6dc7237f
Tree: http://git-wip-us.apache.org/repos/asf/impala/tree/6dc7237f
Diff: http://git-wip-us.apache.org/repos/asf/impala/diff/6dc7237f

Branch: refs/heads/master
Commit: 6dc7237fc128ae52e85ef9fdd887a1ab4eb2a465
Parents: 5842c84
Author: Lars Volker <lv...@cloudera.com>
Authored: Thu Jan 11 10:14:04 2018 -0800
Committer: Lars Volker <lv...@cloudera.com>
Committed: Fri Jan 12 17:22:56 2018 +0000

----------------------------------------------------------------------
 tests/custom_cluster/test_breakpad.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/impala/blob/6dc7237f/tests/custom_cluster/test_breakpad.py
----------------------------------------------------------------------
diff --git a/tests/custom_cluster/test_breakpad.py b/tests/custom_cluster/test_breakpad.py
index c9fa79c..a6e85ba 100644
--- a/tests/custom_cluster/test_breakpad.py
+++ b/tests/custom_cluster/test_breakpad.py
@@ -107,7 +107,7 @@ class TestBreakpadBase(CustomClusterTestSuite):
       return self.cluster.statestored and 1 or 0
     raise RuntimeError("Unknown daemon name: %s" % daemon)
 
-  def wait_for_num_processes(self, daemon, num_expected, timeout=5):
+  def wait_for_num_processes(self, daemon, num_expected, timeout=30):
     end = time.time() + timeout
     self.cluster.refresh()
     num_processes = self.get_num_processes(daemon)


[2/2] impala git commit: IMPALA-2181: [DOCS] Document changes to SET output

Posted by jr...@apache.org.
IMPALA-2181: [DOCS] Document changes to SET output

Change-Id: Iade7cb326715ebbb8518230d518d05601d615f61
Reviewed-on: http://gerrit.cloudera.org:8080/8865
Reviewed-by: John Russell <jr...@cloudera.com>
Tested-by: Impala Public Jenkins


Project: http://git-wip-us.apache.org/repos/asf/impala/repo
Commit: http://git-wip-us.apache.org/repos/asf/impala/commit/e0c99300
Tree: http://git-wip-us.apache.org/repos/asf/impala/tree/e0c99300
Diff: http://git-wip-us.apache.org/repos/asf/impala/diff/e0c99300

Branch: refs/heads/master
Commit: e0c99300372a04e23d30cb08eb7a998b2d9019ce
Parents: 6dc7237
Author: John Russell <jr...@cloudera.com>
Authored: Mon Dec 18 13:02:52 2017 -0800
Committer: Impala Public Jenkins <im...@gerrit.cloudera.org>
Committed: Fri Jan 12 20:11:20 2018 +0000

----------------------------------------------------------------------
 docs/topics/impala_set.xml | 87 ++++++++++++++++++++++++++++++++++++-----
 1 file changed, 78 insertions(+), 9 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/impala/blob/e0c99300/docs/topics/impala_set.xml
----------------------------------------------------------------------
diff --git a/docs/topics/impala_set.xml b/docs/topics/impala_set.xml
index c3efd90..598fc4b 100644
--- a/docs/topics/impala_set.xml
+++ b/docs/topics/impala_set.xml
@@ -49,14 +49,64 @@ under the License.
       not with queries submitted through JDBC or ODBC.
     </p>
 
+    <note type="important" rev="2.11.0 IMPALA-2181">
+      <p>
+        In <keyword keyref="impala211_full"/> and higher, the output of the <codeph>SET</codeph>
+        statement changes in some important ways:
+      </p>
+      <ul>
+        <li>
+          <p>
+            The options are divided into groups: <codeph>Regular Query Options</codeph>,
+            <codeph>Advanced Query Options</codeph>, <codeph>Development Query Options</codeph>, and
+            <codeph>Deprecated Query Options</codeph>.
+          </p>
+        </li>
+        <li>
+          <p>
+            The advanced options are intended for use in specific
+            kinds of performance tuning and debugging scenarios. The development options are
+            related to internal development of Impala or features that are not yet finalized;
+            these options might be changed or removed without notice.
+            The deprecated options are related to features that are removed or changed so that
+            the options no longer have any purpose; these options might be removed in future
+            versions.
+          </p>
+        </li>
+        <li>
+          <p>
+            By default, only the first two groups (regular and advanced) are
+            displayed by the <codeph>SET</codeph> command. Use the syntax <codeph>SET ALL</codeph>
+            to see all groups of options.
+          </p>
+        </li>
+        <li>
+          <p>
+            <cmdname>impala-shell</cmdname> options and user-specified variables are always displayed
+            at the end of the list of query options, after all appropriate option groups.
+          </p>
+        </li>
+        <li>
+          <p>
+            When the <codeph>SET</codeph> command is run through the JDBC or ODBC interfaces,
+            the result set has a new third column, <codeph>level</codeph>, indicating which
+            group each option belongs to. The same distinction of <codeph>SET</codeph>
+            returning the regular and advanced options, and <codeph>SET ALL</codeph>
+            returning all option groups, applies to JDBC and ODBC also.
+          </p>
+        </li>
+      </ul>
+    </note>
+
     <p conref="../shared/impala_common.xml#common/syntax_blurb"/>
 
 <codeblock>SET [<varname>query_option</varname>=<varname>option_value</varname>]
+<ph rev="2.11.0 IMPALA-2181">SET ALL</ph>
 </codeblock>
 
-    <p>
-      <codeph>SET</codeph> with no arguments returns a result set consisting of all available query options and
-      their current values.
+    <p rev="2.11.0 IMPALA-2181">
+      <codeph>SET</codeph> and <codeph>SET ALL</codeph> with no arguments return a
+      result set consisting of all the applicable query options and their current values.
     </p>
 
     <p>
@@ -131,17 +181,36 @@ Query: select s from production_table order by s limit 3
 </codeblock>
 
     <p rev="2.5.0 IMPALA-2180">
-      The following example shows how <codeph>SET</codeph> with no parameters displays
+      The following example shows how <codeph>SET ALL</codeph> with no parameters displays
       all user-specified substitution variables, and how <codeph>UNSET</codeph> removes
       the substitution variable entirely:
     </p>
 
-<codeblock rev="2.5.0 IMPALA-2180">
-[localhost:21000] > set;
+<codeblock rev="2.11.0 IMPALA-2181">
+[localhost:21000] > set all;
 Query options (defaults shown in []):
-  ABORT_ON_DEFAULT_LIMIT_EXCEEDED: [0]
-  ...
-  V_CPU_CORES: [0]
+ABORT_ON_ERROR: [0]
+COMPRESSION_CODEC: []
+DISABLE_CODEGEN: [0]
+...
+
+Advanced Query Options:
+APPX_COUNT_DISTINCT: [0]
+BUFFER_POOL_LIMIT: []
+DEFAULT_JOIN_DISTRIBUTION_MODE: [0]
+...
+
+Development Query Options:
+BATCH_SIZE: [0]
+DEBUG_ACTION: []
+DECIMAL_V2: [0]
+...
+
+Deprecated Query Options:
+ABORT_ON_DEFAULT_LIMIT_EXCEEDED: [0]
+ALLOW_UNSUPPORTED_FORMATS: [0]
+DEFAULT_ORDER_BY_LIMIT: [-1]
+...
 
 Shell Options
   LIVE_PROGRESS: False