You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kudu.apache.org by jd...@apache.org on 2018/01/18 23:35:25 UTC
[1/3] kudu git commit: [docs] Added steps to update HMS after
migrating to multiple Kudu masters
Repository: kudu
Updated Branches:
refs/heads/master 918db2d66 -> 31a720fc3
[docs] Added steps to update HMS after migrating to multiple Kudu masters
Change-Id: Iab3999c9e581ed3591b220c08491cdae867c91db
Reviewed-on: http://gerrit.cloudera.org:8080/8948
Reviewed-by: Jean-Daniel Cryans <jd...@apache.org>
Tested-by: Jean-Daniel Cryans <jd...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/ee58617c
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/ee58617c
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/ee58617c
Branch: refs/heads/master
Commit: ee58617c0cfd56340bbd6e4751ae82b9e441ca30
Parents: 918db2d
Author: Alex Rodoni <ar...@cloudera.com>
Authored: Thu Jan 4 15:44:31 2018 -0800
Committer: Jean-Daniel Cryans <jd...@apache.org>
Committed: Thu Jan 18 23:33:20 2018 +0000
----------------------------------------------------------------------
docs/administration.adoc | 36 ++++++++++++++++++++++++++++++++++++
1 file changed, 36 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kudu/blob/ee58617c/docs/administration.adoc
----------------------------------------------------------------------
diff --git a/docs/administration.adoc b/docs/administration.adoc
index 71d957f..b8f6361 100644
--- a/docs/administration.adoc
+++ b/docs/administration.adoc
@@ -258,6 +258,21 @@ $ kudu fs dump uuid --fs_wal_dir=/var/lib/kudu/master 2>/dev/null
WARNING: Without DNS aliases it is not possible to recover from permanent master failures without
bringing the cluster down for maintenance, and as such, it is highly recommended.
+
+. If you have Kudu tables that are accessed from Impala, you must update
+the master addresses in the Apache Hive Metastore (HMS) database.
+* If you set up the DNS aliases, run the following statement in `impala-shell`,
+replacing `master-1`, `master-2`, and `master-3` with your actual aliases.
++
+[source,sql]
+----
+ALTER TABLE table_name
+SET TBLPROPERTIES
+('kudu.master_addresses' = 'master-1,master-2,master-3');
+----
++
+* If you do not have DNS aliases set up, see Step #11 in the Performing
+the migration section for updating HMS.
++
. Perform the following preparatory steps for each new master:
* Choose an unused machine in the cluster. The master generates very little load so it can be
colocated with other data services or load-generating processes, though not with another Kudu
@@ -361,6 +376,27 @@ hostname:: master's previously recorded hostname or alias
port:: master's previously recorded RPC port number
. Start all of the tablet servers.
+. If you have Kudu tables that are accessed from Impala and you didn't set up
+DNS aliases, update the HMS database manually in the underlying database that
+provides the storage for HMS.
+* The following is an example SQL statement you should run in the HMS database:
++
+[source,sql]
+----
+UPDATE TABLE_PARAMS
+SET PARAM_VALUE =
+ 'master-1.example.com,master-2.example.com,master-3.example.com'
+WHERE PARAM_KEY = 'kudu.master_addresses' AND PARAM_VALUE = 'old-master';
+----
++
+* In `impala-shell`, run:
++
+[source,bash]
+----
+INVALIDATE METADATA;
+----
++
+
Congratulations, the cluster has now been migrated to multiple masters! To verify that all masters
are working properly, consider performing the following sanity checks:
[3/3] kudu git commit: [docs] Removed the note about KUDU-1626
Posted by jd...@apache.org.
[docs] Removed the note about KUDU-1626
Change-Id: Ia7b5e127cd9d1e2bda60a20de62fafd95e5f93e3
Reviewed-on: http://gerrit.cloudera.org:8080/9020
Tested-by: Kudu Jenkins
Reviewed-by: Jean-Daniel Cryans <jd...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/31a720fc
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/31a720fc
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/31a720fc
Branch: refs/heads/master
Commit: 31a720fc3a84d09204e46a5dae42e968a4730f7c
Parents: 81be8c4
Author: Alex Rodoni <ar...@cloudera.com>
Authored: Fri Jan 12 13:45:04 2018 -0800
Committer: Jean-Daniel Cryans <jd...@apache.org>
Committed: Thu Jan 18 23:34:54 2018 +0000
----------------------------------------------------------------------
docs/schema_design.adoc | 5 -----
1 file changed, 5 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kudu/blob/31a720fc/docs/schema_design.adoc
----------------------------------------------------------------------
diff --git a/docs/schema_design.adoc b/docs/schema_design.adoc
index 9764239..c5407a6 100644
--- a/docs/schema_design.adoc
+++ b/docs/schema_design.adoc
@@ -442,11 +442,6 @@ You can alter a table's schema in the following ways:
Multiple alteration steps can be combined in a single transactional operation.
-[IMPORTANT]
-.Renaming Primary Key Columns
-https://issues.apache.org/jira/browse/KUDU-1626[KUDU-1626]: Kudu does not yet
-support renaming primary key columns.
-
[[known-limitations]]
== Known Limitations
[2/3] kudu git commit: [docs] Added a section for Kudu clients
connecting to secure clusters
Posted by jd...@apache.org.
[docs] Added a section for Kudu clients connecting to secure clusters
Change-Id: Iabee52216b4db0e18e5f693375f0a3e0f0a8a164
Reviewed-on: http://gerrit.cloudera.org:8080/8953
Tested-by: Kudu Jenkins
Reviewed-by: Jean-Daniel Cryans <jd...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/kudu/repo
Commit: http://git-wip-us.apache.org/repos/asf/kudu/commit/81be8c45
Tree: http://git-wip-us.apache.org/repos/asf/kudu/tree/81be8c45
Diff: http://git-wip-us.apache.org/repos/asf/kudu/diff/81be8c45
Branch: refs/heads/master
Commit: 81be8c45bc8d77ae69a822f361fa08124f777a65
Parents: ee58617
Author: Alex Rodoni <ar...@cloudera.com>
Authored: Fri Jan 5 12:47:26 2018 -0800
Committer: Jean-Daniel Cryans <jd...@apache.org>
Committed: Thu Jan 18 23:34:20 2018 +0000
----------------------------------------------------------------------
docs/security.adoc | 13 +++++++++++++
1 file changed, 13 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kudu/blob/81be8c45/docs/security.adoc
----------------------------------------------------------------------
diff --git a/docs/security.adoc b/docs/security.adoc
index 449106d..85ae261 100644
--- a/docs/security.adoc
+++ b/docs/security.adoc
@@ -99,6 +99,19 @@ planning stage, and distribute the token to tasks. This allows Spark to work
against a secured Kudu cluster where only the planner node has Kerberos
credentials.
+=== Client Authentication to Secure Kudu Clusters
+
+Users running client Kudu applications must first run the `kinit` command to
+obtain a Kerberos ticket-granting ticket. For example:
+
+[source,bash]
+----
+$ kinit admin@EXAMPLE-REALM.COM
+----
+
+Once authenticated, you use the same client code to read from and write to Kudu
+servers with and without Kerberos configuration.
+
== Scalability
Kudu authentication is designed to scale to thousands of nodes, which requires