You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2015/11/17 23:46:11 UTC
[jira] [Commented] (AMBARI-13918) Stack Upgrade: Kafka to call
migration script when upgrading across HDP 2.3.4.0
[ https://issues.apache.org/jira/browse/AMBARI-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15009754#comment-15009754 ]
Hudson commented on AMBARI-13918:
---------------------------------
FAILURE: Integrated in Ambari-branch-2.1 #881 (See [https://builds.apache.org/job/Ambari-branch-2.1/881/])
AMBARI-13918. Stack Upgrade: Kafka to call migration script when (afernandez: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=57aa02f5717bc1ab3aae173db5fce04238786851])
* ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/upgrade.py
* ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/kafka_broker.py
* ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py
* ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.3.xml
* ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/upgrade-2.3.xml
> Stack Upgrade: Kafka to call migration script when upgrading across HDP 2.3.4.0
> -------------------------------------------------------------------------------
>
> Key: AMBARI-13918
> URL: https://issues.apache.org/jira/browse/AMBARI-13918
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.2.0, 2.1.3
> Reporter: Alejandro Fernandez
> Assignee: Alejandro Fernandez
> Fix For: 2.2.0, 2.1.3
>
> Attachments: AMBARI-13918.trunk.patch
>
>
> In HDP 2.3.4.0, the the structure of stored acls for Kafka in zookeeper has changed. This means to support upgrade-to or downgrade-from HDP 2.3.4.0 we will have to move these stored acls to new format or vice versa.
> Ambari should make the following changes for upgrade/downgrade process of Kafka.
> PreReq: Install bits side-by-side
> Steps:
> 1) Stop all Kafka brokers
> 2) Call
> bin/kafka-acls.sh --authorizer kafka.security.auth.SimpleAclAuthorizer --authorizer-properties zookeeper.connect=localhost:2181 --upgradeAcls
> or
> bin/kafka-acls.sh --authorizer kafka.security.auth.SimpleAclAuthorizer --authorizer-properties zookeeper.connect=localhost:2181 --downgradeAcls
> 3) Start all Kafka brokers.
> Example Cases:
> 1) If upgrading from HDP 2.3.0.0 -> 2.3.2.0, we will still stop all Kafka brokers since cannot distinguish the version in the single upgrade pack. Customers may modify this behavior by editing upgrade-2.3.xml.
> Because the 2.3.4.0 boundary is not crossed, we should not call the migration script.
> 2) If upgrading from HDP 2.3.4.0->2.3.5.0, then we will stop all Kafka brokers and not call the migration script since not crossing the boundary.
> 3) If upgrading from HDP 2.3.2.0->2.3.5.0, then we will stop all Kafka brokers and call the migration script since crossing the boundary. On downgrade, we should call the migration script again.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)