Review Request 31212: Kafka & Spark service checks fail intermittently on kerberized cluster

[Alejandro Fernandez <af...@hortonworks.com>]

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31212/
-----------------------------------------------------------

Review request for Ambari, Dmitro Lisnichenko, Jonathan Hurley, Nate Cole, and Srimanth Gunturi.


Bugs: AMBARI-9717
    https://issues.apache.org/jira/browse/AMBARI-9717


Repository: ambari


Description
-------

Kafka and Spark service checks will fail intermittently.

Kafka runs a command to create a topic, which is expected to fail after being ran once, and then greps the output to make sure that the topic was created or already existed. The problem is that this will only work the first time, since it was not ignorring stderr. Instead, just call the command, and perform a regex match on the output.

Spark was not kiniting before doing its service check. I presume it worked sometimes if some credenetial had already been cached.


Diffs
-----

  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py 80b91b6 
  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/service_check.py b10b602 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py d00ae40 

Diff: https://reviews.apache.org/r/31212/diff/


Testing
-------

Deployed a 3-node cluster with HDFS, Yarn, MR, TEZ, ZK, Ranger, Kafka, and Spark, then added Namenode HA, Kerberized the cluster, and performed an RU.

Unit tests are in progress.


Thanks,

Alejandro Fernandez