You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@livy.apache.org by GitBox <gi...@apache.org> on 2020/06/16 07:28:15 UTC

[GitHub] [incubator-livy] lukatera commented on pull request #249: [LIVY-702]: Submit Spark apps to Kubernetes

lukatera commented on pull request #249:
URL: https://github.com/apache/incubator-livy/pull/249#issuecomment-644585957


   I had some issues with using ZooKeeper as a recovery method. When one of the zookeepers is not up in Kubernetes, its address is not published (i.e. there is none), and thus Livy cannot determine the zookeeper host. With the current version of ZooKeeper, Livy crashes because of a bug in ZooKeeper client. This has been fixed though in more recent versions (3.5.2+): [ZOOKEEPER-1576](https://zookeeper.apache.org/doc/r3.5.2-alpha/releasenotes.html).
   
   In short, Livy cannot start if 2 out of 3 ZooKeepers are up at the moment, even though it should be able to do so. Bumping the ZooKeeper client version should resolve the issue.
   
   @jahstreet Can we update ZooKeeper version in this PR as well?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org