You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@livy.apache.org by John Pugliesi <jo...@viaduct.ai> on 2020/06/16 23:18:22 UTC

How to Configure Livy Server's spark.yarn.dist.archives

Hello,

I'm running Livy 0.6.

Is it possible to configure a Livy server with additional spark
configuration for the property *spark.yarn.dist.archives* ? Livy currently
does not respect this property even when it's specified in
spark-defaults.conf, due to this code block.
<https://github.com/apache/incubator-livy/blob/b8251eb9b3d63c77c61a5950dee5958b654d9633/rsc/src/main/java/org/apache/livy/rsc/ContextLauncher.java#L295-L301>


Are there other ways to set this configuration on the livy server? Or does
_every_ livy client need to specify *archives* in their create session
request?

Thanks for your help,

John