You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Kaidi Zhao (Jira)" <ji...@apache.org> on 2021/02/18 04:31:00 UTC

[jira] [Updated] (LIVY-807) Livy can't pick up local jar files when using "jars"

     [ https://issues.apache.org/jira/browse/LIVY-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kaidi Zhao updated LIVY-807:
----------------------------
    Description: 
This could be more explicit in our document, that when doing rest post such as the ones mentioned here: [https://livy.apache.org/docs/latest/rest-api.html,] the "jars" parameter only works for jar files in hdfs, Livy server local host, cluster worker nodes. It won't work if the dependency jar is located at end user's local host (which is not the Livy server host, no cluster). 

ps, if anyone can explain why this is the decision (that don't allow users to submit jobs with their local jar files), that will be great. 

We are using SparkMagic to talk to Livy, by the way.

 

Thanks

  was:
This could be more explicit in our document, that when doing rest post such as the ones mentioned here: [https://livy.apache.org/docs/latest/rest-api.html,] the "jars" parameter only works for jar files in hdfs, Livy server local host, cluster worker nodes. It won't work if the dependency jar is located at end user's local host (which is not the Livy server host, no cluster). 

ps, if anyone can explain why this is the decision (that don't allow users to submit jobs with their local jar files), that will be great. 

Thanks


> Livy can't pick up local jar files when using "jars"
> ----------------------------------------------------
>
>                 Key: LIVY-807
>                 URL: https://issues.apache.org/jira/browse/LIVY-807
>             Project: Livy
>          Issue Type: Bug
>          Components: Docs
>    Affects Versions: 0.7.0
>            Reporter: Kaidi Zhao
>            Priority: Major
>
> This could be more explicit in our document, that when doing rest post such as the ones mentioned here: [https://livy.apache.org/docs/latest/rest-api.html,] the "jars" parameter only works for jar files in hdfs, Livy server local host, cluster worker nodes. It won't work if the dependency jar is located at end user's local host (which is not the Livy server host, no cluster). 
> ps, if anyone can explain why this is the decision (that don't allow users to submit jobs with their local jar files), that will be great. 
> We are using SparkMagic to talk to Livy, by the way.
>  
> Thanks



--
This message was sent by Atlassian Jira
(v8.3.4#803005)