You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Vladimir Prus <vl...@gmail.com> on 2021/02/10 14:44:33 UTC
Kubernetes and interpreter dependencies
Hi,
I was experimenting with Zeppelin + Spark in K8S, and everything worked
fine, but now I'm also trying to configure jdbc interpreter that needs a
custom jar with JDBC driver. Previously, I'd just specify interpreter
dependencies and it worked. In K8S, I observe that
- The pod with zeppelin server downloads the dependency to
/zeppelin/local-repo
- The pod with jdbc interpreter is merely started with zeppelin image, so
can't find those jars
Am I misconfiguring something? Are there alternative approaches to
accomplish this?
--
Vladimir Prus
http://vladimirprus.com
Re: Kubernetes and interpreter dependencies
Posted by Philipp Dallig <ph...@gmail.com>.
Hello Vladimir,
we have a JIRA ticket for this problem. I hope it will help you to solve
your problem.
https://issues.apache.org/jira/browse/ZEPPELIN-4983
Best regards
Philipp
Am 10.02.21 um 17:48 schrieb Vladimir Prus:
> Hi Jeff,
>
> thanks for the answer. Copying the relevant jars to the docker image
> does indeed allow me to get JDBC/Athena queries to work, thanks!
>
> On Wed, Feb 10, 2021 at 6:13 PM Jeff Zhang <zjffdu@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi Vladimir,
>
> That's right, the dependencies download mechanism won't work for
> k8s. Because when introducing this feature, K8s is not considered.
> I think we need to fix it.
>
> For now, you can just download them by yourself and put them in
> the docker image to make it work in k8s.
>
>
>
>
> Vladimir Prus <vladimir.prus@gmail.com
> <ma...@gmail.com>> 于2021年2月10日周三 下午10:44写道：
>
>
> Hi,
>
> I was experimenting with Zeppelin + Spark in K8S, and
> everything worked fine, but now I'm also trying to configure
> jdbc interpreter that needs a custom jar with JDBC driver.
> Previously, I'd just specify interpreter dependencies and it
> worked. In K8S, I observe that
> - The pod with zeppelin server downloads the dependency to
> /zeppelin/local-repo
> - The pod with jdbc interpreter is merely started with
> zeppelin image, so can't find those jars
>
> Am I misconfiguring something? Are there alternative
> approaches to accomplish this?
>
> --
> Vladimir Prus
> http://vladimirprus.com
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
>
>
> --
> Vladimir Prus
> http://vladimirprus.com
Re: Kubernetes and interpreter dependencies
Posted by Vladimir Prus <vl...@gmail.com>.
Hi Jeff,
thanks for the answer. Copying the relevant jars to the docker image does
indeed allow me to get JDBC/Athena queries to work, thanks!
On Wed, Feb 10, 2021 at 6:13 PM Jeff Zhang <zj...@gmail.com> wrote:
> Hi Vladimir,
>
> That's right, the dependencies download mechanism won't work for k8s.
> Because when introducing this feature, K8s is not considered. I think we
> need to fix it.
>
> For now, you can just download them by yourself and put them in the
> docker image to make it work in k8s.
>
>
>
>
> Vladimir Prus <vl...@gmail.com> 于2021年2月10日周三 下午10:44写道：
>
>>
>> Hi,
>>
>> I was experimenting with Zeppelin + Spark in K8S, and everything worked
>> fine, but now I'm also trying to configure jdbc interpreter that needs a
>> custom jar with JDBC driver. Previously, I'd just specify interpreter
>> dependencies and it worked. In K8S, I observe that
>> - The pod with zeppelin server downloads the dependency to
>> /zeppelin/local-repo
>> - The pod with jdbc interpreter is merely started with zeppelin image, so
>> can't find those jars
>>
>> Am I misconfiguring something? Are there alternative approaches to
>> accomplish this?
>>
>> --
>> Vladimir Prus
>> http://vladimirprus.com
>>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
--
Vladimir Prus
http://vladimirprus.com
Re: Kubernetes and interpreter dependencies
Posted by Jeff Zhang <zj...@gmail.com>.
Hi Vladimir,
That's right, the dependencies download mechanism won't work for k8s.
Because when introducing this feature, K8s is not considered. I think we
need to fix it.
For now, you can just download them by yourself and put them in the docker
image to make it work in k8s.
Vladimir Prus <vl...@gmail.com> 于2021年2月10日周三 下午10:44写道：
>
> Hi,
>
> I was experimenting with Zeppelin + Spark in K8S, and everything worked
> fine, but now I'm also trying to configure jdbc interpreter that needs a
> custom jar with JDBC driver. Previously, I'd just specify interpreter
> dependencies and it worked. In K8S, I observe that
> - The pod with zeppelin server downloads the dependency to
> /zeppelin/local-repo
> - The pod with jdbc interpreter is merely started with zeppelin image, so
> can't find those jars
>
> Am I misconfiguring something? Are there alternative approaches to
> accomplish this?
>
> --
> Vladimir Prus
> http://vladimirprus.com
>
--
Best Regards
Jeff Zhang