You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Great Info <gu...@gmail.com> on 2021/03/30 07:57:34 UTC
Zeppelin at scale
I see zeppelin does not have cluster deployment support.
Is there any work to support zeppelin access to multiple users.
Kindly share some links/guides if there is already discussion/solution
around this.
A simple use case, many users(Atleast 1k users) want to access sql
interpreter(jdbc postgres) write show read queries and select some
aggregation on the result then chart it.
Thanks,
gub
Re: Zeppelin at scale
Posted by Jeff Zhang <zj...@gmail.com>.
I don't think anyone has that scale of usage (1k users) of Zeppelin for
now. It is interesting to know your usage scenario.
Carlos Diogo <cd...@gmail.com> 于2021年4月1日周四 上午1:56写道：
> Hi
> My two cents . The only way I know to scale this would be with a container
> based deployment like open shift . You would have isolation per user which
> makes each user process run in its own pod .
> In addition you could setup multiple zeppelin servers ( on the above
> mention way) and then have a load balancer in the middle ( Nginx for
> instance )
> You can have a common notebook repository such as S3 or an NFS share
> Finally , if you want to enable scheduling you would need to ensure that
> only one of the servers have the scheduling enabled so that the jobs only
> run in one instance .
> Hope it helps
> Carlos
>
> On Tue 30. Mar 2021 at 11:57, Great Info <gu...@gmail.com> wrote:
>
>> I see zeppelin does not have cluster deployment support.
>> Is there any work to support zeppelin access to multiple users.
>> Kindly share some links/guides if there is already discussion/solution
>> around this.
>>
>> A simple use case, many users(Atleast 1k users) want to access sql
>> interpreter(jdbc postgres) write show read queries and select some
>> aggregation on the result then chart it.
>>
>> Thanks,
>> gub
>>
> --
> Os meus cumprimentos / Best regards / Mit freundlichen Grüße
> Carlos Diogo
>
--
Best Regards
Jeff Zhang
Re: Zeppelin at scale
Posted by Jeff Zhang <zj...@gmail.com>.
I don't think anyone has that scale of usage (1k users) of Zeppelin for
now. It is interesting to know your usage scenario.
Carlos Diogo <cd...@gmail.com> 于2021年4月1日周四 上午1:56写道：
> Hi
> My two cents . The only way I know to scale this would be with a container
> based deployment like open shift . You would have isolation per user which
> makes each user process run in its own pod .
> In addition you could setup multiple zeppelin servers ( on the above
> mention way) and then have a load balancer in the middle ( Nginx for
> instance )
> You can have a common notebook repository such as S3 or an NFS share
> Finally , if you want to enable scheduling you would need to ensure that
> only one of the servers have the scheduling enabled so that the jobs only
> run in one instance .
> Hope it helps
> Carlos
>
> On Tue 30. Mar 2021 at 11:57, Great Info <gu...@gmail.com> wrote:
>
>> I see zeppelin does not have cluster deployment support.
>> Is there any work to support zeppelin access to multiple users.
>> Kindly share some links/guides if there is already discussion/solution
>> around this.
>>
>> A simple use case, many users(Atleast 1k users) want to access sql
>> interpreter(jdbc postgres) write show read queries and select some
>> aggregation on the result then chart it.
>>
>> Thanks,
>> gub
>>
> --
> Os meus cumprimentos / Best regards / Mit freundlichen Grüße
> Carlos Diogo
>
--
Best Regards
Jeff Zhang
Re: Zeppelin at scale
Posted by Carlos Diogo <cd...@gmail.com>.
Hi
My two cents . The only way I know to scale this would be with a container
based deployment like open shift . You would have isolation per user which
makes each user process run in its own pod .
In addition you could setup multiple zeppelin servers ( on the above
mention way) and then have a load balancer in the middle ( Nginx for
instance )
You can have a common notebook repository such as S3 or an NFS share
Finally , if you want to enable scheduling you would need to ensure that
only one of the servers have the scheduling enabled so that the jobs only
run in one instance .
Hope it helps
Carlos
On Tue 30. Mar 2021 at 11:57, Great Info <gu...@gmail.com> wrote:
> I see zeppelin does not have cluster deployment support.
> Is there any work to support zeppelin access to multiple users.
> Kindly share some links/guides if there is already discussion/solution
> around this.
>
> A simple use case, many users(Atleast 1k users) want to access sql
> interpreter(jdbc postgres) write show read queries and select some
> aggregation on the result then chart it.
>
> Thanks,
> gub
>
--
Os meus cumprimentos / Best regards / Mit freundlichen Grüße
Carlos Diogo