You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by Jongyoul Lee <jo...@gmail.com> on 2020/08/03 07:33:38 UTC
Re: [Proposal] Zeppelin Client API (Zeppelin SDK)
Sounds good to me as well.
BTW, don't we have to change some web socket code as well? <- It's just an
idea.
I would like to see PoC for it and I'm willing to help to improve it
because my company needs it too.
2020년 8월 1일 (토) 오전 12:05, Jeff Zhang <zj...@gmail.com>님이 작성:
> Good idea, Moon, I think cli would be a good start for users. This kind of
> cli is a super combination of spark-shell, hive beeline, flink scala shell,
> python shell.
>
> e.g.
> >>> %spark sc.version
> >>> %hive show tables
> >>> %python print('hello world')
>
>
>
> moon soo Lee <le...@gmail.com> 于2020年7月31日周五 下午10:55写道：
>
> > Looks really good!
> > Do you think to have a CLI on top of high-level API be also useful?
> >
> >
> > On Fri, Jul 31, 2020 at 7:13 AM Jeff Zhang <zj...@gmail.com> wrote:
> >
> > > Thanks for your feedback, I have created ticket
> > > https://issues.apache.org/jira/browse/ZEPPELIN-4981
> > >
> > > Just like @Alex Ott <al...@gmail.com> mentioned, this api may need
> > > several iterations, so I plan to make it as an experimental feature
> > > first, and then refine the api based on user feedback.
> > > .
> > >
> > > Alex Ott <al...@gmail.com> 于2020年7月31日周五 下午7:48写道：
> > >
> > >> Idea is very good - I think that we'll need to get several iterations
> of
> > >> API refinement, but current approach looks promising.
> > >>
> > >> On Fri, Jul 24, 2020 at 5:54 PM Jeff Zhang <zj...@gmail.com> wrote:
> > >>
> > >> > Hi Folks,
> > >> >
> > >> > I'd like to discuss this proposal with you about the zeppelin client
> > api
> > >> > (zeppelin sdk).
> > >> > The background is that now Zeppelin’s main usage scenario is
> > interactive
> > >> > data analysis. Although it provides rest api, it is not easy for an
> > >> > external system (e.g. scheduler system) to integrate Zeppelin for
> the
> > >> > scenario where zeppelin is used as a backend job service. So I
> propose
> > >> to
> > >> > introduce a new module: Zeppelin client api (Zeppelin SDK), whose
> > >> purpose
> > >> > is to provide easy api for external systems to integrate zeppelin.
> > >> >
> > >> > I have created a google doc for the details, welcome any comments
> and
> > >> > feedback.
> > >> >
> > >> >
> > >> >
> > >>
> >
> https://docs.google.com/document/d/1bLLKKxleZlZpP9EFJlLLkJKwDBps-RNvzNwh3LFZWZ4/edit?usp=sharing
> > >> >
> > >> >
> > >> > --
> > >> > Best Regards
> > >> >
> > >> > Jeff Zhang
> > >> >
> > >>
> > >>
> > >> --
> > >> With best wishes, Alex Ott
> > >> http://alexott.net/
> > >> Twitter: alexott_en (English), alexott (Russian)
> > >>
> > >
> > >
> > > --
> > > Best Regards
> > >
> > > Jeff Zhang
> > >
> >
>
>
> --
> Best Regards
>
> Jeff Zhang
>
--
이종열, Jongyoul Lee, 李宗烈
http://madeng.net
Re: [Proposal] Zeppelin Client API (Zeppelin SDK)
Posted by Jeff Zhang <zj...@gmail.com>.
Hi Folks,
I have created PR for this feature, this is a big PR. But you can just take
a look at the examples in new module zeppelin-client-examples to see what
this zeppelin client api would look like. Welcome any comment and feedback.
https://github.com/apache/zeppelin/pull/3887
Jongyoul Lee <jo...@gmail.com> 于2020年8月3日周一 下午3:35写道：
> Sounds good to me as well.
>
> BTW, don't we have to change some web socket code as well? <- It's just an
> idea.
>
> I would like to see PoC for it and I'm willing to help to improve it
> because my company needs it too.
>
> 2020년 8월 1일 (토) 오전 12:05, Jeff Zhang <zj...@gmail.com>님이 작성:
>
>> Good idea, Moon, I think cli would be a good start for users. This kind of
>> cli is a super combination of spark-shell, hive beeline, flink scala
>> shell,
>> python shell.
>>
>> e.g.
>> >>> %spark sc.version
>> >>> %hive show tables
>> >>> %python print('hello world')
>>
>>
>>
>> moon soo Lee <le...@gmail.com> 于2020年7月31日周五 下午10:55写道：
>>
>> > Looks really good!
>> > Do you think to have a CLI on top of high-level API be also useful?
>> >
>> >
>> > On Fri, Jul 31, 2020 at 7:13 AM Jeff Zhang <zj...@gmail.com> wrote:
>> >
>> > > Thanks for your feedback, I have created ticket
>> > > https://issues.apache.org/jira/browse/ZEPPELIN-4981
>> > >
>> > > Just like @Alex Ott <al...@gmail.com> mentioned, this api may need
>> > > several iterations, so I plan to make it as an experimental feature
>> > > first, and then refine the api based on user feedback.
>> > > .
>> > >
>> > > Alex Ott <al...@gmail.com> 于2020年7月31日周五 下午7:48写道：
>> > >
>> > >> Idea is very good - I think that we'll need to get several
>> iterations of
>> > >> API refinement, but current approach looks promising.
>> > >>
>> > >> On Fri, Jul 24, 2020 at 5:54 PM Jeff Zhang <zj...@gmail.com> wrote:
>> > >>
>> > >> > Hi Folks,
>> > >> >
>> > >> > I'd like to discuss this proposal with you about the zeppelin
>> client
>> > api
>> > >> > (zeppelin sdk).
>> > >> > The background is that now Zeppelin’s main usage scenario is
>> > interactive
>> > >> > data analysis. Although it provides rest api, it is not easy for an
>> > >> > external system (e.g. scheduler system) to integrate Zeppelin for
>> the
>> > >> > scenario where zeppelin is used as a backend job service. So I
>> propose
>> > >> to
>> > >> > introduce a new module: Zeppelin client api (Zeppelin SDK), whose
>> > >> purpose
>> > >> > is to provide easy api for external systems to integrate zeppelin.
>> > >> >
>> > >> > I have created a google doc for the details, welcome any comments
>> and
>> > >> > feedback.
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> >
>> https://docs.google.com/document/d/1bLLKKxleZlZpP9EFJlLLkJKwDBps-RNvzNwh3LFZWZ4/edit?usp=sharing
>> > >> >
>> > >> >
>> > >> > --
>> > >> > Best Regards
>> > >> >
>> > >> > Jeff Zhang
>> > >> >
>> > >>
>> > >>
>> > >> --
>> > >> With best wishes, Alex Ott
>> > >> http://alexott.net/
>> > >> Twitter: alexott_en (English), alexott (Russian)
>> > >>
>> > >
>> > >
>> > > --
>> > > Best Regards
>> > >
>> > > Jeff Zhang
>> > >
>> >
>>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>
--
Best Regards
Jeff Zhang
Re: [Proposal] Zeppelin Client API (Zeppelin SDK)
Posted by Jeff Zhang <zj...@gmail.com>.
Hi Folks,
I have created PR for this feature, this is a big PR. But you can just take
a look at the examples in new module zeppelin-client-examples to see what
this zeppelin client api would look like. Welcome any comment and feedback.
https://github.com/apache/zeppelin/pull/3887
Jongyoul Lee <jo...@gmail.com> 于2020年8月3日周一 下午3:35写道：
> Sounds good to me as well.
>
> BTW, don't we have to change some web socket code as well? <- It's just an
> idea.
>
> I would like to see PoC for it and I'm willing to help to improve it
> because my company needs it too.
>
> 2020년 8월 1일 (토) 오전 12:05, Jeff Zhang <zj...@gmail.com>님이 작성:
>
>> Good idea, Moon, I think cli would be a good start for users. This kind of
>> cli is a super combination of spark-shell, hive beeline, flink scala
>> shell,
>> python shell.
>>
>> e.g.
>> >>> %spark sc.version
>> >>> %hive show tables
>> >>> %python print('hello world')
>>
>>
>>
>> moon soo Lee <le...@gmail.com> 于2020年7月31日周五 下午10:55写道：
>>
>> > Looks really good!
>> > Do you think to have a CLI on top of high-level API be also useful?
>> >
>> >
>> > On Fri, Jul 31, 2020 at 7:13 AM Jeff Zhang <zj...@gmail.com> wrote:
>> >
>> > > Thanks for your feedback, I have created ticket
>> > > https://issues.apache.org/jira/browse/ZEPPELIN-4981
>> > >
>> > > Just like @Alex Ott <al...@gmail.com> mentioned, this api may need
>> > > several iterations, so I plan to make it as an experimental feature
>> > > first, and then refine the api based on user feedback.
>> > > .
>> > >
>> > > Alex Ott <al...@gmail.com> 于2020年7月31日周五 下午7:48写道：
>> > >
>> > >> Idea is very good - I think that we'll need to get several
>> iterations of
>> > >> API refinement, but current approach looks promising.
>> > >>
>> > >> On Fri, Jul 24, 2020 at 5:54 PM Jeff Zhang <zj...@gmail.com> wrote:
>> > >>
>> > >> > Hi Folks,
>> > >> >
>> > >> > I'd like to discuss this proposal with you about the zeppelin
>> client
>> > api
>> > >> > (zeppelin sdk).
>> > >> > The background is that now Zeppelin’s main usage scenario is
>> > interactive
>> > >> > data analysis. Although it provides rest api, it is not easy for an
>> > >> > external system (e.g. scheduler system) to integrate Zeppelin for
>> the
>> > >> > scenario where zeppelin is used as a backend job service. So I
>> propose
>> > >> to
>> > >> > introduce a new module: Zeppelin client api (Zeppelin SDK), whose
>> > >> purpose
>> > >> > is to provide easy api for external systems to integrate zeppelin.
>> > >> >
>> > >> > I have created a google doc for the details, welcome any comments
>> and
>> > >> > feedback.
>> > >> >
>> > >> >
>> > >> >
>> > >>
>> >
>> https://docs.google.com/document/d/1bLLKKxleZlZpP9EFJlLLkJKwDBps-RNvzNwh3LFZWZ4/edit?usp=sharing
>> > >> >
>> > >> >
>> > >> > --
>> > >> > Best Regards
>> > >> >
>> > >> > Jeff Zhang
>> > >> >
>> > >>
>> > >>
>> > >> --
>> > >> With best wishes, Alex Ott
>> > >> http://alexott.net/
>> > >> Twitter: alexott_en (English), alexott (Russian)
>> > >>
>> > >
>> > >
>> > > --
>> > > Best Regards
>> > >
>> > > Jeff Zhang
>> > >
>> >
>>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>
--
Best Regards
Jeff Zhang