You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by Jeff Zhang <zj...@gmail.com> on 2022/03/23 12:19:24 UTC
Re: Interpreter maintenance
I plan to remove scalding interpreter. Recently it causes CI fail because
the dependency can not be downloaded (dependency is in twitter repository)
And scalding interpreter is still based on scala 2.10, while the latest
scalding is in 2.12 and 2.11 (not 2.10 supported)
https://mvnrepository.com/artifact/com.twitter/scalding-core
On Mon, Jan 3, 2022 at 9:18 AM Jongyoul Lee <jo...@gmail.com> wrote:
> Hello Alex,
>
> Thank you for the update. I wanted to get this kind of feedback. I’ll
> update the wiki with your comment.
>
> Happy new year!!
>
> Regards,
> Jongyoul Lee
>
> 2022년 1월 3일 (월) 00:29, Alex Ott <al...@gmail.com>님이 작성:
>
> > Cassandra interpreter should just work with new dependency - there are
> > enough tests to catch up problems during upgrade. Also, new versions of
> the
> > driver don't bring a lot of things related to interpreter, so old version
> > of the driver should just work.
> >
> > On Sun, Jan 2, 2022 at 3:43 PM Jongyoul Lee <jo...@gmail.com> wrote:
> >
> > > Hello,
> > >
> > > I made a proposal for maintaining interpreters for the future.
> > > -
> > >
> >
> https://cwiki.apache.org/confluence/display/ZEPPELIN/Interpreter+Maintenance
> > >
> > > Please check it and leave your comments freely on the thread of this
> > > email, comments on the wiki, and the threads of the slack channel.
> > >
> > > References
> > > - https://the-asf.slack.com/archives/C4RDKR51R/p1632495099017000
> > > - https://lists.apache.org/thread/cxzsortyypgh4mnydzxfnljfnwnv2t5c
> > >
> > >
> > > Regards,
> > > Jongyoul Lee
> > >
> > > --
> > > 이종열, Jongyoul Lee, 李宗烈
> > > http://madeng.net
> > >
> >
> >
> > --
> > With best wishes, Alex Ott
> > http://alexott.net/
> > Twitter: alexott_en (English), alexott (Russian)
> >
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>
--
Best Regards
Jeff Zhang
Re: Interpreter maintenance
Posted by PJ Fanning <fa...@apache.org>.
This issue is intermittent but is not currently happening - see https://github.com/twitter/hadoop-lzo/issues/148 for context.
On 2022/03/23 13:29:17 Peter Lee wrote:
> Hi Jeff,
>
> I'm new to Zeppelin recently. I was trying to build Zeppelin from source, but unfortunately I met this problem you mentioned about the missing of maven dependencies from scalding.
>
> Do you have any work around about this? Or I should wait until you remove scalding interpreter?
>
> cheers,
> Lee
>
> On 2022/03/23 12:19:24 Jeff Zhang wrote:
> > I plan to remove scalding interpreter. Recently it causes CI fail because
> > the dependency can not be downloaded (dependency is in twitter repository)
> > And scalding interpreter is still based on scala 2.10, while the latest
> > scalding is in 2.12 and 2.11 (not 2.10 supported)
> > https://mvnrepository.com/artifact/com.twitter/scalding-core
> >
> >
> > On Mon, Jan 3, 2022 at 9:18 AM Jongyoul Lee <jo...@gmail.com> wrote:
> >
> > > Hello Alex,
> > >
> > > Thank you for the update. I wanted to get this kind of feedback. I’ll
> > > update the wiki with your comment.
> > >
> > > Happy new year!!
> > >
> > > Regards,
> > > Jongyoul Lee
> > >
> > > 2022년 1월 3일 (월) 00:29, Alex Ott <al...@gmail.com>님이 작성:
> > >
> > > > Cassandra interpreter should just work with new dependency - there are
> > > > enough tests to catch up problems during upgrade. Also, new versions of
> > > the
> > > > driver don't bring a lot of things related to interpreter, so old version
> > > > of the driver should just work.
> > > >
> > > > On Sun, Jan 2, 2022 at 3:43 PM Jongyoul Lee <jo...@gmail.com> wrote:
> > > >
> > > > > Hello,
> > > > >
> > > > > I made a proposal for maintaining interpreters for the future.
> > > > > -
> > > > >
> > > >
> > > https://cwiki.apache.org/confluence/display/ZEPPELIN/Interpreter+Maintenance
> > > > >
> > > > > Please check it and leave your comments freely on the thread of this
> > > > > email, comments on the wiki, and the threads of the slack channel.
> > > > >
> > > > > References
> > > > > - https://the-asf.slack.com/archives/C4RDKR51R/p1632495099017000
> > > > > - https://lists.apache.org/thread/cxzsortyypgh4mnydzxfnljfnwnv2t5c
> > > > >
> > > > >
> > > > > Regards,
> > > > > Jongyoul Lee
> > > > >
> > > > > --
> > > > > 이종열, Jongyoul Lee, 李宗烈
> > > > > http://madeng.net
> > > > >
> > > >
> > > >
> > > > --
> > > > With best wishes, Alex Ott
> > > > http://alexott.net/
> > > > Twitter: alexott_en (English), alexott (Russian)
> > > >
> > > --
> > > 이종열, Jongyoul Lee, 李宗烈
> > > http://madeng.net
> > >
> >
> >
> > --
> > Best Regards
> >
> > Jeff Zhang
> >
>
Re: Interpreter maintenance
Posted by Peter Lee <pe...@apache.org>.
Hi Jeff,
I'm new to Zeppelin recently. I was trying to build Zeppelin from source, but unfortunately I met this problem you mentioned about the missing of maven dependencies from scalding.
Do you have any work around about this? Or I should wait until you remove scalding interpreter?
cheers,
Lee
On 2022/03/23 12:19:24 Jeff Zhang wrote:
> I plan to remove scalding interpreter. Recently it causes CI fail because
> the dependency can not be downloaded (dependency is in twitter repository)
> And scalding interpreter is still based on scala 2.10, while the latest
> scalding is in 2.12 and 2.11 (not 2.10 supported)
> https://mvnrepository.com/artifact/com.twitter/scalding-core
>
>
> On Mon, Jan 3, 2022 at 9:18 AM Jongyoul Lee <jo...@gmail.com> wrote:
>
> > Hello Alex,
> >
> > Thank you for the update. I wanted to get this kind of feedback. I’ll
> > update the wiki with your comment.
> >
> > Happy new year!!
> >
> > Regards,
> > Jongyoul Lee
> >
> > 2022년 1월 3일 (월) 00:29, Alex Ott <al...@gmail.com>님이 작성:
> >
> > > Cassandra interpreter should just work with new dependency - there are
> > > enough tests to catch up problems during upgrade. Also, new versions of
> > the
> > > driver don't bring a lot of things related to interpreter, so old version
> > > of the driver should just work.
> > >
> > > On Sun, Jan 2, 2022 at 3:43 PM Jongyoul Lee <jo...@gmail.com> wrote:
> > >
> > > > Hello,
> > > >
> > > > I made a proposal for maintaining interpreters for the future.
> > > > -
> > > >
> > >
> > https://cwiki.apache.org/confluence/display/ZEPPELIN/Interpreter+Maintenance
> > > >
> > > > Please check it and leave your comments freely on the thread of this
> > > > email, comments on the wiki, and the threads of the slack channel.
> > > >
> > > > References
> > > > - https://the-asf.slack.com/archives/C4RDKR51R/p1632495099017000
> > > > - https://lists.apache.org/thread/cxzsortyypgh4mnydzxfnljfnwnv2t5c
> > > >
> > > >
> > > > Regards,
> > > > Jongyoul Lee
> > > >
> > > > --
> > > > 이종열, Jongyoul Lee, 李宗烈
> > > > http://madeng.net
> > > >
> > >
> > >
> > > --
> > > With best wishes, Alex Ott
> > > http://alexott.net/
> > > Twitter: alexott_en (English), alexott (Russian)
> > >
> > --
> > 이종열, Jongyoul Lee, 李宗烈
> > http://madeng.net
> >
>
>
> --
> Best Regards
>
> Jeff Zhang
>
Re: Interpreter maintenance
Posted by Philipp Dallig <ph...@gmail.com>.
+1 for removing
The last release is from 2017, but the repository seems active.
https://github.com/twitter/scalding/commits/develop
Perhaps an update to a newer Scalding version that supports Scala 2.12
or 2.11 will fit our needs.
I would like it if we don't need the Twitter repository anymore.
Am 23.03.22 um 13:19 schrieb Jeff Zhang:
> I plan to remove scalding interpreter. Recently it causes CI fail because
> the dependency can not be downloaded (dependency is in twitter repository)
> And scalding interpreter is still based on scala 2.10, while the latest
> scalding is in 2.12 and 2.11 (not 2.10 supported)
> https://mvnrepository.com/artifact/com.twitter/scalding-core
>
>
> On Mon, Jan 3, 2022 at 9:18 AM Jongyoul Lee <jo...@gmail.com> wrote:
>
>> Hello Alex,
>>
>> Thank you for the update. I wanted to get this kind of feedback. I’ll
>> update the wiki with your comment.
>>
>> Happy new year!!
>>
>> Regards,
>> Jongyoul Lee
>>
>> 2022년 1월 3일 (월) 00:29, Alex Ott <al...@gmail.com>님이 작성:
>>
>>> Cassandra interpreter should just work with new dependency - there are
>>> enough tests to catch up problems during upgrade. Also, new versions of
>> the
>>> driver don't bring a lot of things related to interpreter, so old version
>>> of the driver should just work.
>>>
>>> On Sun, Jan 2, 2022 at 3:43 PM Jongyoul Lee <jo...@gmail.com> wrote:
>>>
>>>> Hello,
>>>>
>>>> I made a proposal for maintaining interpreters for the future.
>>>> -
>>>>
>> https://cwiki.apache.org/confluence/display/ZEPPELIN/Interpreter+Maintenance
>>>> Please check it and leave your comments freely on the thread of this
>>>> email, comments on the wiki, and the threads of the slack channel.
>>>>
>>>> References
>>>> - https://the-asf.slack.com/archives/C4RDKR51R/p1632495099017000
>>>> - https://lists.apache.org/thread/cxzsortyypgh4mnydzxfnljfnwnv2t5c
>>>>
>>>>
>>>> Regards,
>>>> Jongyoul Lee
>>>>
>>>> --
>>>> 이종열, Jongyoul Lee, 李宗烈
>>>> http://madeng.net
>>>>
>>>
>>> --
>>> With best wishes, Alex Ott
>>> http://alexott.net/
>>> Twitter: alexott_en (English), alexott (Russian)
>>>
>> --
>> 이종열, Jongyoul Lee, 李宗烈
>> http://madeng.net
>>
>