You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Byung-Gon Chun <bg...@gmail.com> on 2017/12/18 15:09:57 UTC
Sharing Onyx
Hi Reefers,
I'm happy to share that my research group just made Onyx, a data processing
system for flexible employment with different execution scenarios for
various deployment characteristics on clusters.
https://snuspl.github.io/onyx/
Onyx is a full-blown data processing framework built atop REEF. It
currently supports Apache Beam for writing applications. We're working on
supporting Spark DSL.
Onyx outperforms Spark in various deployment scenarios. We plan to share
evaluation results soon through the web site.
Any feedback's welcomed!
Best,
Gon
--
Byung-Gon Chun
Re: Sharing Onyx
Posted by Markus Weimer <ma...@weimo.de>.
Congrats! Looking forward to another vibrant ASF project. -- Markus
On Fri, Mar 2, 2018 at 4:15 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
> Recently Nemo (called Onyx before) was accepted to the Apache Incubator. :)
>
>
> On Tue, Dec 19, 2017 at 7:45 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
>
> > Thanks, Dongjoon.
> > Stay tuned! :)
> >
> > On Tue, Dec 19, 2017 at 5:28 AM, Dongjoon Hyun <do...@gmail.com>
> > wrote:
> >
> >> It's great! Congratulation!
> >>
> >> I'm really looking forward to see the evaluation result with Spark.
> >>
> >> Bests,
> >> Dongjoon.
> >>
> >>
> >> On Mon, Dec 18, 2017 at 12:19 PM, Sergiy Matusevych <
> >> sergiy.matusevych@gmail.com> wrote:
> >>
> >> > Hi Gon,
> >> >
> >> > This is fantastic, and the code and the site look very neat. I want to
> >> > learn more about the project! Do you plan to give talks in English
> >> about it
> >> > any time soon? Please share the video! Also, it would be very cool if
> >> you
> >> > could write a paragraph or two about the project so we can reference
> it
> >> > from the REEF site?
> >> >
> >> > Thank you,
> >> > Sergiy.
> >> >
> >> > On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com>
> >> wrote:
> >> >
> >> > > Hi Reefers,
> >> > >
> >> > > I'm happy to share that my research group just made Onyx, a data
> >> > processing
> >> > > system for flexible employment with different execution scenarios
> for
> >> > > various deployment characteristics on clusters.
> >> > > https://snuspl.github.io/onyx/
> >> > >
> >> > > Onyx is a full-blown data processing framework built atop REEF. It
> >> > > currently supports Apache Beam for writing applications. We're
> >> working on
> >> > > supporting Spark DSL.
> >> > >
> >> > > Onyx outperforms Spark in various deployment scenarios. We plan to
> >> share
> >> > > evaluation results soon through the web site.
> >> > >
> >> > > Any feedback's welcomed!
> >> > >
> >> > > Best,
> >> > > Gon
> >> > >
> >> > > --
> >> > > Byung-Gon Chun
> >> > >
> >> >
> >>
> >
> >
> >
> > --
> > Byung-Gon Chun
> >
>
>
>
> --
> Byung-Gon Chun
>
Re: Sharing Onyx
Posted by Byung-Gon Chun <bg...@gmail.com>.
Recently Nemo (called Onyx before) was accepted to the Apache Incubator. :)
On Tue, Dec 19, 2017 at 7:45 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
> Thanks, Dongjoon.
> Stay tuned! :)
>
> On Tue, Dec 19, 2017 at 5:28 AM, Dongjoon Hyun <do...@gmail.com>
> wrote:
>
>> It's great! Congratulation!
>>
>> I'm really looking forward to see the evaluation result with Spark.
>>
>> Bests,
>> Dongjoon.
>>
>>
>> On Mon, Dec 18, 2017 at 12:19 PM, Sergiy Matusevych <
>> sergiy.matusevych@gmail.com> wrote:
>>
>> > Hi Gon,
>> >
>> > This is fantastic, and the code and the site look very neat. I want to
>> > learn more about the project! Do you plan to give talks in English
>> about it
>> > any time soon? Please share the video! Also, it would be very cool if
>> you
>> > could write a paragraph or two about the project so we can reference it
>> > from the REEF site?
>> >
>> > Thank you,
>> > Sergiy.
>> >
>> > On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com>
>> wrote:
>> >
>> > > Hi Reefers,
>> > >
>> > > I'm happy to share that my research group just made Onyx, a data
>> > processing
>> > > system for flexible employment with different execution scenarios for
>> > > various deployment characteristics on clusters.
>> > > https://snuspl.github.io/onyx/
>> > >
>> > > Onyx is a full-blown data processing framework built atop REEF. It
>> > > currently supports Apache Beam for writing applications. We're
>> working on
>> > > supporting Spark DSL.
>> > >
>> > > Onyx outperforms Spark in various deployment scenarios. We plan to
>> share
>> > > evaluation results soon through the web site.
>> > >
>> > > Any feedback's welcomed!
>> > >
>> > > Best,
>> > > Gon
>> > >
>> > > --
>> > > Byung-Gon Chun
>> > >
>> >
>>
>
>
>
> --
> Byung-Gon Chun
>
--
Byung-Gon Chun
Re: Sharing Onyx
Posted by Byung-Gon Chun <bg...@gmail.com>.
Thanks, Dongjoon.
Stay tuned! :)
On Tue, Dec 19, 2017 at 5:28 AM, Dongjoon Hyun <do...@gmail.com>
wrote:
> It's great! Congratulation!
>
> I'm really looking forward to see the evaluation result with Spark.
>
> Bests,
> Dongjoon.
>
>
> On Mon, Dec 18, 2017 at 12:19 PM, Sergiy Matusevych <
> sergiy.matusevych@gmail.com> wrote:
>
> > Hi Gon,
> >
> > This is fantastic, and the code and the site look very neat. I want to
> > learn more about the project! Do you plan to give talks in English about
> it
> > any time soon? Please share the video! Also, it would be very cool if you
> > could write a paragraph or two about the project so we can reference it
> > from the REEF site?
> >
> > Thank you,
> > Sergiy.
> >
> > On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com>
> wrote:
> >
> > > Hi Reefers,
> > >
> > > I'm happy to share that my research group just made Onyx, a data
> > processing
> > > system for flexible employment with different execution scenarios for
> > > various deployment characteristics on clusters.
> > > https://snuspl.github.io/onyx/
> > >
> > > Onyx is a full-blown data processing framework built atop REEF. It
> > > currently supports Apache Beam for writing applications. We're working
> on
> > > supporting Spark DSL.
> > >
> > > Onyx outperforms Spark in various deployment scenarios. We plan to
> share
> > > evaluation results soon through the web site.
> > >
> > > Any feedback's welcomed!
> > >
> > > Best,
> > > Gon
> > >
> > > --
> > > Byung-Gon Chun
> > >
> >
>
--
Byung-Gon Chun
Re: Sharing Onyx
Posted by Dongjoon Hyun <do...@gmail.com>.
It's great! Congratulation!
I'm really looking forward to see the evaluation result with Spark.
Bests,
Dongjoon.
On Mon, Dec 18, 2017 at 12:19 PM, Sergiy Matusevych <
sergiy.matusevych@gmail.com> wrote:
> Hi Gon,
>
> This is fantastic, and the code and the site look very neat. I want to
> learn more about the project! Do you plan to give talks in English about it
> any time soon? Please share the video! Also, it would be very cool if you
> could write a paragraph or two about the project so we can reference it
> from the REEF site?
>
> Thank you,
> Sergiy.
>
> On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
>
> > Hi Reefers,
> >
> > I'm happy to share that my research group just made Onyx, a data
> processing
> > system for flexible employment with different execution scenarios for
> > various deployment characteristics on clusters.
> > https://snuspl.github.io/onyx/
> >
> > Onyx is a full-blown data processing framework built atop REEF. It
> > currently supports Apache Beam for writing applications. We're working on
> > supporting Spark DSL.
> >
> > Onyx outperforms Spark in various deployment scenarios. We plan to share
> > evaluation results soon through the web site.
> >
> > Any feedback's welcomed!
> >
> > Best,
> > Gon
> >
> > --
> > Byung-Gon Chun
> >
>
Re: Sharing Onyx
Posted by Byung-Gon Chun <bg...@gmail.com>.
Thanks, Sergiy!
We plan to give a talk in English at a summit. Stay tuned. :)
Thanks for the suggestion. We will write a paragraph about the project and
add it to the REEF site.
-Gon
On Tue, Dec 19, 2017 at 5:19 AM, Sergiy Matusevych <
sergiy.matusevych@gmail.com> wrote:
> Hi Gon,
>
> This is fantastic, and the code and the site look very neat. I want to
> learn more about the project! Do you plan to give talks in English about it
> any time soon? Please share the video! Also, it would be very cool if you
> could write a paragraph or two about the project so we can reference it
> from the REEF site?
>
> Thank you,
> Sergiy.
>
> On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
>
> > Hi Reefers,
> >
> > I'm happy to share that my research group just made Onyx, a data
> processing
> > system for flexible employment with different execution scenarios for
> > various deployment characteristics on clusters.
> > https://snuspl.github.io/onyx/
> >
> > Onyx is a full-blown data processing framework built atop REEF. It
> > currently supports Apache Beam for writing applications. We're working on
> > supporting Spark DSL.
> >
> > Onyx outperforms Spark in various deployment scenarios. We plan to share
> > evaluation results soon through the web site.
> >
> > Any feedback's welcomed!
> >
> > Best,
> > Gon
> >
> > --
> > Byung-Gon Chun
> >
>
--
Byung-Gon Chun
Re: Sharing Onyx
Posted by Sergiy Matusevych <se...@gmail.com>.
Hi Gon,
This is fantastic, and the code and the site look very neat. I want to
learn more about the project! Do you plan to give talks in English about it
any time soon? Please share the video! Also, it would be very cool if you
could write a paragraph or two about the project so we can reference it
from the REEF site?
Thank you,
Sergiy.
On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
> Hi Reefers,
>
> I'm happy to share that my research group just made Onyx, a data processing
> system for flexible employment with different execution scenarios for
> various deployment characteristics on clusters.
> https://snuspl.github.io/onyx/
>
> Onyx is a full-blown data processing framework built atop REEF. It
> currently supports Apache Beam for writing applications. We're working on
> supporting Spark DSL.
>
> Onyx outperforms Spark in various deployment scenarios. We plan to share
> evaluation results soon through the web site.
>
> Any feedback's welcomed!
>
> Best,
> Gon
>
> --
> Byung-Gon Chun
>
Re: Sharing Onyx
Posted by Byung-Gon Chun <bg...@gmail.com>.
Thanks, Markus!
Are you looking for a doc like
https://github.com/swsnu/bd2017/blob/master/doc/reefify.md, which Jooyeon
wrote up?
We'd appreciate your feedback on turning the doc into a blog post.
-Gon
On Tue, Dec 19, 2017 at 4:09 AM, Markus Weimer <ma...@weimo.de> wrote:
> Wow, this is so cool to see! I know these must be exciting and busy times,
> but I'd love to learn more about your experience using REEF in this
> context. Maybe we can even turn this into a blog post on the REEF site?
>
> Congrats again!
>
> Markus
>
> On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
>
> > Hi Reefers,
> >
> > I'm happy to share that my research group just made Onyx, a data
> processing
> > system for flexible employment with different execution scenarios for
> > various deployment characteristics on clusters.
> > https://snuspl.github.io/onyx/
> >
> > Onyx is a full-blown data processing framework built atop REEF. It
> > currently supports Apache Beam for writing applications. We're working on
> > supporting Spark DSL.
> >
> > Onyx outperforms Spark in various deployment scenarios. We plan to share
> > evaluation results soon through the web site.
> >
> > Any feedback's welcomed!
> >
> > Best,
> > Gon
> >
> > --
> > Byung-Gon Chun
> >
>
--
Byung-Gon Chun
Re: Sharing Onyx
Posted by Markus Weimer <ma...@weimo.de>.
Wow, this is so cool to see! I know these must be exciting and busy times,
but I'd love to learn more about your experience using REEF in this
context. Maybe we can even turn this into a blog post on the REEF site?
Congrats again!
Markus
On Mon, Dec 18, 2017 at 7:09 AM, Byung-Gon Chun <bg...@gmail.com> wrote:
> Hi Reefers,
>
> I'm happy to share that my research group just made Onyx, a data processing
> system for flexible employment with different execution scenarios for
> various deployment characteristics on clusters.
> https://snuspl.github.io/onyx/
>
> Onyx is a full-blown data processing framework built atop REEF. It
> currently supports Apache Beam for writing applications. We're working on
> supporting Spark DSL.
>
> Onyx outperforms Spark in various deployment scenarios. We plan to share
> evaluation results soon through the web site.
>
> Any feedback's welcomed!
>
> Best,
> Gon
>
> --
> Byung-Gon Chun
>