You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@samza.apache.org by Ed Yakabosky <ey...@linkedin.com.INVALID> on 2015/08/24 21:03:36 UTC

New Samza blog published - http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node

Hi Samza open source,

I want to share that Tao Feng
<https://www.linkedin.com/pub/tao-feng/14/958/171> (from LinkedIn's
Performance Team) has published a blog post
<http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node>
on
Samza perf benchmarks in collaboration with our development team.  A lot of
hard work went into this blog post so please join me in congratulating Tao
and other contributors, and please share to your "Big Data" social media
circles.

Synopsis: *T**he objective of the blog is to measure Samza's performance in
terms of the message-processing rate for a single machine for typical Samza
use cases. T**his will help engineers to understand and to optimize
performance and provide a basis for establishing a capacity model to run
Samza platform as a service.*

Thanks,
Ed Yakabosky
Streams Infrastructure TPM, LinkedIn

Re: New Samza blog published - http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node

Posted by Shekar Tippur <ct...@gmail.com>.

Ed,

Nice work.

On Tue, Aug 25, 2015 at 10:48 PM, Roger Hoover <ro...@gmail.com>
wrote:

> Thanks for sharing!
>
> Tao, did you use YARN to run 15 containers or is there a way to have them
> statically divide up the tasks?
>
>
>
> On Mon, Aug 24, 2015 at 12:03 PM, Ed Yakabosky <
> eyakabosky@linkedin.com.invalid> wrote:
>
> > Hi Samza open source,
> >
> > I want to share that Tao Feng
> > <https://www.linkedin.com/pub/tao-feng/14/958/171> (from LinkedIn's
> > Performance Team) has published a blog post
> > <
> >
> http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node
> > >
> > on
> > Samza perf benchmarks in collaboration with our development team.  A lot
> of
> > hard work went into this blog post so please join me in congratulating
> Tao
> > and other contributors, and please share to your "Big Data" social media
> > circles.
> >
> > Synopsis: *T**he objective of the blog is to measure Samza's performance
> in
> > terms of the message-processing rate for a single machine for typical
> Samza
> > use cases. T**his will help engineers to understand and to optimize
> > performance and provide a basis for establishing a capacity model to run
> > Samza platform as a service.*
> >
> > Thanks,
> > Ed Yakabosky
> > Streams Infrastructure TPM, LinkedIn
> >
>

Re: New Samza blog published - http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node

Posted by Roger Hoover <ro...@gmail.com>.

Thanks for sharing!

Tao, did you use YARN to run 15 containers or is there a way to have them
statically divide up the tasks?



On Mon, Aug 24, 2015 at 12:03 PM, Ed Yakabosky <
eyakabosky@linkedin.com.invalid> wrote:

> Hi Samza open source,
>
> I want to share that Tao Feng
> <https://www.linkedin.com/pub/tao-feng/14/958/171> (from LinkedIn's
> Performance Team) has published a blog post
> <
> http://engineering.linkedin.com/performance/benchmarking-apache-samza-12-million-messages-second-single-node
> >
> on
> Samza perf benchmarks in collaboration with our development team.  A lot of
> hard work went into this blog post so please join me in congratulating Tao
> and other contributors, and please share to your "Big Data" social media
> circles.
>
> Synopsis: *T**he objective of the blog is to measure Samza's performance in
> terms of the message-processing rate for a single machine for typical Samza
> use cases. T**his will help engineers to understand and to optimize
> performance and provide a basis for establishing a capacity model to run
> Samza platform as a service.*
>
> Thanks,
> Ed Yakabosky
> Streams Infrastructure TPM, LinkedIn
>