Re: Real time insights into LinkedIn's performance using Apache Samza

[Shekar Tippur <ct...@gmail.com>]

Chris,

Really appreciate you sharing the paper.
I will certainly internalise this.

- S

On Thu, Sep 18, 2014 at 10:02 AM, Chris Riccomini <
criccomini@linkedin.com.invalid> wrote:

> Hey Guys,
>
> I want to send a heads-up about a blog post written by Jakob:
>
>
> http://engineering.linkedin.com/samza/real-time-insights-linkedins-performance-using-apache-samza
>
> The post is a pretty good description of a big (600,000 msgs/sec) Samza
> job that we run at LinkedIn. This job has been discussed in the abstract on
> the dev list for quite some time when various questions arise. It's also
> been the motivation behind some of Samza's JIRAs (SAMZA-123, SAMZA-348,
> SAMZA-337, etc). Feel free to post/publicize.
>
> Cheers,
> Chris
>

Re: Real time insights into LinkedIn's performance using Apache Samza

[Chris Riccomini <cr...@linkedin.com.INVALID>]

Hey Yan,

Good point. I don't think this post is really a rigorous performance post.
It covers a number of different things. Maybe a "In the press" section
would be more appropriate? We could also dig up some other Samza posts to
put on there. Here are a few that I just dug up from googling.

https://gigaom.com/2013/09/17/linkedin-open-sources-stream-processing-engin
e-samza-its-take-on-storm/

http://radar.oreilly.com/2013/09/stream-processing-and-mining-just-got-more
-interesting.html

http://allthingshadoop.com/2013/09/17/real-time-data-pipelines-and-analytic
s-with-apache-kafka-and-apache-samza/

http://jaxenter.com/one-to-watch-apache-samza-the-continuous-computation-st
ream-processing-system-47909.html

http://www.thecloudavenue.com/2013/09/storm-and-samza-for-real-time.html

http://www.datanami.com/2013/09/17/linkedin_open_sources_samza_stream_proce
ssor/


Cheers,
Chris

On 9/18/14 5:28 PM, "Yan Fang" <ya...@gmail.com> wrote:

>Do we also add this post to the Wiki under a category such as performance,
>like what Kafka has in its website ?
>
>Fang, Yan
>yanfang724@gmail.com
>+1 (206) 849-4108
>
>On Thu, Sep 18, 2014 at 10:22 AM, Shekar Tippur <ct...@gmail.com> wrote:
>
>> Chris,
>>
>> Really appreciate you sharing the paper.
>> I will certainly internalise this.
>>
>> - S
>>
>> On Thu, Sep 18, 2014 at 10:02 AM, Chris Riccomini <
>> criccomini@linkedin.com.invalid> wrote:
>>
>> > Hey Guys,
>> >
>> > I want to send a heads-up about a blog post written by Jakob:
>> >
>> >
>> >
>> 
>>http://engineering.linkedin.com/samza/real-time-insights-linkedins-perfor
>>mance-using-apache-samza
>> >
>> > The post is a pretty good description of a big (600,000 msgs/sec)
>>Samza
>> > job that we run at LinkedIn. This job has been discussed in the
>>abstract
>> on
>> > the dev list for quite some time when various questions arise. It's
>>also
>> > been the motivation behind some of Samza's JIRAs (SAMZA-123,
>>SAMZA-348,
>> > SAMZA-337, etc). Feel free to post/publicize.
>> >
>> > Cheers,
>> > Chris
>> >
>>

Re: Real time insights into LinkedIn's performance using Apache Samza

[Yan Fang <ya...@gmail.com>]

Do we also add this post to the Wiki under a category such as performance,
like what Kafka has in its website ?

Fang, Yan
yanfang724@gmail.com
+1 (206) 849-4108

On Thu, Sep 18, 2014 at 10:22 AM, Shekar Tippur <ct...@gmail.com> wrote:

> Chris,
>
> Really appreciate you sharing the paper.
> I will certainly internalise this.
>
> - S
>
> On Thu, Sep 18, 2014 at 10:02 AM, Chris Riccomini <
> criccomini@linkedin.com.invalid> wrote:
>
> > Hey Guys,
> >
> > I want to send a heads-up about a blog post written by Jakob:
> >
> >
> >
> http://engineering.linkedin.com/samza/real-time-insights-linkedins-performance-using-apache-samza
> >
> > The post is a pretty good description of a big (600,000 msgs/sec) Samza
> > job that we run at LinkedIn. This job has been discussed in the abstract
> on
> > the dev list for quite some time when various questions arise. It's also
> > been the motivation behind some of Samza's JIRAs (SAMZA-123, SAMZA-348,
> > SAMZA-337, etc). Feel free to post/publicize.
> >
> > Cheers,
> > Chris
> >
>