You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@aurora.apache.org by William Morgan <wi...@buoyant.io> on 2016/05/04 22:53:52 UTC
interested in a fast service load balancer / proxy?
[cross posting from the Mesos users' list by popular demand]
Dear Aurora friends,
We have an open source load balancer / proxy called linkerd
<https://linkerd.io/> that might be of interest to some of you. Similar to
things like SmartStack's Synapse and marathon-lb, it's a request-level load
balancer that speaks to service discovery. However, it doesn't require
process restarts when SD updates. It's built on Finagle, Twitter's
high-volume RPC library, which means it also can do intelligent things with
slow and failing servers, connection pooling, etc.
It features pluggable service discovery backends (Zookeeper, Marathon,
Consul, etcd), and pluggable protocol support (HTTP, thrift and mux).
It's designed as a sort of out-of-process client-side network stack for
high-volume service communication, but you can also use it as a debug proxy
or an edge traffic server.
If that sounds interesting, check out linkerd.io for more details, or join
us on our Slack channel <http://slack.linkerd.io/>. We'll be presenting it
at ApacheCon <http://sched.co/6OJA> and at MesosCon
<http://sched.co/6jta> later
this month. In the mean time, here's a screenshot to whet your appetite:
Feel free to hit me up with any questions!
-William
Re: interested in a fast service load balancer / proxy?
Posted by William Morgan <wi...@buoyant.io>.
Excellent, let us know how it goes.
There are a couple nice things we can provide beyond synapse:
- drop-in TLS support
<https://blog.buoyant.io/2016/03/24/transparent-tls-with-linkerd/>
- latency-aware load balancing
<https://blog.buoyant.io/2016/03/16/beyond-round-robin-load-balancing-for-latency/>
- a really good metrics.json endpoint with per-client latency percentiles,
etc.
- Zipkin tracing emission (blog post coming soon!)
Jump into our slack if you need help.
-William
On Fri, May 6, 2016 at 7:50 AM, Erb, Stephan <St...@blue-yonder.com>
wrote:
> We are currently using synapse instances (
> https://github.com/airbnb/synapse) as client-side loadbalancers next to
> our our individual python services. Linkerd sounds like a capable drop-in
> replacement. Great!
> ------------------------------
> *From:* benley@gmail.com <be...@gmail.com>
> *Sent:* Thursday, May 5, 2016 23:28
> *To:* user@aurora.apache.org
> *Subject:* Re: interested in a fast service load balancer / proxy?
>
> I've got a set of aurora configs for linkerd that I can share after
> cleaning them up a bit; stay tuned, unless someone else beats me to it.
>
> On Thu, May 5, 2016 at 5:17 PM William Morgan <wi...@buoyant.io> wrote:
>
>> Great idea, let me ask some of our Aurora users and see if we can get an
>> example config from them.
>>
>> -William
>>
>> On Thu, May 5, 2016 at 7:42 AM, Rogier Dikkes <ro...@surfsara.nl>
>> wrote:
>>
>>> Are there any plans to provide examples for Aurora+linkerd (as done for
>>> kubernetes & mesos+marathon) to give new users an easy way to take linkerd
>>> into consideration?
>>>
>>>
>>> On 5/5/16 3:21 AM, William Morgan wrote:
>>>
>>> Oh, great point. Should have mentioned that. linkerd does indeed speak
>>> ServerSets out of the box.
>>>
>>> On Wednesday, May 4, 2016, Zameer Manji < <zm...@apache.org>
>>> zmanji@apache.org> wrote:
>>>
>>>> Since linkerd is built upon Finagle, it should automatically work with
>>>> the ServerSets created by the Announcer in the executor. It should be
>>>> fairly easy to try out linkerd if you already use Aurora.
>>>>
>>>> On Wed, May 4, 2016 at 3:53 PM, William Morgan <wi...@buoyant.io>
>>>> wrote:
>>>>
>>>>> [cross posting from the Mesos users' list by popular demand]
>>>>>
>>>>> Dear Aurora friends,
>>>>>
>>>>> We have an open source load balancer / proxy called linkerd
>>>>> <https://linkerd.io/> that might be of interest to some of you.
>>>>> Similar to things like SmartStack's Synapse and marathon-lb, it's a
>>>>> request-level load balancer that speaks to service discovery. However, it
>>>>> doesn't require process restarts when SD updates. It's built on Finagle,
>>>>> Twitter's high-volume RPC library, which means it also can do intelligent
>>>>> things with slow and failing servers, connection pooling, etc.
>>>>>
>>>>> It features pluggable service discovery backends (Zookeeper, Marathon,
>>>>> Consul, etcd), and pluggable protocol support (HTTP, thrift and mux).
>>>>>
>>>>> It's designed as a sort of out-of-process client-side network stack
>>>>> for high-volume service communication, but you can also use it as a debug
>>>>> proxy or an edge traffic server.
>>>>>
>>>>> If that sounds interesting, check out linkerd.io for more details, or
>>>>> join us on our Slack channel <http://slack.linkerd.io/>. We'll be
>>>>> presenting it at ApacheCon <http://sched.co/6OJA> and at MesosCon
>>>>> <http://sched.co/6jta> later this month. In the mean time, here's a
>>>>> screenshot to whet your appetite:
>>>>>
>>>>>
>>>>>
>>>>> Feel free to hit me up with any questions!
>>>>>
>>>>> -William
>>>>>
>>>>> --
>>>>> Zameer Manji
>>>>>
>>>>>
>>>
>>> --
>>> -William
>>>
>>>
>>> --
>>> Rogier Dikkes
>>> Systeem Programmeur Hadoop & HPC Cloud
>>> e-mail: rogier.dikkes@surfsara.nl | M: +31 6 47 48 93 28
>>> SURFsara | Science Park 140 | 1098 XG Amsterdam
>>>
>>>
>>
Re: interested in a fast service load balancer / proxy?
Posted by "Erb, Stephan" <St...@blue-yonder.com>.
We are currently using synapse instances (https://github.com/airbnb/synapse?) as client-side loadbalancers next to our our individual python services. Linkerd sounds like a capable drop-in replacement. Great!
________________________________
From: benley@gmail.com <be...@gmail.com>
Sent: Thursday, May 5, 2016 23:28
To: user@aurora.apache.org
Subject: Re: interested in a fast service load balancer / proxy?
I've got a set of aurora configs for linkerd that I can share after cleaning them up a bit; stay tuned, unless someone else beats me to it.
On Thu, May 5, 2016 at 5:17 PM William Morgan <wi...@buoyant.io>> wrote:
Great idea, let me ask some of our Aurora users and see if we can get an example config from them.
-William
On Thu, May 5, 2016 at 7:42 AM, Rogier Dikkes <ro...@surfsara.nl>> wrote:
Are there any plans to provide examples for Aurora+linkerd (as done for kubernetes & mesos+marathon) to give new users an easy way to take linkerd into consideration?
On 5/5/16 3:21 AM, William Morgan wrote:
Oh, great point. Should have mentioned that. linkerd does indeed speak ServerSets out of the box.
On Wednesday, May 4, 2016, Zameer Manji <<m...@apache.org>> wrote:
Since linkerd is built upon Finagle, it should automatically work with the ServerSets created by the Announcer in the executor. It should be fairly easy to try out linkerd if you already use Aurora.
On Wed, May 4, 2016 at 3:53 PM, William Morgan <wi...@buoyant.io>> wrote:
[cross posting from the Mesos users' list by popular demand]
Dear Aurora friends,
We have an open source load balancer / proxy called linkerd<https://linkerd.io/> that might be of interest to some of you. Similar to things like SmartStack's Synapse and marathon-lb, it's a request-level load balancer that speaks to service discovery. However, it doesn't require process restarts when SD updates. It's built on Finagle, Twitter's high-volume RPC library, which means it also can do intelligent things with slow and failing servers, connection pooling, etc.
It features pluggable service discovery backends (Zookeeper, Marathon, Consul, etcd), and pluggable protocol support (HTTP, thrift and mux).
It's designed as a sort of out-of-process client-side network stack for high-volume service communication, but you can also use it as a debug proxy or an edge traffic server.
If that sounds interesting, check out linkerd.io<https://linkerd.io/> for more details, or join us on our Slack channel<http://slack.linkerd.io/>. We'll be presenting it at ApacheCon<http://sched.co/6OJA> and at MesosCon<http://sched.co/6jta> later this month. In the mean time, here's a screenshot to whet your appetite:
[cid:part8.01090809.02010307@surfsara.nl]
??
Feel free to hit me up with any questions!
-William
--
Zameer Manji
--
-William
--
Rogier Dikkes
Systeem Programmeur Hadoop & HPC Cloud
e-mail: rogier.dikkes@surfsara.nl<ma...@surfsara.nl> | M: +31 6 47 48 93 28
SURFsara | Science Park 140 | 1098 XG Amsterdam
Re: interested in a fast service load balancer / proxy?
Posted by "benley@gmail.com" <be...@gmail.com>.
I've got a set of aurora configs for linkerd that I can share after
cleaning them up a bit; stay tuned, unless someone else beats me to it.
On Thu, May 5, 2016 at 5:17 PM William Morgan <wi...@buoyant.io> wrote:
> Great idea, let me ask some of our Aurora users and see if we can get an
> example config from them.
>
> -William
>
> On Thu, May 5, 2016 at 7:42 AM, Rogier Dikkes <ro...@surfsara.nl>
> wrote:
>
>> Are there any plans to provide examples for Aurora+linkerd (as done for
>> kubernetes & mesos+marathon) to give new users an easy way to take linkerd
>> into consideration?
>>
>>
>> On 5/5/16 3:21 AM, William Morgan wrote:
>>
>> Oh, great point. Should have mentioned that. linkerd does indeed speak
>> ServerSets out of the box.
>>
>> On Wednesday, May 4, 2016, Zameer Manji < <zm...@apache.org>
>> zmanji@apache.org> wrote:
>>
>>> Since linkerd is built upon Finagle, it should automatically work with
>>> the ServerSets created by the Announcer in the executor. It should be
>>> fairly easy to try out linkerd if you already use Aurora.
>>>
>>> On Wed, May 4, 2016 at 3:53 PM, William Morgan <wi...@buoyant.io>
>>> wrote:
>>>
>>>> [cross posting from the Mesos users' list by popular demand]
>>>>
>>>> Dear Aurora friends,
>>>>
>>>> We have an open source load balancer / proxy called linkerd
>>>> <https://linkerd.io/> that might be of interest to some of you.
>>>> Similar to things like SmartStack's Synapse and marathon-lb, it's a
>>>> request-level load balancer that speaks to service discovery. However, it
>>>> doesn't require process restarts when SD updates. It's built on Finagle,
>>>> Twitter's high-volume RPC library, which means it also can do intelligent
>>>> things with slow and failing servers, connection pooling, etc.
>>>>
>>>> It features pluggable service discovery backends (Zookeeper, Marathon,
>>>> Consul, etcd), and pluggable protocol support (HTTP, thrift and mux).
>>>>
>>>> It's designed as a sort of out-of-process client-side network stack for
>>>> high-volume service communication, but you can also use it as a debug proxy
>>>> or an edge traffic server.
>>>>
>>>> If that sounds interesting, check out linkerd.io for more details, or
>>>> join us on our Slack channel <http://slack.linkerd.io/>. We'll be
>>>> presenting it at ApacheCon <http://sched.co/6OJA> and at MesosCon
>>>> <http://sched.co/6jta> later this month. In the mean time, here's a
>>>> screenshot to whet your appetite:
>>>>
>>>>
>>>>
>>>> Feel free to hit me up with any questions!
>>>>
>>>> -William
>>>>
>>>> --
>>>> Zameer Manji
>>>>
>>>>
>>
>> --
>> -William
>>
>>
>> --
>> Rogier Dikkes
>> Systeem Programmeur Hadoop & HPC Cloud
>> e-mail: rogier.dikkes@surfsara.nl | M: +31 6 47 48 93 28
>> SURFsara | Science Park 140 | 1098 XG Amsterdam
>>
>>
>
Re: interested in a fast service load balancer / proxy?
Posted by William Morgan <wi...@buoyant.io>.
Great idea, let me ask some of our Aurora users and see if we can get an
example config from them.
-William
On Thu, May 5, 2016 at 7:42 AM, Rogier Dikkes <ro...@surfsara.nl>
wrote:
> Are there any plans to provide examples for Aurora+linkerd (as done for
> kubernetes & mesos+marathon) to give new users an easy way to take linkerd
> into consideration?
>
>
> On 5/5/16 3:21 AM, William Morgan wrote:
>
> Oh, great point. Should have mentioned that. linkerd does indeed speak
> ServerSets out of the box.
>
> On Wednesday, May 4, 2016, Zameer Manji < <zm...@apache.org>
> zmanji@apache.org> wrote:
>
>> Since linkerd is built upon Finagle, it should automatically work with
>> the ServerSets created by the Announcer in the executor. It should be
>> fairly easy to try out linkerd if you already use Aurora.
>>
>> On Wed, May 4, 2016 at 3:53 PM, William Morgan <wi...@buoyant.io>
>> wrote:
>>
>>> [cross posting from the Mesos users' list by popular demand]
>>>
>>> Dear Aurora friends,
>>>
>>> We have an open source load balancer / proxy called linkerd
>>> <https://linkerd.io/> that might be of interest to some of you. Similar
>>> to things like SmartStack's Synapse and marathon-lb, it's a request-level
>>> load balancer that speaks to service discovery. However, it doesn't require
>>> process restarts when SD updates. It's built on Finagle, Twitter's
>>> high-volume RPC library, which means it also can do intelligent things with
>>> slow and failing servers, connection pooling, etc.
>>>
>>> It features pluggable service discovery backends (Zookeeper, Marathon,
>>> Consul, etcd), and pluggable protocol support (HTTP, thrift and mux).
>>>
>>> It's designed as a sort of out-of-process client-side network stack for
>>> high-volume service communication, but you can also use it as a debug proxy
>>> or an edge traffic server.
>>>
>>> If that sounds interesting, check out linkerd.io for more details, or
>>> join us on our Slack channel <http://slack.linkerd.io/>. We'll be
>>> presenting it at ApacheCon <http://sched.co/6OJA> and at MesosCon
>>> <http://sched.co/6jta> later this month. In the mean time, here's a
>>> screenshot to whet your appetite:
>>>
>>>
>>>
>>> Feel free to hit me up with any questions!
>>>
>>> -William
>>>
>>> --
>>> Zameer Manji
>>>
>>>
>
> --
> -William
>
>
> --
> Rogier Dikkes
> Systeem Programmeur Hadoop & HPC Cloud
> e-mail: rogier.dikkes@surfsara.nl | M: +31 6 47 48 93 28
> SURFsara | Science Park 140 | 1098 XG Amsterdam
>
>
Re: interested in a fast service load balancer / proxy?
Posted by Rogier Dikkes <ro...@surfsara.nl>.
Are there any plans to provide examples for Aurora+linkerd (as done for
kubernetes & mesos+marathon) to give new users an easy way to take
linkerd into consideration?
On 5/5/16 3:21 AM, William Morgan wrote:
> Oh, great point. Should have mentioned that. linkerd does indeed speak
> ServerSets out of the box.
>
> On Wednesday, May 4, 2016, Zameer Manji <zmanji@apache.org
> <ma...@apache.org>> wrote:
>
> Since linkerd is built upon Finagle, it should automatically work
> with the ServerSets created by the Announcer in the executor. It
> should be fairly easy to try out linkerd if you already use Aurora.
>
> On Wed, May 4, 2016 at 3:53 PM, William Morgan <william@buoyant.io
> <javascript:_e(%7B%7D,'cvml','william@buoyant.io');>> wrote:
>
> [cross posting from the Mesos users' list by popular demand]
>
> Dear Aurora friends,
>
> We have an open source load balancer / proxy called linkerd
> <https://linkerd.io/> that might be of interest to some of
> you. Similar to things like SmartStack's Synapse and
> marathon-lb, it's a request-level load balancer that speaks to
> service discovery. However, it doesn't require process
> restarts when SD updates. It's built on Finagle, Twitter's
> high-volume RPC library, which means it also can do
> intelligent things with slow and failing servers, connection
> pooling, etc.
>
> It features pluggable service discovery backends (Zookeeper,
> Marathon, Consul, etcd), and pluggable protocol support (HTTP,
> thrift and mux).
>
> It's designed as a sort of out-of-process client-side network
> stack for high-volume service communication, but you can also
> use it as a debug proxy or an edge traffic server.
>
> If that sounds interesting, check out linkerd.io
> <https://linkerd.io/> for more details, or join us on our
> Slack channel <http://slack.linkerd.io/>. We'll be presenting
> it at ApacheCon <http://sched.co/6OJA> and at MesosCon
> <http://sched.co/6jta> later this month. In the mean time,
> here's a screenshot to whet your appetite:
>
>
>
> Feel free to hit me up with any questions!
>
> -William
>
> --
> Zameer Manji
>
>
>
> --
> -William
>
--
Rogier Dikkes
Systeem Programmeur Hadoop & HPC Cloud
e-mail: rogier.dikkes@surfsara.nl | M: +31 6 47 48 93 28
SURFsara | Science Park 140 | 1098 XG Amsterdam
Re: interested in a fast service load balancer / proxy?
Posted by William Morgan <wi...@buoyant.io>.
Oh, great point. Should have mentioned that. linkerd does indeed speak
ServerSets out of the box.
On Wednesday, May 4, 2016, Zameer Manji <zm...@apache.org> wrote:
> Since linkerd is built upon Finagle, it should automatically work with the
> ServerSets created by the Announcer in the executor. It should be fairly
> easy to try out linkerd if you already use Aurora.
>
> On Wed, May 4, 2016 at 3:53 PM, William Morgan <william@buoyant.io
> <javascript:_e(%7B%7D,'cvml','william@buoyant.io');>> wrote:
>
>> [cross posting from the Mesos users' list by popular demand]
>>
>> Dear Aurora friends,
>>
>> We have an open source load balancer / proxy called linkerd
>> <https://linkerd.io/> that might be of interest to some of you. Similar
>> to things like SmartStack's Synapse and marathon-lb, it's a request-level
>> load balancer that speaks to service discovery. However, it doesn't require
>> process restarts when SD updates. It's built on Finagle, Twitter's
>> high-volume RPC library, which means it also can do intelligent things with
>> slow and failing servers, connection pooling, etc.
>>
>> It features pluggable service discovery backends (Zookeeper, Marathon,
>> Consul, etcd), and pluggable protocol support (HTTP, thrift and mux).
>>
>> It's designed as a sort of out-of-process client-side network stack for
>> high-volume service communication, but you can also use it as a debug proxy
>> or an edge traffic server.
>>
>> If that sounds interesting, check out linkerd.io for more details, or
>> join us on our Slack channel <http://slack.linkerd.io/>. We'll be
>> presenting it at ApacheCon <http://sched.co/6OJA> and at MesosCon
>> <http://sched.co/6jta> later this month. In the mean time, here's a
>> screenshot to whet your appetite:
>>
>>
>>
>> Feel free to hit me up with any questions!
>>
>> -William
>>
>> --
>> Zameer Manji
>>
>>
--
-William
Re: interested in a fast service load balancer / proxy?
Posted by Zameer Manji <zm...@apache.org>.
Since linkerd is built upon Finagle, it should automatically work with the
ServerSets created by the Announcer in the executor. It should be fairly
easy to try out linkerd if you already use Aurora.
On Wed, May 4, 2016 at 3:53 PM, William Morgan <wi...@buoyant.io> wrote:
> [cross posting from the Mesos users' list by popular demand]
>
> Dear Aurora friends,
>
> We have an open source load balancer / proxy called linkerd
> <https://linkerd.io/> that might be of interest to some of you. Similar
> to things like SmartStack's Synapse and marathon-lb, it's a request-level
> load balancer that speaks to service discovery. However, it doesn't require
> process restarts when SD updates. It's built on Finagle, Twitter's
> high-volume RPC library, which means it also can do intelligent things with
> slow and failing servers, connection pooling, etc.
>
> It features pluggable service discovery backends (Zookeeper, Marathon,
> Consul, etcd), and pluggable protocol support (HTTP, thrift and mux).
>
> It's designed as a sort of out-of-process client-side network stack for
> high-volume service communication, but you can also use it as a debug proxy
> or an edge traffic server.
>
> If that sounds interesting, check out linkerd.io for more details, or
> join us on our Slack channel <http://slack.linkerd.io/>. We'll be
> presenting it at ApacheCon <http://sched.co/6OJA> and at MesosCon
> <http://sched.co/6jta> later this month. In the mean time, here's a
> screenshot to whet your appetite:
>
>
>
> Feel free to hit me up with any questions!
>
> -William
>
> --
> Zameer Manji
>
>