You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Andrew Ash <an...@andrewash.com> on 2014/01/03 07:39:33 UTC
Terminology: "worker" vs "slave"
The terms worker and slave seem to be used interchangeably. Are they the
same?
Worker is used more frequently in the codebase:
aash@aash-mbp ~/git/spark$ git grep -i worker | wc -l
981
aash@aash-mbp ~/git/spark$ git grep -i slave | wc -l
348
aash@aash-mbp ~/git/spark$
Does it make sense to unify on one or the other?
Re: Terminology: "worker" vs "slave"
Posted by Henry Saputra <he...@gmail.com>.
+1 for worker =)
On Thu, Jan 2, 2014 at 10:45 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Ya we've been trying to standardize on the terminology here (see glossary):
>
> http://spark.incubator.apache.org/docs/latest/cluster-overview.html
>
> I think "slave" actually isn't mentioned here at all - but references
> to slave in the codebase are synonymous with "worker".
>
> - Patrick
>
> On Thu, Jan 2, 2014 at 10:42 PM, Reynold Xin <rx...@databricks.com> wrote:
>> It is historic.
>>
>> I think we are converging towards
>>
>> worker: the "slave" daemon in the standalone cluster manager
>>
>> executor: the jvm process that is launched by the worker that executes tasks
>>
>>
>>
>> On Thu, Jan 2, 2014 at 10:39 PM, Andrew Ash <an...@andrewash.com> wrote:
>>
>>> The terms worker and slave seem to be used interchangeably. Are they the
>>> same?
>>>
>>> Worker is used more frequently in the codebase:
>>>
>>> aash@aash-mbp ~/git/spark$ git grep -i worker | wc -l
>>> 981
>>> aash@aash-mbp ~/git/spark$ git grep -i slave | wc -l
>>> 348
>>> aash@aash-mbp ~/git/spark$
>>>
>>> Does it make sense to unify on one or the other?
>>>
Re: Terminology: "worker" vs "slave"
Posted by Andrew Ash <an...@andrewash.com>.
That matches my mental model -- glad to hear we're converging on one though
for consistency.
Thanks guys!
On Fri, Jan 3, 2014 at 1:45 AM, Patrick Wendell <pw...@gmail.com> wrote:
> Ya we've been trying to standardize on the terminology here (see glossary):
>
> http://spark.incubator.apache.org/docs/latest/cluster-overview.html
>
> I think "slave" actually isn't mentioned here at all - but references
> to slave in the codebase are synonymous with "worker".
>
> - Patrick
>
> On Thu, Jan 2, 2014 at 10:42 PM, Reynold Xin <rx...@databricks.com> wrote:
> > It is historic.
> >
> > I think we are converging towards
> >
> > worker: the "slave" daemon in the standalone cluster manager
> >
> > executor: the jvm process that is launched by the worker that executes
> tasks
> >
> >
> >
> > On Thu, Jan 2, 2014 at 10:39 PM, Andrew Ash <an...@andrewash.com>
> wrote:
> >
> >> The terms worker and slave seem to be used interchangeably. Are they
> the
> >> same?
> >>
> >> Worker is used more frequently in the codebase:
> >>
> >> aash@aash-mbp ~/git/spark$ git grep -i worker | wc -l
> >> 981
> >> aash@aash-mbp ~/git/spark$ git grep -i slave | wc -l
> >> 348
> >> aash@aash-mbp ~/git/spark$
> >>
> >> Does it make sense to unify on one or the other?
> >>
>
Re: Terminology: "worker" vs "slave"
Posted by Patrick Wendell <pw...@gmail.com>.
Ya we've been trying to standardize on the terminology here (see glossary):
http://spark.incubator.apache.org/docs/latest/cluster-overview.html
I think "slave" actually isn't mentioned here at all - but references
to slave in the codebase are synonymous with "worker".
- Patrick
On Thu, Jan 2, 2014 at 10:42 PM, Reynold Xin <rx...@databricks.com> wrote:
> It is historic.
>
> I think we are converging towards
>
> worker: the "slave" daemon in the standalone cluster manager
>
> executor: the jvm process that is launched by the worker that executes tasks
>
>
>
> On Thu, Jan 2, 2014 at 10:39 PM, Andrew Ash <an...@andrewash.com> wrote:
>
>> The terms worker and slave seem to be used interchangeably. Are they the
>> same?
>>
>> Worker is used more frequently in the codebase:
>>
>> aash@aash-mbp ~/git/spark$ git grep -i worker | wc -l
>> 981
>> aash@aash-mbp ~/git/spark$ git grep -i slave | wc -l
>> 348
>> aash@aash-mbp ~/git/spark$
>>
>> Does it make sense to unify on one or the other?
>>
Re: Terminology: "worker" vs "slave"
Posted by Reynold Xin <rx...@databricks.com>.
It is historic.
I think we are converging towards
worker: the "slave" daemon in the standalone cluster manager
executor: the jvm process that is launched by the worker that executes tasks
On Thu, Jan 2, 2014 at 10:39 PM, Andrew Ash <an...@andrewash.com> wrote:
> The terms worker and slave seem to be used interchangeably. Are they the
> same?
>
> Worker is used more frequently in the codebase:
>
> aash@aash-mbp ~/git/spark$ git grep -i worker | wc -l
> 981
> aash@aash-mbp ~/git/spark$ git grep -i slave | wc -l
> 348
> aash@aash-mbp ~/git/spark$
>
> Does it make sense to unify on one or the other?
>