You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by "Ruebenacker, Oliver A" <Ol...@altisource.com> on 2014/09/04 00:12:41 UTC
If master is local, where are master and workers?
Hello,
If launched with "local" as master, where are master and workers? Do they each have a web UI? How can they be monitored?
Thanks!
Best,
Oliver
Oliver Ruebenacker | Solutions Architect
Altisource(tm)
290 Congress St, 7th Floor | Boston, Massachusetts 02210
P: (617) 728-5582 | ext: 275585
Oliver.Ruebenacker@Altisource.com<ma...@Altisource.com> | www.Altisource.com
***********************************************************************************************************************
This email message and any attachments are intended solely for the use of the addressee. If you are not the intended recipient, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. If you have received this message in error, please promptly notify the sender by reply email and immediately delete this message from your system. This message and any attachments may contain information that is confidential, privileged or exempt from disclosure. Delivery of this message to any person other than the intended recipient is not intended to waive any right or privilege. Message transmission is not guaranteed to be secure or free of software viruses.
***********************************************************************************************************************
Re: If master is local, where are master and workers?
Posted by Marcelo Vanzin <va...@cloudera.com>.
The only monitoring available is the driver's Web UI, which will
generally be available on port 4040.
On Wed, Sep 3, 2014 at 3:43 PM, Ruebenacker, Oliver A
<Ol...@altisource.com> wrote:
> How can that single process be monitored? Thanks!
>
> -----Original Message-----
> From: Marcelo Vanzin [mailto:vanzin@cloudera.com]
> Sent: Wednesday, September 03, 2014 6:32 PM
> To: Ruebenacker, Oliver A
> Cc: user@spark.apache.org
> Subject: Re: If master is local, where are master and workers?
>
> "local" means everything runs in the same process; that means there is no need for "master" and "worker" daemons to start processes.
>
> On Wed, Sep 3, 2014 at 3:12 PM, Ruebenacker, Oliver A <Ol...@altisource.com> wrote:
>>
>>
>> Hello,
>>
>>
>>
>> If launched with “local” as master, where are master and workers? Do
>> they each have a web UI? How can they be monitored?
>>
>>
>>
>> Thanks!
>>
>>
>>
>> Best,
>>
>> Oliver
>>
>>
>>
>> Oliver Ruebenacker | Solutions Architect
>>
>>
>>
>> Altisource™
>>
>> 290 Congress St, 7th Floor | Boston, Massachusetts 02210
>>
>> P: (617) 728-5582 | ext: 275585
>>
>> Oliver.Ruebenacker@Altisource.com | www.Altisource.com
>>
>>
>>
>> **********************************************************************
>> *************************************************
>>
>> This email message and any attachments are intended solely for the use
>> of the addressee. If you are not the intended recipient, you are
>> prohibited from reading, disclosing, reproducing, distributing,
>> disseminating or otherwise using this transmission. If you have
>> received this message in error, please promptly notify the sender by
>> reply email and immediately delete this message from your system.
>>
>> This message and any attachments may contain information that is
>> confidential, privileged or exempt from disclosure. Delivery of this
>> message to any person other than the intended recipient is not
>> intended to waive any right or privilege. Message transmission is not
>> guaranteed to be secure or free of software viruses.
>> **********************************************************************
>> *************************************************
>
>
>
> --
> Marcelo
> ***********************************************************************************************************************
>
> This email message and any attachments are intended solely for the use of the addressee. If you are not the intended recipient, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. If you have received this message in error, please promptly notify the sender by reply email and immediately delete this message from your system. This message and any attachments may contain information that is confidential, privileged or exempt from disclosure. Delivery of this message to any person other than the intended recipient is not intended to waive any right or privilege. Message transmission is not guaranteed to be secure or free of software viruses.
> ***********************************************************************************************************************
--
Marcelo
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
RE: If master is local, where are master and workers?
Posted by "Ruebenacker, Oliver A" <Ol...@altisource.com>.
How can that single process be monitored? Thanks!
-----Original Message-----
From: Marcelo Vanzin [mailto:vanzin@cloudera.com]
Sent: Wednesday, September 03, 2014 6:32 PM
To: Ruebenacker, Oliver A
Cc: user@spark.apache.org
Subject: Re: If master is local, where are master and workers?
"local" means everything runs in the same process; that means there is no need for "master" and "worker" daemons to start processes.
On Wed, Sep 3, 2014 at 3:12 PM, Ruebenacker, Oliver A <Ol...@altisource.com> wrote:
>
>
> Hello,
>
>
>
> If launched with “local” as master, where are master and workers? Do
> they each have a web UI? How can they be monitored?
>
>
>
> Thanks!
>
>
>
> Best,
>
> Oliver
>
>
>
> Oliver Ruebenacker | Solutions Architect
>
>
>
> Altisource™
>
> 290 Congress St, 7th Floor | Boston, Massachusetts 02210
>
> P: (617) 728-5582 | ext: 275585
>
> Oliver.Ruebenacker@Altisource.com | www.Altisource.com
>
>
>
> **********************************************************************
> *************************************************
>
> This email message and any attachments are intended solely for the use
> of the addressee. If you are not the intended recipient, you are
> prohibited from reading, disclosing, reproducing, distributing,
> disseminating or otherwise using this transmission. If you have
> received this message in error, please promptly notify the sender by
> reply email and immediately delete this message from your system.
>
> This message and any attachments may contain information that is
> confidential, privileged or exempt from disclosure. Delivery of this
> message to any person other than the intended recipient is not
> intended to waive any right or privilege. Message transmission is not
> guaranteed to be secure or free of software viruses.
> **********************************************************************
> *************************************************
--
Marcelo
***********************************************************************************************************************
This email message and any attachments are intended solely for the use of the addressee. If you are not the intended recipient, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. If you have received this message in error, please promptly notify the sender by reply email and immediately delete this message from your system. This message and any attachments may contain information that is confidential, privileged or exempt from disclosure. Delivery of this message to any person other than the intended recipient is not intended to waive any right or privilege. Message transmission is not guaranteed to be secure or free of software viruses.
***********************************************************************************************************************
Re: If master is local, where are master and workers?
Posted by Marcelo Vanzin <va...@cloudera.com>.
"local" means everything runs in the same process; that means there is
no need for "master" and "worker" daemons to start processes.
On Wed, Sep 3, 2014 at 3:12 PM, Ruebenacker, Oliver A
<Ol...@altisource.com> wrote:
>
>
> Hello,
>
>
>
> If launched with “local” as master, where are master and workers? Do they
> each have a web UI? How can they be monitored?
>
>
>
> Thanks!
>
>
>
> Best,
>
> Oliver
>
>
>
> Oliver Ruebenacker | Solutions Architect
>
>
>
> Altisource™
>
> 290 Congress St, 7th Floor | Boston, Massachusetts 02210
>
> P: (617) 728-5582 | ext: 275585
>
> Oliver.Ruebenacker@Altisource.com | www.Altisource.com
>
>
>
> ***********************************************************************************************************************
>
> This email message and any attachments are intended solely for the use of
> the addressee. If you are not the intended recipient, you are prohibited
> from reading, disclosing, reproducing, distributing, disseminating or
> otherwise using this transmission. If you have received this message in
> error, please promptly notify the sender by reply email and immediately
> delete this message from your system.
>
> This message and any attachments may contain information that is
> confidential, privileged or exempt from disclosure. Delivery of this message
> to any person other than the intended recipient is not intended to waive any
> right or privilege. Message transmission is not guaranteed to be secure or
> free of software viruses.
> ***********************************************************************************************************************
--
Marcelo
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org