You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by danilopds <da...@gmail.com> on 2014/09/24 22:12:13 UTC
Question About Submit Application
Hello,
I'm learning about Spark Streaming and I'm really excited.
Today I was testing to package some apps and send them in a Standalone
cluster in my computer locally.
It occurred ok.
So,
I created one Virtual Machine with network bridge and I tried to send again
the app to this VM from my local PC.
But I had some errors, like these:
WARN AppClient$ClientActor: Could not connect to
akka.tcp://sparkMaster@spark-01:7077:
akka.remote.EndpointAssociationException: Association failed with
[akka.tcp://sparkMaster@spark-01:7077]
14/09/24 16:28:48 WARN TaskSchedulerImpl: Initial job has not accepted any
resources; check your cluster UI to ensure that workers are registered and
have sufficient memory
Can I submit an application from another computer to a remote master with
workers?
Anybody suggest something?
Thanks a lot.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Question-About-Submit-Application-tp15072.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Question About Submit Application
Posted by danilopds <da...@gmail.com>.
One more information..
When I submit the application from my local PC to my VM,
This VM was the master and worker and my local PC wasn't part of the
cluster.
Thanks.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Question-About-Submit-Application-tp15072p15076.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Question About Submit Application
Posted by danilopds <da...@gmail.com>.
I'll do this test and after I reply the result.
Thank you Marcelo.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Question-About-Submit-Application-tp15072p15539.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Question About Submit Application
Posted by Marcelo Vanzin <va...@cloudera.com>.
Then I think it's time for you to look at the Spark Master logs...
On Thu, Sep 25, 2014 at 7:51 AM, danilopds <da...@gmail.com> wrote:
> Hi Marcelo,
>
> Yes, I can ping "spark-01" and I also include the IP and host in my file
> /etc/hosts.
> My VM can ping the local machine too.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Question-About-Submit-Application-tp15072p15145.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
--
Marcelo
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Question About Submit Application
Posted by danilopds <da...@gmail.com>.
Hi Marcelo,
Yes, I can ping "spark-01" and I also include the IP and host in my file
/etc/hosts.
My VM can ping the local machine too.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Question-About-Submit-Application-tp15072p15145.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Question About Submit Application
Posted by Marcelo Vanzin <va...@cloudera.com>.
Sounds like "spark-01" is not resolving correctly on your machine (or
is the wrong address). Can you ping "spark-01" and does that reach the
VM where you set up the Spark Master?
On Wed, Sep 24, 2014 at 1:12 PM, danilopds <da...@gmail.com> wrote:
> Hello,
> I'm learning about Spark Streaming and I'm really excited.
> Today I was testing to package some apps and send them in a Standalone
> cluster in my computer locally.
> It occurred ok.
>
> So,
> I created one Virtual Machine with network bridge and I tried to send again
> the app to this VM from my local PC.
>
> But I had some errors, like these:
> WARN AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@spark-01:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@spark-01:7077]
> 14/09/24 16:28:48 WARN TaskSchedulerImpl: Initial job has not accepted any
> resources; check your cluster UI to ensure that workers are registered and
> have sufficient memory
>
> Can I submit an application from another computer to a remote master with
> workers?
> Anybody suggest something?
>
> Thanks a lot.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Question-About-Submit-Application-tp15072.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
--
Marcelo
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org