You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by nizang <ni...@windward.eu> on 2015/06/23 08:18:28 UTC
Spark standalone cluster - resource management
hi,
I'm running spark standalone cluster with 5 slaves, each has 4 cores. When I
run job with the following configuration:
/root/spark/bin/spark-submit -v --total-executor-cores 20
--executor-memory 22g --executor-cores 4 --class
com.windward.spark.apps.MyApp --name dev-app --properties-file
/mnt/spark-apps/apps/dev/my-app/app.properties
/mnt/spark-apps/apps/dev/my-app/my-app-1.0-SNAPSHOT-jar-with-dependencies.jar
201401010000 201401030000
everything runs fine (total-executor-cores=20 -> I set it to all the cores I
have 4*5)
If I run it with the following configuration:
/root/spark/bin/spark-submit -v --total-executor-cores 4 --executor-memory
22g --executor-cores 4 --class com.windward.spark.apps.MyApp --name
dev-app --properties-file /mnt/spark-apps/apps/dev/my-app/app.properties
/mnt/spark-apps/apps/dev/my-app/my-app-1.0-SNAPSHOT-jar-with-dependencies.jar
201401010000 201401030000
(I set total-executor-cores=4. because I want to use only small part of my
cluster for that task), I get the following message:
org.apache.spark.scheduler.TaskSchedulerImpl- Initial job has not accepted
any resources; check your cluster UI to ensure that workers are registered
and have sufficient resources
Can't I tell spark to use only part of my cores for specific task? I need it
if I want to run many tasks in parallel
thanks, nizan
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-standalone-cluster-resource-management-tp23444.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Spark standalone cluster - resource management
Posted by canan chen <cc...@gmail.com>.
Check the available resources you have (cpu cores & memory ) on master web
ui.
The log you see means the job can't get any resources.
On Wed, Jun 24, 2015 at 5:03 AM, Nizan Grauer <ni...@windward.eu> wrote:
> I'm having 30G per machine
>
> This is the first (and only) job I'm trying to submit. So it's weird that
> for --total-executor-cores=20 it works, and for --total-executor-cores=4
> it doesn't
>
> On Tue, Jun 23, 2015 at 10:46 PM, Igor Berman <ig...@gmail.com>
> wrote:
>
>> probably there are already running jobs there
>> in addition, memory is also a resource, so if you are running 1
>> application that took all your memory and then you are trying to run
>> another application that asks
>> for the memory the cluster doesn't have then the second app wont be
>> running
>>
>> so why are u specifying 22g as executor memory? how much memory you have
>> for each machine?
>>
>> On 23 June 2015 at 09:33, nizang <ni...@windward.eu> wrote:
>>
>>> to give a bit more data on what I'm trying to get -
>>>
>>> I have many tasks I want to run in parallel, so I want each task to catch
>>> small part of the cluster (-> only limited part of my 20 cores in the
>>> cluster)
>>>
>>> I have important tasks that I want them to get 10 cores, and I have small
>>> tasks that I want to run with only 1 or 2 cores)
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-standalone-cluster-resource-management-tp23444p23445.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>>
>
Re: Spark standalone cluster - resource management
Posted by Nizan Grauer <ni...@windward.eu>.
I'm having 30G per machine
This is the first (and only) job I'm trying to submit. So it's weird that
for --total-executor-cores=20 it works, and for --total-executor-cores=4 it
doesn't
On Tue, Jun 23, 2015 at 10:46 PM, Igor Berman <ig...@gmail.com> wrote:
> probably there are already running jobs there
> in addition, memory is also a resource, so if you are running 1
> application that took all your memory and then you are trying to run
> another application that asks
> for the memory the cluster doesn't have then the second app wont be running
>
> so why are u specifying 22g as executor memory? how much memory you have
> for each machine?
>
> On 23 June 2015 at 09:33, nizang <ni...@windward.eu> wrote:
>
>> to give a bit more data on what I'm trying to get -
>>
>> I have many tasks I want to run in parallel, so I want each task to catch
>> small part of the cluster (-> only limited part of my 20 cores in the
>> cluster)
>>
>> I have important tasks that I want them to get 10 cores, and I have small
>> tasks that I want to run with only 1 or 2 cores)
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-standalone-cluster-resource-management-tp23444p23445.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>
Re: Spark standalone cluster - resource management
Posted by Igor Berman <ig...@gmail.com>.
probably there are already running jobs there
in addition, memory is also a resource, so if you are running 1 application
that took all your memory and then you are trying to run another
application that asks
for the memory the cluster doesn't have then the second app wont be running
so why are u specifying 22g as executor memory? how much memory you have
for each machine?
On 23 June 2015 at 09:33, nizang <ni...@windward.eu> wrote:
> to give a bit more data on what I'm trying to get -
>
> I have many tasks I want to run in parallel, so I want each task to catch
> small part of the cluster (-> only limited part of my 20 cores in the
> cluster)
>
> I have important tasks that I want them to get 10 cores, and I have small
> tasks that I want to run with only 1 or 2 cores)
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-standalone-cluster-resource-management-tp23444p23445.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
Re: Spark standalone cluster - resource management
Posted by nizang <ni...@windward.eu>.
to give a bit more data on what I'm trying to get -
I have many tasks I want to run in parallel, so I want each task to catch
small part of the cluster (-> only limited part of my 20 cores in the
cluster)
I have important tasks that I want them to get 10 cores, and I have small
tasks that I want to run with only 1 or 2 cores)
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-standalone-cluster-resource-management-tp23444p23445.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org