You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by ambujhbti <ag...@hawk.iit.edu> on 2015/08/21 04:01:45 UTC
Re: what determine the task size?
cwz wrote
> sorry, my question is not clear.
> I mean what determine the one task size? not how many tasks
one task size= one HDFS block size.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/what-determine-the-task-size-tp24363p24375.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: what determine the task size?
Posted by Robineast <Ro...@xense.co.uk>.
The OP wants to understand what determines the size of the task code that is shipped to each executor so it can run the task. I don't know the answer to but would be interested to know too.
Sent from my iPhone
> On 21 Aug 2015, at 08:26, oubrik [via Apache Spark User List] <ml...@n3.nabble.com> wrote:
>
> Hi
> You mean user code ?
>
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://apache-spark-user-list.1001560.n3.nabble.com/what-determine-the-task-size-tp24363p24380.html
> To start a new topic under Apache Spark User List, email ml-node+s1001560n1h36@n3.nabble.com
> To unsubscribe from Apache Spark User List, click here.
> NAML
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/what-determine-the-task-size-tp24363p24384.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.