You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2014/01/21 23:53:52 UTC
[1/2] git commit: Clarify spark.default.parallelism
Updated Branches:
refs/heads/master f8544981a -> 749f84282
Clarify spark.default.parallelism
It's the task count across the cluster, not per worker, per machine, per core, or anything else.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/069bb942
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/069bb942
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/069bb942
Branch: refs/heads/master
Commit: 069bb94206530a30d095c4920ecfc3b4a8635a72
Parents: f854498
Author: Andrew Ash <an...@andrewash.com>
Authored: Tue Jan 21 14:49:35 2014 -0800
Committer: Andrew Ash <an...@andrewash.com>
Committed: Tue Jan 21 14:49:35 2014 -0800
----------------------------------------------------------------------
docs/configuration.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/069bb942/docs/configuration.md
----------------------------------------------------------------------
diff --git a/docs/configuration.md b/docs/configuration.md
index be548e3..3bb6550 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -98,7 +98,7 @@ Apart from these, the following properties are also available, and may be useful
<td>spark.default.parallelism</td>
<td>8</td>
<td>
- Default number of tasks to use for distributed shuffle operations (<code>groupByKey</code>,
+ Default number of tasks to use across the cluster for distributed shuffle operations (<code>groupByKey</code>,
<code>reduceByKey</code>, etc) when not set by user.
</td>
</tr>
[2/2] git commit: Merge pull request #489 from ash211/patch-6
Posted by rx...@apache.org.
Merge pull request #489 from ash211/patch-6
Clarify spark.default.parallelism
It's the task count across the cluster, not per worker, per machine, per core, or anything else.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/749f8428
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/749f8428
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/749f8428
Branch: refs/heads/master
Commit: 749f842827c7e7766a342b6b0a437803044a9f90
Parents: f854498 069bb94
Author: Reynold Xin <rx...@apache.org>
Authored: Tue Jan 21 14:53:49 2014 -0800
Committer: Reynold Xin <rx...@apache.org>
Committed: Tue Jan 21 14:53:49 2014 -0800
----------------------------------------------------------------------
docs/configuration.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------