You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2015/05/03 00:41:20 UTC
spark git commit: [SPARK-7255] [STREAMING] [DOCUMENTATION] Added
documentation for spark.streaming.kafka.maxRetries
Repository: spark
Updated Branches:
refs/heads/master 5d6b90d93 -> ea841efc5
[SPARK-7255] [STREAMING] [DOCUMENTATION] Added documentation for spark.streaming.kafka.maxRetries
Added documentation for spark.streaming.kafka.maxRetries
Author: BenFradet <be...@gmail.com>
Closes #5808 from BenFradet/master and squashes the following commits:
cc72e7a [BenFradet] updated doc for spark.streaming.kafka.maxRetries to explain the default value
18f823e [BenFradet] Added "consecutive" to the spark.streaming.kafka.maxRetries doc
597fdeb [BenFradet] Mention that spark.streaming.kafka.maxRetries only applies to the direct kafka api
0efad39 [BenFradet] Added documentation for spark.streaming.kafka.maxRetries
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ea841efc
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ea841efc
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ea841efc
Branch: refs/heads/master
Commit: ea841efc5a67e9a64a4ec803d31e4023b565c327
Parents: 5d6b90d
Author: BenFradet <be...@gmail.com>
Authored: Sat May 2 23:41:14 2015 +0100
Committer: Sean Owen <so...@cloudera.com>
Committed: Sat May 2 23:41:14 2015 +0100
----------------------------------------------------------------------
docs/configuration.md | 10 ++++++++++
1 file changed, 10 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/ea841efc/docs/configuration.md
----------------------------------------------------------------------
diff --git a/docs/configuration.md b/docs/configuration.md
index 7239b25..64066bc 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -1464,6 +1464,16 @@ Apart from these, the following properties are also available, and may be useful
for more details.
</td>
</tr>
+<tr>
+ <td><code>spark.streaming.kafka.maxRetries</code></td>
+ <td>1</td>
+ <td>
+ Maximum number of consecutive retries the driver will make in order to find
+ the latest offsets on the leader of each partition (a default value of 1
+ means that the driver will make a maximum of 2 attempts). Only applies to
+ the new Kafka direct stream API.
+ </td>
+</tr>
</table>
#### Cluster Managers
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org