You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by cw...@apache.org on 2019/09/11 07:15:56 UTC
[incubator-druid-website-src] branch 0.16.0-incubating updated:
updated kafka docs
This is an automated email from the ASF dual-hosted git repository.
cwylie pushed a commit to branch 0.16.0-incubating
in repository https://gitbox.apache.org/repos/asf/incubator-druid-website-src.git
The following commit(s) were added to refs/heads/0.16.0-incubating by this push:
new 72cf198 updated kafka docs
72cf198 is described below
commit 72cf198ec2db73fc50ecf6ce9e41fd59b597c64f
Author: Clint Wylie <cw...@apache.org>
AuthorDate: Wed Sep 11 00:15:42 2019 -0700
updated kafka docs
---
.../development/extensions-core/kafka-ingestion.html | 11 ++++++-----
docs/latest/development/extensions-core/kafka-ingestion.html | 11 ++++++-----
2 files changed, 12 insertions(+), 10 deletions(-)
diff --git a/docs/0.16.0-incubating/development/extensions-core/kafka-ingestion.html b/docs/0.16.0-incubating/development/extensions-core/kafka-ingestion.html
index bcef6ec..4be7dc0 100644
--- a/docs/0.16.0-incubating/development/extensions-core/kafka-ingestion.html
+++ b/docs/0.16.0-incubating/development/extensions-core/kafka-ingestion.html
@@ -81,14 +81,15 @@
Kafka by managing the creation and lifetime of Kafka indexing tasks. These indexing tasks read events using Kafka's own
partition and offset mechanism and are therefore able to provide guarantees of exactly-once ingestion. They are also
able to read non-recent events from Kafka and are not subject to the window period considerations imposed on other
-ingestion mechanisms using Tranquility. The supervisor oversees the state of the indexing tasks to coordinate handoffs, manage failures,
-and ensure that the scalability and replication requirements are maintained.</p>
+ingestion mechanisms using Tranquility. The supervisor oversees the state of the indexing tasks to coordinate handoffs,
+manage failures, and ensure that the scalability and replication requirements are maintained.</p>
<p>This service is provided in the <code>druid-kafka-indexing-service</code> core Apache Druid (incubating) extension (see
<a href="/docs/0.16.0-incubating/development/extensions.html#loading-extensions">Including Extensions</a>).</p>
<blockquote>
-<p>The Kafka indexing service uses the Java consumer that was introduced in Kafka 0.10.x. As there were protocol changes
-made in this version, Kafka 0.10.x consumers might not be compatible with older brokers. Ensure that your Kafka brokers are
-version 0.10.x or better before using this functionality. Refer <a href="https://kafka.apache.org/documentation/#upgrade">Kafka upgrade guide</a> if you are using older version of Kafka brokers.</p>
+<p>The Kafka indexing service supports transactional topics which were introduced in Kafka 0.11.x. These changes make the
+Kafka consumer that Druid uses incompatible with older brokers. Ensure that your Kafka brokers are version 0.11.x or
+better before using this functionality. Refer <a href="https://kafka.apache.org/documentation/#upgrade">Kafka upgrade guide</a>
+if you are using older version of Kafka brokers.</p>
</blockquote>
<h2><a class="anchor" aria-hidden="true" id="tutorial"></a><a href="#tutorial" aria-hidden="true" class="hash-link"><svg class="hash-link-icon" aria-hidden="true" height="16" version="1.1" viewBox="0 0 16 16" width="16"><path fill-rule="evenodd" d="M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 [...]
<p>This page contains reference documentation for Apache Kafka-based ingestion.
diff --git a/docs/latest/development/extensions-core/kafka-ingestion.html b/docs/latest/development/extensions-core/kafka-ingestion.html
index 16ef6ac..81640e1 100644
--- a/docs/latest/development/extensions-core/kafka-ingestion.html
+++ b/docs/latest/development/extensions-core/kafka-ingestion.html
@@ -81,14 +81,15 @@
Kafka by managing the creation and lifetime of Kafka indexing tasks. These indexing tasks read events using Kafka's own
partition and offset mechanism and are therefore able to provide guarantees of exactly-once ingestion. They are also
able to read non-recent events from Kafka and are not subject to the window period considerations imposed on other
-ingestion mechanisms using Tranquility. The supervisor oversees the state of the indexing tasks to coordinate handoffs, manage failures,
-and ensure that the scalability and replication requirements are maintained.</p>
+ingestion mechanisms using Tranquility. The supervisor oversees the state of the indexing tasks to coordinate handoffs,
+manage failures, and ensure that the scalability and replication requirements are maintained.</p>
<p>This service is provided in the <code>druid-kafka-indexing-service</code> core Apache Druid (incubating) extension (see
<a href="/docs/latest/development/extensions.html#loading-extensions">Including Extensions</a>).</p>
<blockquote>
-<p>The Kafka indexing service uses the Java consumer that was introduced in Kafka 0.10.x. As there were protocol changes
-made in this version, Kafka 0.10.x consumers might not be compatible with older brokers. Ensure that your Kafka brokers are
-version 0.10.x or better before using this functionality. Refer <a href="https://kafka.apache.org/documentation/#upgrade">Kafka upgrade guide</a> if you are using older version of Kafka brokers.</p>
+<p>The Kafka indexing service supports transactional topics which were introduced in Kafka 0.11.x. These changes make the
+Kafka consumer that Druid uses incompatible with older brokers. Ensure that your Kafka brokers are version 0.11.x or
+better before using this functionality. Refer <a href="https://kafka.apache.org/documentation/#upgrade">Kafka upgrade guide</a>
+if you are using older version of Kafka brokers.</p>
</blockquote>
<h2><a class="anchor" aria-hidden="true" id="tutorial"></a><a href="#tutorial" aria-hidden="true" class="hash-link"><svg class="hash-link-icon" aria-hidden="true" height="16" version="1.1" viewBox="0 0 16 16" width="16"><path fill-rule="evenodd" d="M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 [...]
<p>This page contains reference documentation for Apache Kafka-based ingestion.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org