You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gobblin.apache.org by ku...@apache.org on 2020/03/31 17:05:49 UTC
[incubator-gobblin] branch master updated: [GOBBLIN-1102] Add link
to GIP[]
This is an automated email from the ASF dual-hosted git repository.
kuyu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git
The following commit(s) were added to refs/heads/master by this push:
new 7b9c7cb [GOBBLIN-1102] Add link to GIP[]
7b9c7cb is described below
commit 7b9c7cbbff76c6963576846b81bfdae8ced4ba22
Author: vbohra <vb...@linkedin.com>
AuthorDate: Tue Mar 31 10:05:40 2020 -0700
[GOBBLIN-1102] Add link to GIP[]
Closes #2943 from vikrambohra/GOBBLIN-1102
---
gobblin-docs/developer-guide/HighLevelConsumer.md | 2 ++
1 file changed, 2 insertions(+)
diff --git a/gobblin-docs/developer-guide/HighLevelConsumer.md b/gobblin-docs/developer-guide/HighLevelConsumer.md
index 3f229b7..e2799b9 100644
--- a/gobblin-docs/developer-guide/HighLevelConsumer.md
+++ b/gobblin-docs/developer-guide/HighLevelConsumer.md
@@ -6,6 +6,8 @@ Problem Statement
Current Gobblin Kafka [`High Level Consumer`](https://github.com/apache/incubator-gobblin/blob/master/gobblin-runtime/src/main/java/org/apache/gobblin/runtime/kafka/HighLevelConsumer.java) uses Kafka Consumer (0.8) APIs and gobblin support for them will be deprecated. The Re-design's primary goal is to replace old kafka consumer APIs like [`ConsumerConnector`](https://archive.apache.org/dist/kafka/0.8.2.2/scaladoc/index.html#kafka.consumer.ConsumerConnector) and [`MessageAndMetadata`](ht [...]
Additionally, the old design uses kafka auto commit feature which can cause potential loss of messages when offsets are committed and the system fails before messages are processed.
+Detailed design and implementation details can be found [here](https://cwiki.apache.org/confluence/display/GOBBLIN/GIP+5%3A+High+Level+Consumer+Re-design)
+
New Design & Details
====================