You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "showuon (via GitHub)" <gi...@apache.org> on 2024/08/08 13:20:30 UTC
[PR] KAFKA-17300: add document for disabling tiered storage at topic level [kafka]
showuon opened a new pull request, #16836:
URL: https://github.com/apache/kafka/pull/16836
The updated doc looks like this:
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for new tiered storage feature in v3.9.0. [kafka]
Posted by "kamalcph (via GitHub)" <gi...@apache.org>.
kamalcph commented on code in PR #16836:
URL: https://github.com/apache/kafka/pull/16836#discussion_r1714980756
##########
docs/ops.html:
##########
@@ -4316,7 +4316,28 @@ <h4 class="anchor-heading"><a id="tiered_storage_config_ex" class="anchor-link">
<pre><code class="language-bash">$ bin/kafka-console-consumer.sh --topic tieredTopic --from-beginning --max-messages 1 --bootstrap-server localhost:9092 --property print.offset=true</code></pre>
-<p>Please note, if you want to disable tiered storage at the cluster level, you should delete the tiered storage enabled topics explicitly.
+<p>In KRaft mode, you can disable tiered storage at the topic level, to make the remote logs as read-only logs, or completely delete all remote logs.</p>
+
+<p>If you want to let the remote logs become read-only and no more local logs copied to the remote storage,
+ you can set <code>remote.storage.enable=true,remote.log.copy.disable=true</code> to the topic.</p>
Review Comment:
```suggestion
you can set <code>remote.storage.enable=true,remote.log.copy.disable=true,local.retention.ms=-2,local.retention.bytes=-2</code>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for new tiered storage feature in v3.9.0. [kafka]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd merged PR #16836:
URL: https://github.com/apache/kafka/pull/16836
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for disabling tiered storage at topic level [kafka]
Posted by "showuon (via GitHub)" <gi...@apache.org>.
showuon commented on PR #16836:
URL: https://github.com/apache/kafka/pull/16836#issuecomment-2283827469
@abhijeetk88 @satishd @kamalcph @clolov , in the document update PR, I added:
1. Added document for disabling tiered storage at topic level
2. Added a notable change item in v3.9.0 for tiered storage quota.
3. Added a notable change item in v3.9.0 for making tiered storage feature as a general availability feature.
Please take a look when available. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for new tiered storage feature in v3.9.0. [kafka]
Posted by "abhijeetk88 (via GitHub)" <gi...@apache.org>.
abhijeetk88 commented on PR #16836:
URL: https://github.com/apache/kafka/pull/16836#issuecomment-2284115795
LGTM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for new tiered storage feature in v3.9.0. [kafka]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on PR #16836:
URL: https://github.com/apache/kafka/pull/16836#issuecomment-2286075546
A couple of unrelated test failures are observed in CI jobs. merging it to trunk.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for disabling tiered storage at topic level [kafka]
Posted by "showuon (via GitHub)" <gi...@apache.org>.
showuon commented on PR #16836:
URL: https://github.com/apache/kafka/pull/16836#issuecomment-2275812012
@kamalcph @satishd @clolov , document PR. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for disabling tiered storage at topic level [kafka]
Posted by "satishd (via GitHub)" <gi...@apache.org>.
satishd commented on code in PR #16836:
URL: https://github.com/apache/kafka/pull/16836#discussion_r1712850310
##########
docs/ops.html:
##########
@@ -4316,7 +4316,26 @@ <h4 class="anchor-heading"><a id="tiered_storage_config_ex" class="anchor-link">
<pre><code class="language-bash">$ bin/kafka-console-consumer.sh --topic tieredTopic --from-beginning --max-messages 1 --bootstrap-server localhost:9092 --property print.offset=true</code></pre>
-<p>Please note, if you want to disable tiered storage at the cluster level, you should delete the tiered storage enabled topics explicitly.
+<p>If you want to disable tiered storage at the topic level to let the remote logs become read-only and no more local logs copied to the remote storage,
Review Comment:
Please clarify that the disablement feature is available only with KRaft.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for disabling tiered storage at topic level [kafka]
Posted by "showuon (via GitHub)" <gi...@apache.org>.
showuon commented on code in PR #16836:
URL: https://github.com/apache/kafka/pull/16836#discussion_r1713241423
##########
docs/ops.html:
##########
@@ -4316,7 +4316,26 @@ <h4 class="anchor-heading"><a id="tiered_storage_config_ex" class="anchor-link">
<pre><code class="language-bash">$ bin/kafka-console-consumer.sh --topic tieredTopic --from-beginning --max-messages 1 --bootstrap-server localhost:9092 --property print.offset=true</code></pre>
-<p>Please note, if you want to disable tiered storage at the cluster level, you should delete the tiered storage enabled topics explicitly.
+<p>If you want to disable tiered storage at the topic level to let the remote logs become read-only and no more local logs copied to the remote storage,
Review Comment:
Oh, good catch! Updated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-17300: add document for new tiered storage feature in v3.9.0. [kafka]
Posted by "kamalcph (via GitHub)" <gi...@apache.org>.
kamalcph commented on code in PR #16836:
URL: https://github.com/apache/kafka/pull/16836#discussion_r1714980756
##########
docs/ops.html:
##########
@@ -4316,7 +4316,28 @@ <h4 class="anchor-heading"><a id="tiered_storage_config_ex" class="anchor-link">
<pre><code class="language-bash">$ bin/kafka-console-consumer.sh --topic tieredTopic --from-beginning --max-messages 1 --bootstrap-server localhost:9092 --property print.offset=true</code></pre>
-<p>Please note, if you want to disable tiered storage at the cluster level, you should delete the tiered storage enabled topics explicitly.
+<p>In KRaft mode, you can disable tiered storage at the topic level, to make the remote logs as read-only logs, or completely delete all remote logs.</p>
+
+<p>If you want to let the remote logs become read-only and no more local logs copied to the remote storage,
+ you can set <code>remote.storage.enable=true,remote.log.copy.disable=true</code> to the topic.</p>
Review Comment:
```suggestion
you can set <code>remote.storage.enable=true,remote.log.copy.disable=true,local.retention.ms=-2,local.retention.bytes=-2</code>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org