You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jason Turim <ja...@signalvine.com> on 2018/03/20 02:03:22 UTC
Question about KIP-107
Hi folks,
My team and I are just getting started with Kafka, and I'm looking for
information about removing individual items in the log. It led me to this
article about implementing GDPR with Kafka
<https://www.confluent.io/blog/handling-gdpr-log-forget/>. That article
links to KIP-107: Add purgeDataBefore() API in AdminClient
<https://cwiki.apache.org/confluence/display/KAFKA/KIP-107%3A+Add+purgeDataBefore%28%29+API+in+AdminClient>.
It looks like the KIP was released in version 0.11
<https://archive.apache.org/dist/kafka/0.11.0.0/RELEASE_NOTES.html> but, I
don't see the method in the AdminClient API documentation
<https://kafka.apache.org/10/javadoc/index.html?org/apache/kafka/clients/admin/AdminClient.html>.
is this feature available?
thanks,
Jason
Re: Question about KIP-107
Posted by Brett Rann <br...@zendesk.com.INVALID>.
Looks to be addressed in 1.1.0 which is currently being voted on for
release:
https://issues.apache.org/jira/browse/KAFKA-5925
------------
The KIP-107
<https://cwiki.apache.org/confluence/display/KAFKA/KIP-107%3A+Add+purgeDataBefore%28%29+API+in+AdminClient>
provides
a way to delete messages starting from a specified offset inside a topic
partition which we don’t want to take anymore so without relying on
time-based and size-based log retention policies. The already implemented
protocol request and response messages (DeleteRecords API, key 21) are used
only by the “legacy” Admin Client in Scala and aren’t provided by the new
Admin Client API in Java.
The KIP-204
<https://cwiki.apache.org/confluence/display/KAFKA/KIP-204+%3A+adding+records+deletion+operation+to+the+new+Admin+Client+API>
is
about addressing this JIRA.
------------
Link to the PR:
https://github.com/apache/kafka/pull/4132/files
And JavaDoc:
https://kafka.apache.org/11/javadoc/org/apache/kafka/clients/admin/DeleteRecordsResult.html
On Tue, Mar 20, 2018 at 1:03 PM, Jason Turim <ja...@signalvine.com> wrote:
> Hi folks,
>
> My team and I are just getting started with Kafka, and I'm looking for
> information about removing individual items in the log. It led me to this
> article about implementing GDPR with Kafka
> <https://www.confluent.io/blog/handling-gdpr-log-forget/
> <https://www.confluent.io/blog/handling-gdpr-log-forget/>>. That article
> links to KIP-107: Add purgeDataBefore() API in AdminClient
> <https://cwiki.apache.org/confluence/display/KAFKA/KIP-107: Add
> purgeDataBefore() API in AdminClient
> <https://cwiki.apache.org/confluence/display/KAFKA/KIP-107: Add purgeDataBefore() API in AdminClient>>.
>
>
> It looks like the KIP was released in version 0.11
> <https://archive.apache.org/dist/kafka/0.11.0.0/RELEASE_NOTES.html
> <https://archive.apache.org/dist/kafka/0.11.0.0/RELEASE_NOTES.html>> but, I
> don't see the method in the AdminClient API documentation
> <https://kafka.apache.org/10/javadoc/index.html?org/apache/
> kafka/clients/admin/AdminClient.html
> <https://kafka.apache.org/10/javadoc/index.html?org/apache/kafka/clients/admin/AdminClient.html>>.
>
>
> is this feature available?
>
> thanks,
> Jason
>
--
Brett Rann
Senior DevOps Engineer
Zendesk International Ltd
395 Collins Street, Melbourne VIC 3000 Australia
Mobile: +61 (0) 418 826 017