You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Sergei Morozov (Jira)" <ji...@apache.org> on 2023/02/23 23:38:00 UTC

[jira] [Updated] (KAFKA-14750) Sink connector fails if a topic matching its topics.regex gets deleted

     [ https://issues.apache.org/jira/browse/KAFKA-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sergei Morozov updated KAFKA-14750:
-----------------------------------
    Summary: Sink connector fails if a topic matching its topics.regex gets deleted  (was: Sink connector fails if a source topic matching irs topics.regex gets deleted)

> Sink connector fails if a topic matching its topics.regex gets deleted
> ----------------------------------------------------------------------
>
>                 Key: KAFKA-14750
>                 URL: https://issues.apache.org/jira/browse/KAFKA-14750
>             Project: Kafka
>          Issue Type: Bug
>          Components: KafkaConnect
>    Affects Versions: 3.3.1
>            Reporter: Sergei Morozov
>            Priority: Major
>
> Steps to reproduce:
>  # In {{config/connect-standalone.properties}} set (use the version corresponding to the version of Apache Kafka):
> plugin.path=libs/connect-file-3.3.1.jar
>  # In {{config/connect-file-sink.properties}} remove the {{topics=}} line and add this one: 
> topics.regex=connect-test-.*
>  # Start zookeeper:
> bin/zookeeper-server-start.sh config/zookeeper.properties
>  # Start the cluster:
> bin/kafka-server-start.sh config/server.properties
>  # Start the file sink connector:
> bin/connect-standalone.sh config/connect-standalone.properties config/connect-file-sink.properties
>  # Create topics for the sink connector to subscribe to:
> for i in \{0..2}; do
>   for j in {$(($i * 100))..$(( ($i + 1) * 100 - 1 ))}; do
>     bin/kafka-topics.sh \
>         --bootstrap-server localhost:9092 \
>         --create \
>         --topic connect-test-$j
>   done &
> done
> wait
>  # Wait until all the created topics are assigned to the connector. Check the number of partitions to be > 0 in the output of:
> bin/kafka-consumer-groups.sh \
>     --bootstrap-server localhost:9092 \
>     --group connect-local-file-sink \
>     --describe --members
>  # Delete the created topics
> for i in \{0..2}; do
>   for j in {$(($i * 100))..$(( ($i + 1) * 100 - 1 ))}; do
>     bin/kafka-topics.sh \
>         --bootstrap-server localhost:9092 \
>         --delete \
>         --topic connect-test-$j
>     echo Created topic connect-test-$j.
>   done &
> done
> wait
>  # Observe the connector to fail with the following error:
> {quote}org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before the position for partition connect-test-211-0 could be determined
> {quote}
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)