You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Sergei Morozov (Jira)" <ji...@apache.org> on 2023/02/23 23:37:00 UTC
[jira] [Created] (KAFKA-14750) Sink connector fails if a source topic matching irs topics.regex gets deleted
Sergei Morozov created KAFKA-14750:
--------------------------------------
Summary: Sink connector fails if a source topic matching irs topics.regex gets deleted
Key: KAFKA-14750
URL: https://issues.apache.org/jira/browse/KAFKA-14750
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Affects Versions: 3.3.1
Reporter: Sergei Morozov
Steps to reproduce:
# In {{config/connect-standalone.properties}} set (use the version corresponding to the version of Apache Kafka):
plugin.path=libs/connect-file-3.3.1.jar
# In {{config/connect-file-sink.properties}} remove the {{topics=}} line and add this one:
topics.regex=connect-test-.*
# Start zookeeper:
bin/zookeeper-server-start.sh config/zookeeper.properties
# Start the cluster:
bin/kafka-server-start.sh config/server.properties
# Start the file sink connector:
bin/connect-standalone.sh config/connect-standalone.properties config/connect-file-sink.properties
# Create topics for the sink connector to subscribe to:
for i in \{0..2}; do
for j in {$(($i * 100))..$(( ($i + 1) * 100 - 1 ))}; do
bin/kafka-topics.sh \
--bootstrap-server localhost:9092 \
--create \
--topic connect-test-$j
done &
done
wait
# Wait until all the created topics are assigned to the connector. Check the number of partitions to be > 0 in the output of:
bin/kafka-consumer-groups.sh \
--bootstrap-server localhost:9092 \
--group connect-local-file-sink \
--describe --members
# Delete the created topics
for i in \{0..2}; do
for j in {$(($i * 100))..$(( ($i + 1) * 100 - 1 ))}; do
bin/kafka-topics.sh \
--bootstrap-server localhost:9092 \
--delete \
--topic connect-test-$j
echo Created topic connect-test-$j.
done &
done
wait
# Observe the connector to fail with the following error:
{quote}org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before the position for partition connect-test-211-0 could be determined
{quote}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)