You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/09/30 09:41:05 UTC
[GitHub] [pulsar] julienlau opened a new issue #12250: pulsar python client always log ERROR at consumer close
julienlau opened a new issue #12250:
URL: https://github.com/apache/pulsar/issues/12250
**Describe the bug**
client.close()
Generates the following log: `ERROR [140357162395392] ClientConnection:523 | [127.0.0.1:50144 -> 127.0.0.1:6650] Read failed: Operation canceled`
**To Reproduce**
```
[jlu@linux-gp75]> head -1000 p.py c.py
==> p.py <==
import time
import pulsar
client = pulsar.Client('pulsar://localhost:6650')
producer = client.create_producer(
'my-topic',
block_if_queue_full=True,
batching_enabled=False,
batching_max_publish_delay_ms=10
)
def send_callback(res, msg_id):
print('Message published res=%s', res)
i=0
while i < 100:
producer.send_async(('Hello-%d' % i).encode('utf-8'), send_callback)
time.sleep(0.01)
i += 1
client.close()
==> c.py <==
import time
import pulsar
client = pulsar.Client('pulsar://localhost:6650')
consumer = client.subscribe('my-topic', 'my-subscription',
consumer_type=pulsar.ConsumerType.Exclusive,
initial_position=pulsar.InitialPosition.Latest)
ok = 0
ko = 0
timeout_ms = 1000
while ok+ko < 100:
msg = consumer.receive(timeout_ms)
try:
print("Received message '%s' id='%s'", msg.data().decode('utf-8'), msg.message_id())
consumer.acknowledge(msg)
ok += 1
except:
consumer.negative_acknowledge(msg)
ko += 1
consumer.close()
time.sleep(timeout_ms / 1000.0)
client.close()
```
```
[jlu@linux-gp75]> python p.py > /dev/null ; python c.py
2021-09-30 11:39:03.910 INFO [140054859532096] Client:88 | Subscribing on Topic :my-topic
2021-09-30 11:39:03.910 INFO [140054859532096] ConnectionPool:84 | Created connection for pulsar://localhost:6650
2021-09-30 11:39:03.910 INFO [140054822745856] ClientConnection:364 | [127.0.0.1:50718 -> 127.0.0.1:6650] Connected to broker
2021-09-30 11:39:03.911 INFO [140054822745856] HandlerBase:54 | [persistent://public/default/my-topic, my-subscription, 0] Getting connection from pool
2021-09-30 11:39:03.912 INFO [140054822745856] ConsumerImpl:220 | [persistent://public/default/my-topic, my-subscription, 0] Created consumer on broker [127.0.0.1:50718 -> 127.0.0.1:6650]
Received message '%s' id='%s' Hello-0 (1613,2015,-1,-1)
Received message '%s' id='%s' Hello-1 (1613,2016,-1,-1)
Received message '%s' id='%s' Hello-2 (1613,2017,-1,-1)
Received message '%s' id='%s' Hello-3 (1613,2018,-1,-1)
Received message '%s' id='%s' Hello-4 (1613,2019,-1,-1)
Received message '%s' id='%s' Hello-5 (1613,2020,-1,-1)
Received message '%s' id='%s' Hello-6 (1613,2021,-1,-1)
Received message '%s' id='%s' Hello-7 (1613,2022,-1,-1)
Received message '%s' id='%s' Hello-8 (1613,2023,-1,-1)
Received message '%s' id='%s' Hello-9 (1613,2024,-1,-1)
Received message '%s' id='%s' Hello-10 (1613,2025,-1,-1)
Received message '%s' id='%s' Hello-11 (1613,2026,-1,-1)
Received message '%s' id='%s' Hello-12 (1613,2027,-1,-1)
Received message '%s' id='%s' Hello-13 (1613,2028,-1,-1)
Received message '%s' id='%s' Hello-14 (1613,2029,-1,-1)
Received message '%s' id='%s' Hello-15 (1613,2030,-1,-1)
Received message '%s' id='%s' Hello-16 (1613,2031,-1,-1)
Received message '%s' id='%s' Hello-17 (1613,2032,-1,-1)
Received message '%s' id='%s' Hello-18 (1613,2033,-1,-1)
Received message '%s' id='%s' Hello-19 (1613,2034,-1,-1)
Received message '%s' id='%s' Hello-20 (1613,2035,-1,-1)
Received message '%s' id='%s' Hello-21 (1613,2036,-1,-1)
Received message '%s' id='%s' Hello-22 (1613,2037,-1,-1)
Received message '%s' id='%s' Hello-23 (1613,2038,-1,-1)
Received message '%s' id='%s' Hello-24 (1613,2039,-1,-1)
Received message '%s' id='%s' Hello-25 (1613,2040,-1,-1)
Received message '%s' id='%s' Hello-26 (1613,2041,-1,-1)
Received message '%s' id='%s' Hello-27 (1613,2042,-1,-1)
Received message '%s' id='%s' Hello-28 (1613,2043,-1,-1)
Received message '%s' id='%s' Hello-29 (1613,2044,-1,-1)
Received message '%s' id='%s' Hello-30 (1613,2045,-1,-1)
Received message '%s' id='%s' Hello-31 (1613,2046,-1,-1)
Received message '%s' id='%s' Hello-32 (1613,2047,-1,-1)
Received message '%s' id='%s' Hello-33 (1613,2048,-1,-1)
Received message '%s' id='%s' Hello-34 (1613,2049,-1,-1)
Received message '%s' id='%s' Hello-35 (1613,2050,-1,-1)
Received message '%s' id='%s' Hello-36 (1613,2051,-1,-1)
Received message '%s' id='%s' Hello-37 (1613,2052,-1,-1)
Received message '%s' id='%s' Hello-38 (1613,2053,-1,-1)
Received message '%s' id='%s' Hello-39 (1613,2054,-1,-1)
Received message '%s' id='%s' Hello-40 (1613,2055,-1,-1)
Received message '%s' id='%s' Hello-41 (1613,2056,-1,-1)
Received message '%s' id='%s' Hello-42 (1613,2057,-1,-1)
Received message '%s' id='%s' Hello-43 (1613,2058,-1,-1)
Received message '%s' id='%s' Hello-44 (1613,2059,-1,-1)
Received message '%s' id='%s' Hello-45 (1613,2060,-1,-1)
Received message '%s' id='%s' Hello-46 (1613,2061,-1,-1)
Received message '%s' id='%s' Hello-47 (1613,2062,-1,-1)
Received message '%s' id='%s' Hello-48 (1613,2063,-1,-1)
Received message '%s' id='%s' Hello-49 (1613,2064,-1,-1)
Received message '%s' id='%s' Hello-50 (1613,2065,-1,-1)
Received message '%s' id='%s' Hello-51 (1613,2066,-1,-1)
Received message '%s' id='%s' Hello-52 (1613,2067,-1,-1)
Received message '%s' id='%s' Hello-53 (1613,2068,-1,-1)
Received message '%s' id='%s' Hello-54 (1613,2069,-1,-1)
Received message '%s' id='%s' Hello-55 (1613,2070,-1,-1)
Received message '%s' id='%s' Hello-56 (1613,2071,-1,-1)
Received message '%s' id='%s' Hello-57 (1613,2072,-1,-1)
Received message '%s' id='%s' Hello-58 (1613,2073,-1,-1)
Received message '%s' id='%s' Hello-59 (1613,2074,-1,-1)
Received message '%s' id='%s' Hello-60 (1613,2075,-1,-1)
Received message '%s' id='%s' Hello-61 (1613,2076,-1,-1)
Received message '%s' id='%s' Hello-62 (1613,2077,-1,-1)
Received message '%s' id='%s' Hello-63 (1613,2078,-1,-1)
Received message '%s' id='%s' Hello-64 (1613,2079,-1,-1)
Received message '%s' id='%s' Hello-65 (1613,2080,-1,-1)
Received message '%s' id='%s' Hello-66 (1613,2081,-1,-1)
Received message '%s' id='%s' Hello-67 (1613,2082,-1,-1)
Received message '%s' id='%s' Hello-68 (1613,2083,-1,-1)
Received message '%s' id='%s' Hello-69 (1613,2084,-1,-1)
Received message '%s' id='%s' Hello-70 (1613,2085,-1,-1)
Received message '%s' id='%s' Hello-71 (1613,2086,-1,-1)
Received message '%s' id='%s' Hello-72 (1613,2087,-1,-1)
Received message '%s' id='%s' Hello-73 (1613,2088,-1,-1)
Received message '%s' id='%s' Hello-74 (1613,2089,-1,-1)
Received message '%s' id='%s' Hello-75 (1613,2090,-1,-1)
Received message '%s' id='%s' Hello-76 (1613,2091,-1,-1)
Received message '%s' id='%s' Hello-77 (1613,2092,-1,-1)
Received message '%s' id='%s' Hello-78 (1613,2093,-1,-1)
Received message '%s' id='%s' Hello-79 (1613,2094,-1,-1)
Received message '%s' id='%s' Hello-80 (1613,2095,-1,-1)
Received message '%s' id='%s' Hello-81 (1613,2096,-1,-1)
Received message '%s' id='%s' Hello-82 (1613,2097,-1,-1)
Received message '%s' id='%s' Hello-83 (1613,2098,-1,-1)
Received message '%s' id='%s' Hello-84 (1613,2099,-1,-1)
Received message '%s' id='%s' Hello-85 (1613,2100,-1,-1)
Received message '%s' id='%s' Hello-86 (1613,2101,-1,-1)
Received message '%s' id='%s' Hello-87 (1613,2102,-1,-1)
Received message '%s' id='%s' Hello-88 (1613,2103,-1,-1)
Received message '%s' id='%s' Hello-89 (1613,2104,-1,-1)
Received message '%s' id='%s' Hello-90 (1613,2105,-1,-1)
Received message '%s' id='%s' Hello-91 (1613,2106,-1,-1)
Received message '%s' id='%s' Hello-92 (1613,2107,-1,-1)
Received message '%s' id='%s' Hello-93 (1613,2108,-1,-1)
Received message '%s' id='%s' Hello-94 (1613,2109,-1,-1)
Received message '%s' id='%s' Hello-95 (1613,2110,-1,-1)
Received message '%s' id='%s' Hello-96 (1613,2111,-1,-1)
Received message '%s' id='%s' Hello-97 (1613,2112,-1,-1)
Received message '%s' id='%s' Hello-98 (1613,2113,-1,-1)
Received message '%s' id='%s' Hello-99 (1613,2114,-1,-1)
2021-09-30 11:39:03.915 INFO [140054859532096] ConsumerImpl:871 | [persistent://public/default/my-topic, my-subscription, 0] Closing consumer for topic persistent://public/default/my-topic
2021-09-30 11:39:03.916 INFO [140054822745856] ConsumerImpl:927 | [persistent://public/default/my-topic, my-subscription, 0] Closed consumer 0
2021-09-30 11:39:04.917 INFO [140054859532096] ClientImpl:483 | Closing Pulsar client
2021-09-30 11:39:04.922 INFO [140054859532096] ClientConnection:1436 | [127.0.0.1:50718 -> 127.0.0.1:6650] Connection closed
2021-09-30 11:39:04.922 ERROR [140054822745856] ClientConnection:523 | [127.0.0.1:50718 -> 127.0.0.1:6650] Read failed: Operation canceled
2021-09-30 11:39:04.922 INFO [140054859532096] ClientConnection:253 | [127.0.0.1:50718 -> 127.0.0.1:6650] Destroyed connection
```
**Expected behavior**
There should be a way to close a python consumer without having an ERROR.
**Desktop (please complete the following information):**
- Linux
- Pulsar 2.7.3
- pulsar-client 2.7.3
**Additional context**
Add any other context about the problem here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] github-actions[bot] commented on issue #12250: pulsar python client always log ERROR at consumer close
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #12250:
URL: https://github.com/apache/pulsar/issues/12250#issuecomment-1053791739
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org