You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2019/12/02 09:11:04 UTC
Slack digest for #general - 2019-12-02
2019-12-02 01:44:02 UTC - Jorge Miralles: Hi, I’m new to pulsar and I can’t find why I’m getting this error when producing a message in a partitioned topic using pulsar-client (pulsar-2.4.1)
----
2019-12-02 01:44:02 UTC - Jorge Miralles: ```01:33:06.790 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConnectionPool - [[id: 0x386cad05, L:/127.0.0.1:57372 - R:localhost/127.0.0.1:6650]] Connected to server
01:33:06.956 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar producer perf with config: {
"topicName" : "<persistent://public/default/stage02-test-7-partition-1>",
"producerName" : null,
"sendTimeoutMs" : 30000,
"blockIfQueueFull" : false,
"maxPendingMessages" : 1000,
"maxPendingMessagesAcrossPartitions" : 50000,
"messageRoutingMode" : "RoundRobinPartition",
"hashingScheme" : "JavaStringHash",
"cryptoFailureAction" : "FAIL",
"batchingMaxPublishDelayMicros" : 1000,
"batchingMaxMessages" : 1000,
"batchingEnabled" : true,
"compressionType" : "NONE",
"initialSequenceId" : null,
"autoUpdatePartitions" : true,
"properties" : { }
}
01:33:06.961 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config: {
"serviceUrl" : "<pulsar://localhost:6650/>",
"authPluginClassName" : null,
"authParams" : null,
"operationTimeoutMs" : 30000,
"statsIntervalSeconds" : 60,
"numIoThreads" : 1,
"numListenerThreads" : 1,
"connectionsPerBroker" : 1,
"useTcpNoDelay" : true,
"useTls" : false,
"tlsTrustCertsFilePath" : "",
"tlsAllowInsecureConnection" : false,
"tlsHostnameVerificationEnable" : false,
"concurrentLookupRequest" : 5000,
"maxLookupRequest" : 50000,
"maxNumberOfRejectedRequestPerConnection" : 50,
"keepAliveIntervalSeconds" : 30,
"connectionTimeoutMs" : 10000,
"requestTimeoutMs" : 60000,
"defaultBackoffIntervalNanos" : 100000000,
"maxBackoffIntervalNanos" : 30000000000
}
01:33:07.003 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xae1fcc9b, L:/10.64.167.155:59948 - R:ip-10-64-167-50.ec2.internal/10.64.167.50:6650]] Connected to server
01:33:07.005 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ProducerImpl - [<persistent://public/default/stage02-test-7-partition-1>] [null] Creating producer on cnx [id: 0xae1fcc9b, L:/10.64.167.155:59948 - R:ip-10-64-167-50.ec2.internal/10.64.167.50:6650]
01:33:07.015 [pulsar-client-io-1-1] WARN org.apache.pulsar.client.impl.ClientCnx - [id: 0xae1fcc9b, L:/10.64.167.155:59948 - R:ip-10-64-167-50.ec2.internal/10.64.167.50:6650] Received error from server: No value present
01:33:07.017 [pulsar-client-io-1-1] ERROR org.apache.pulsar.client.impl.ProducerImpl - [<persistent://public/default/stage02-test-7-partition-1>] [null] Failed to create producer: No value present
01:33:07.018 [main] ERROR org.apache.pulsar.client.cli.PulsarClientTool - Error while producing messages
01:33:07.018 [main] ERROR org.apache.pulsar.client.cli.PulsarClientTool - java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: No value present
org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: No value present
at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:297) ~[org.apache.pulsar-pulsar-client-api-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:88) ~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.cli.CmdProduce.publish(CmdProduce.java:179) [org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.cli.CmdProduce.run(CmdProduce.java:169) [org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.cli.PulsarClientTool.run(PulsarClientTool.java:131) [org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.cli.PulsarClientTool.main(PulsarClientTool.java:165) [org.apache.pulsar-pulsar-client-tools-2.4.1.jar:2.4.1]
Caused by: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: No value present
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) ~[?:1.8.0_232]
at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:86) ~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
... 4 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: No value present
at org.apache.pulsar.client.impl.ClientCnx.getPulsarClientException(ClientCnx.java:916) ~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
at org.apache.pulsar.client.impl.ClientCnx.handleError(ClientCnx.java:598) ~[org.apache.pulsar-pulsar-client-original-2.4.1.jar:2.4.1]
at org.apache.pulsar.common.protocol.PulsarDecoder.channelRead(PulsarDecoder.java:154) ~[org.apache.pulsar-pulsar-common-2.4.1.jar:2.4.1]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:799) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:433) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:330) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:909) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_232]
01:33:07.022 [main] INFO org.apache.pulsar.client.cli.PulsarClientTool - 0 messages successfully produced```
----
2019-12-02 01:52:35 UTC - Penghui Li: @Jorge Miralles You can check the log of server side, maybe there is some information can help us to troubleshoot this problem.
----
2019-12-02 01:53:54 UTC - Penghui Li: And, can you show the reproduce steps here? so that i can test is at my laptop.
----
2019-12-02 02:08:35 UTC - Jorge Miralles: @Penghui Li this is broker log when i try to produce a message
```02:07:00.214 [pulsar-io-22-2] INFO org.apache.pulsar.broker.service.ServerCnx - [/10.64.167.155:39728][<persistent://public/default/stage02-test-3-partition-2>] Creating producer. producerId=2
02:07:00.215 [pulsar-ordered-OrderedExecutor-0-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Opening managed ledger public/default/persistent/stage02-test-3-partition-2
02:07:00.215 [bookkeeper-ml-workers-OrderedExecutor-3-0] ERROR org.apache.pulsar.broker.service.ServerCnx - [/10.64.167.155:39728] Failed to create topic <persistent://public/default/stage02-test-3-partition-2>
java.util.concurrent.CompletionException: java.util.NoSuchElementException: No value present
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:618) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) ~[?:1.8.0_232]
at org.apache.pulsar.broker.service.BrokerService$2.openLedgerFailed(BrokerService.java:691) ~[org.apache.pulsar-pulsar-broker-2.4.1.jar:2.4.1]
at org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryImpl.lambda$asyncOpen$8(ManagedLedgerFactoryImpl.java:330) ~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_232]
at org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryImpl$2.initializeFailed(ManagedLedgerFactoryImpl.java:323) ~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl$1.operationFailed(ManagedLedgerImpl.java:336) ~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at org.apache.bookkeeper.mledger.impl.MetaStoreImplZookeeper.lambda$null$1(MetaStoreImplZookeeper.java:164) ~[org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at org.apache.bookkeeper.mledger.util.SafeRun$1.safeRun(SafeRun.java:32) [org.apache.pulsar-managed-ledger-original-2.4.1.jar:2.4.1]
at org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36) [org.apache.bookkeeper-bookkeeper-common-4.9.2.jar:4.9.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_232]
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_232]
Caused by: java.util.NoSuchElementException: No value present
at java.util.Optional.get(Optional.java:135) ~[?:1.8.0_232]
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616) ~[?:1.8.0_232]
... 18 more
02:07:00.558 [pulsar-io-22-1] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /127.0.0.1:57948
02:07:00.558 [pulsar-io-22-2] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /10.64.167.155:39728```
+1 : Penghui Li
----
2019-12-02 02:15:32 UTC - Penghui Li: @Jorge Miralles Can you help to check if the topic auto creation is enable? allowAutoTopicCreation= in broker.conf
----
2019-12-02 02:49:33 UTC - Jorge Miralles: is set to false
----
2019-12-02 03:08:48 UTC - Penghui Li: Ok, there is problem related to disable topic auto creation while using partitioned topic, we already create a pull request <https://github.com/apache/pulsar/pull/5572> to fix it. Currently, you’d better enable it.
----
2019-12-02 03:12:31 UTC - Jorge Miralles: Thank you very much i’ll test this and give you an update
+1 : Penghui Li
----
2019-12-02 07:12:21 UTC - Jianfeng Qiao: Hi all, I'm running pulsar 2.3.1 as server side and my app as a consumer is using pulsar go client. I always got some error after app receives some messages from the topic. The error looks like "handleRead error: asio.ssl:336151548 : sslv3 alert bad record mac, bytesTransferred:0". Does anyone have ideas about this issue?
----
2019-12-02 07:17:56 UTC - Penghui Li: Can you help create an issue at github? Looks need more information(e.g. the version of go client, the reproduce code etc) which can help find the problem.
----
2019-12-02 07:38:43 UTC - Jianfeng Qiao: Ok, I'll create an issue later.
----
2019-12-02 07:54:53 UTC - Yong Liu: @Yong Liu has joined the channel
----
2019-12-02 08:43:57 UTC - Jianfeng Qiao: Is there any recommendation for configurationg SSL cipher for pulsar?
----
2019-12-02 09:02:07 UTC - Endre Karlson: Any idea on when Transactions will land ?
----
2019-12-02 09:08:57 UTC - jia zhai: Here is a page for TLS authentication:
<https://pulsar.apache.org/docs/en/security-tls-authentication/>
Here is a page for TLS Transport Encryption:
<https://pulsar.apache.org/docs/en/security-tls-transport/>
----
2019-12-02 09:09:38 UTC - jia zhai: @Endre Karlson It should be ready in 2.6 release
----
2019-12-02 09:09:52 UTC - Endre Karlson: ETA
----
2019-12-02 09:09:57 UTC - Endre Karlson: You got a ca date ?
----
2019-12-02 09:10:52 UTC - jia zhai: As the release plan, it should be 3 months later.
----