You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2019/08/03 09:11:10 UTC
Slack digest for #general - 2019-08-03
2019-08-02 11:58:27 UTC - Vladimir Shchur: Hi! Just found that consumer acknowledgement will silently do nothing if connection is unavailable, so acknowledgement success doesn't have any guarantee that message made it way to the server, is it a bug or a feature? Should I raise a github issue to allow consumers to be aware of whether ack actually succeeded or not?
----
2019-08-02 12:56:56 UTC - Sijie Guo: @Vladimir Shchur that’s current behavior. there is no acknowledge on “acks”. because it is at-least-once semantic.
with the ongoing development of supporting transaction, we will add the commands for acknowledges on “acks”.
----
2019-08-02 13:00:33 UTC - Vladimir Shchur: @Sijie Guo I see, thank you for the explanation
----
2019-08-02 16:41:32 UTC - Alexandre DUVAL: It is not possible to update function input topics? Only delete/create is working? So, when i delete, it removes the subcription, then messages are lost? right?
----
2019-08-02 16:42:46 UTC - Jerry Peng: You can set to cleanupSubscription to be false in your function config
----
2019-08-02 16:42:59 UTC - Jerry Peng: To keep the subscription
----
2019-08-02 16:45:28 UTC - Alexandre DUVAL: okay :slightly_smiling_face:
----
2019-08-02 16:46:14 UTC - Addison Higham: question for the community: anyone else considered or know of any efforts to create a terraform provider for pulsar? We have gotten a lot of feedback internally as we have moved towards pulsar that it is desired, be curious to see if anyone is aware of similar efforts?
----
2019-08-02 16:49:06 UTC - Alexandre DUVAL: i don't fint it, it's a functions create param? functions_worker config? I don't find it.
----
2019-08-02 16:51:16 UTC - David Kjerrumgaard: @Addison Higham We developed some ansible scripts a while back that leverage terraform to deploy Pulsar.
----
2019-08-02 16:53:51 UTC - David Kjerrumgaard: @Addison Higham Once we shifted over to K8s deployments, we sort of lost interest in them. Are you interested in collaborating on them as an ASF-2.0 project?
----
2019-08-02 17:00:23 UTC - Addison Higham: @David Kjerrumgaard I am not saying for deploying, i mean for managing tenants, namespaces, topics etc
----
2019-08-02 17:00:33 UTC - Addison Higham: pretty much most of the pulsar-admin CLI
----
2019-08-02 17:02:24 UTC - David Kjerrumgaard: Got it.
----
2019-08-02 18:21:06 UTC - Tarek Shaar: Does one know how Pulsar handles large messages? I believe Kafka is restricted to 1 MG (probably since it runs within a JVM and GC pauses slows things down). Is there a limit on the msg size in Pulsar?
----
2019-08-02 18:36:53 UTC - Addison Higham: @Tarek Shaar the default is 5 MiB, but in 2.4.0 support was added to configure that, see <https://github.com/apache/pulsar/pull/4247> for details
----
2019-08-02 18:42:25 UTC - Tarek Shaar: So I am assuming that the performance of Pulsar is not impacted by message size up to 5MiB? In other words the broker throughput is not impacted very much by increasing the message size so long as it is below 5MiB
----
2019-08-02 18:58:46 UTC - Sam Leung: This is one of the imminent projects we’re looking at doing, but it hasn’t started yet. Open sourcing what ends up from that is not out of the question, but we don’t have clear plans to do that yet.
----
2019-08-03 00:50:55 UTC - mapa: can anyone help me look for the right direction of an ability to do kstream in pulsar\
----
2019-08-03 00:51:01 UTC - mapa: thanks so much
----
2019-08-03 04:59:23 UTC - Leon: @Leon has joined the channel
----
2019-08-03 05:05:04 UTC - Leon: Hi, does pulsar sql work together with tiered storage? That is, can pulsar sql seamlessly query messages in cold storage (s3 / gcs) together with messages still stored in bookies?
----
2019-08-03 05:08:15 UTC - Jerry Peng: Yes
----
2019-08-03 05:08:58 UTC - Jerry Peng: You just have to configure tiered storage separately for sql
----
2019-08-03 05:09:50 UTC - Leon: Thanks, thats cool, will try it out
----
2019-08-03 08:56:06 UTC - Daniel Smith: @Daniel Smith has joined the channel
----