You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2018/04/18 09:11:04 UTC
Slack digest for #general - 2018-04-18
2018-04-17 20:28:33 UTC - Poule: @Matteo Merli we talked about local state store previously <https://apache-pulsar.slack.com/archives/C5Z4T36F7/p1522702016000100>
----
2018-04-17 20:30:04 UTC - Poule: in this PR, <https://github.com/apache/incubator-pulsar/pull/1587> sijie says "just a reminder, getValue can be very slow. it is not a local state, it is a global state. it involves network I/O and potential disk I/O. do we think we want to do sync calls only?"
----
2018-04-17 20:31:37 UTC - Poule: will there be local state on top of remote global state?
----
2018-04-17 20:36:04 UTC - Poule: goal is fast sync Get..
----
2018-04-17 20:46:36 UTC - Sijie Guo: @Poule - this is a good question, glad you noticed it :slightly_smiling_face: yeah we are still discussing exposing key/value api and also local state vs global state, there is no final decision yet. “local” state is a bit “tricky” for functions than traditional SPE (stream-processing-engines), because from functions’ point-of-review, it only see an event/message, it doesn’t have the concept of “instance”. so the goal is going to be a “global” state in some sense, we want to provide fast accesses to state just like accessing “local” state and you don’t need to worry about rebuilding state on crashes. we are not there yet but close …
----
2018-04-17 20:49:03 UTC - Sijie Guo: @Poule I would like to hear what would be the usage of “get” at your use cases. it is easy to get a lot of use cases around “put”, “incrCounter”.
----
2018-04-17 20:50:47 UTC - Poule: <https://apache-pulsar.slack.com/archives/C5Z4T36F7/p1522703287000422>
----
2018-04-17 20:52:36 UTC - Sijie Guo: I see
----
2018-04-17 20:52:45 UTC - Sijie Guo: that’s interesting
----
2018-04-17 20:58:01 UTC - Igor Zubchenok: It's significantly faster, I'll test how it scales with 3 servers. Expect getting tens of thousands of subscriptions in a reasonable time.
----
2018-04-17 20:59:19 UTC - Igor Zubchenok: Could anyone comment this issue? We're blocked. I can create subscription *only* if I connect to a proper node.
----
2018-04-17 22:30:21 UTC - Sijie Guo: @Igor Zubchenok checking now. sorry missed that before.
----
2018-04-17 22:38:15 UTC - Sijie Guo: Can you provide any logging at your broker side?
----
2018-04-18 00:51:06 UTC - xushy: @xushy has joined the channel
----
2018-04-18 01:40:01 UTC - Igor Zubchenok: cannot now, sorry, will do tomorrow.
----
2018-04-18 01:40:12 UTC - Igor Zubchenok: thanks for your response
----
2018-04-18 05:29:01 UTC - Vasily Yanov: same issue if I try to create subscription with pulsar-admin. I can do that only on one node (master node? BTW how I can determine master node?):
/opt/pulsar/bin/pulsar-admin persistent create-subscription <persistent://sample/prod-pulsar-cluster-1/ns1/test12> -s <random subscription name>
can be successfully executed only on 1 of 3 nodes.
----