You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2020/04/20 09:11:05 UTC
Slack digest for #general - 2020-04-20
2020-04-19 10:59:54 UTC - Subash Kunjupillai: I did a quick check by adding an additional broker to the cluster by configuring just ZK details in <http://broker.co|broker.conf. I was able to publish and consume message using the new broker(stopped other brokers in the cluster). So I believe Metadata Initialization is not required while adding a broker / bookie to the existing cluster. Is my understanding correct?>
----
2020-04-19 11:38:45 UTC - Subash Kunjupillai: Hi, Can someone please let me know is there any verified OS for Pulsar? Currently we are using (in bare metal) RHEL 7.4 and we have plans to upgrade to RHEL 7.7 in sometime. So would like to understand whether Pulsar work on these OS version?
----
2020-04-19 11:59:59 UTC - Ebere Abanonu: @Sijie Guo @Sijie Guo how can one for instance set retention policy via the openapi? So far setting retention
----
2020-04-19 12:00:19 UTC - Ebere Abanonu: set the size and time to zero
----
2020-04-19 16:30:58 UTC - Tufan Rakshit: @Tufan Rakshit has joined the channel
----
2020-04-20 03:12:32 UTC - Ebere Abanonu: Solved!
ok_hand : Sijie Guo
----
2020-04-20 03:17:14 UTC - Ebere Abanonu: Hello House, please _I need_ your help in testing <https://www.nuget.org/packages/SharpPulsar/> a custom c# client for pulsar. Just released version 0.7.0 which comes with Pulsar SQL and Pulsar Admin inbuilt, also support byte[] and Avro schema. I am working to make it stable for production and I need your feed backs!
----
2020-04-20 05:12:43 UTC - Sijie Guo: Yes this will be fixed in 2.5.1
----
2020-04-20 05:14:29 UTC - Sijie Guo: I don’t quite understand the question here. Acknowledgements are stored in cursors and not in the event data itself.
----
2020-04-20 05:15:09 UTC - Sijie Guo: Presto is just one of the integrations that Pulsar has . Users can use presto to query event streams if they are already using presto.
----
2020-04-20 05:16:05 UTC - Sijie Guo: For server-side components, they are JVM based. If you have JDK8 or JDK11, you can run those components. There are no strong requirements about OS
----
2020-04-20 05:18:03 UTC - Sijie Guo: If you are not doing point lookup, pulsar is fine.
----
2020-04-20 05:22:20 UTC - Sijie Guo: 1. is the function worker running as part of broker or separately?
2. If the function worker is running separately, did you configure function_worker.yml to include the tls related settings?
----
2020-04-20 05:52:48 UTC - Adelina Brask: @Sijie Guo Part of the broker :slightly_smiling_face:
----
2020-04-20 05:58:11 UTC - Adelina Brask: Depends if you are running bookies & brokers on the same node. To answer your previous questions, I don't know the exact mechanism and where the behaviour is hardcoded. What I know is that the bookies have to be registered with Zookeeper with cluster metadata initialisation. Brokers is not necessary. Brokers are started based on available bookies. :slightly_smiling_face:
----
2020-04-20 06:19:00 UTC - Sijie Guo: okay. did you enable the broker client tls settings?
----
2020-04-20 06:44:07 UTC - Frans Guelinckx: ```09:30:58.655 [public/default/employerFunction-0] INFO org.apache.pulsar.functions.instance.JavaInstanceRunnable - Encountered user exception when processing message Pu
lsarRecord(topicName=Optional[<persistent://public/default/everesst.employer.DOMAIN_EVENT_RECORD>], partition=0, message=Optional[org.apache.pulsar.client.impl.MessageImp
l@22a671f1], failFunction=org.apache.pulsar.functions.source.PulsarSource$$Lambda$162/1657211398@62b38a86, ackFunction=org.apache.pulsar.functions.source.PulsarSource$$
Lambda$161/1865196485@5b385bd0)
java.lang.ClassCastException: org.apache.pulsar.client.impl.schema.KeyValueSchema cannot be cast to org.apache.pulsar.client.impl.schema.KeyValueSchema
at org.apache.pulsar.client.impl.TypedMessageBuilderImpl.value(TypedMessageBuilderImpl.java:143) ~[org.apache.pulsar-pulsar-client-original-2.5.0.jar:2.5.0]
at org.apache.pulsar.functions.instance.ContextImpl$MessageBuilderImpl.value(ContextImpl.java:497) ~[org.apache.pulsar-pulsar-functions-instance-2.5.0.jar:?]
at be.everesst.pulsar.functions.employer.function.EmployeeRoutingFunction.lambda$process$0(EmployeeRoutingFunction.java:39) ~[?:?]
at java.util.Optional.ifPresent(Optional.java:159) ~[?:1.8.0_232]
at be.everesst.pulsar.functions.employer.function.EmployeeRoutingFunction.process(EmployeeRoutingFunction.java:36) ~[?:?]
at be.everesst.pulsar.functions.employer.function.EmployeeRoutingFunction.process(EmployeeRoutingFunction.java:21) ~[?:?]
at org.apache.pulsar.functions.instance.JavaInstance.handleMessage(JavaInstance.java:63) ~[org.apache.pulsar-pulsar-functions-instance-2.5.0.jar:?]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:269) [org.apache.pulsar-pulsar-functions-instance-2.5.0.jar:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_232]```
----
2020-04-20 08:25:16 UTC - Penghui Li: Thanks @Frans Guelinckx , @ran also met this problem and he is trying to fix it.
white_check_mark : Frans Guelinckx
----
2020-04-20 08:52:30 UTC - Sunny Chan: @Sunny Chan has joined the channel
----
2020-04-20 08:59:52 UTC - JG: what do you meabn by point lookup ? You mean looking for a particular event ?
----
2020-04-20 09:02:08 UTC - JG: what are the other possibilities to query event streams ?
----