You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2019/01/04 09:11:02 UTC
Slack digest for #general - 2019-01-04
2019-01-03 09:59:38 UTC - Michael-Yu: i have get this err too, have u solved it or not
----
2019-01-03 14:28:11 UTC - Grant Wu: I haven't
----
2019-01-03 14:28:23 UTC - Grant Wu: We generally chalked it up to unreliable disk
----
2019-01-03 15:39:49 UTC - Jochen Kapaun: @Jochen Kapaun has joined the channel
----
2019-01-03 15:49:06 UTC - Jochen Kapaun: Hi, I tried to start with a Java Client like described here:
<https://pulsar.apache.org/docs/en/client-libraries-java/>
I added the maven dependency:
<dependency>
<groupId>org.apache.pulsar</groupId>
<artifactId>pulsar-client</artifactId>
<version>2.2.1</version>
</dependency>
Unfortunately, this dependency does not include the org.apache.pulsar.client.api.PulsarClient
So I cannot compile somthing like this because PulsarClient cannot be resolved.
PulsarClient client = PulsarClient.builder()
.serviceUrl("<pulsar://localhost:6650>")
.build();
Any ideas?
----
2019-01-03 16:04:51 UTC - Jochen Kapaun: Please forget what I wrote, it is probably a proxy problem on my side.
----
2019-01-03 22:05:47 UTC - Emma Pollum: Can someone explain to me the procedure for reading messages that have been offloaded to either s3 or google cloud?
----
2019-01-03 22:25:46 UTC - Matteo Merli: It’s completely transparent to users
----
2019-01-03 22:26:36 UTC - Matteo Merli: You keep using the same API and tools, irrespective of where the data is located
----
2019-01-03 22:27:47 UTC - Grant Wu: What is the syntax of the `--user-config` argument to `pulsar-admin functions create`?
----
2019-01-03 22:31:00 UTC - Jerry Peng: @Grant Wu its a map of key and values in JSON format
----
2019-01-03 22:31:09 UTC - Grant Wu: okay, JSON format
----
2019-01-03 22:31:18 UTC - Grant Wu: provided as a string I’m guessing, not as a file right
----
2019-01-03 22:31:29 UTC - Jerry Peng: yes
----
2019-01-03 22:37:17 UTC - Grant Wu: Is there any chance we could get Python Pulsar functions that take wheels :slightly_smiling_face:
----
2019-01-03 22:37:33 UTC - Grant Wu: (wheels being the Python package format)
----
2019-01-03 22:37:34 UTC - Matteo Merli: It already does !
----
2019-01-03 22:37:37 UTC - Grant Wu: oh
----
2019-01-03 22:37:38 UTC - Grant Wu: it does?
----
2019-01-03 22:37:56 UTC - Grant Wu: <https://pulsar.apache.org/docs/en/functions-api/#packaging-1> says it needs to be a single Python file
thinking_face : Grant Wu
----
2019-01-03 22:39:05 UTC - Matteo Merli: Although, fetching dependencies is a bit more tricky. Though you can also pass a Zip file with all dependencies included.. Docs for this are a bit ehem, behind. (also the last part of the zip file I think will only be available in 2.3)
----
2019-01-03 22:39:44 UTC - Matteo Merli: @Jerry Peng Can you share any info on how to use wheel or zip files?
----
2019-01-03 22:39:46 UTC - Grant Wu: last part of the zip file?
----
2019-01-03 22:40:10 UTC - Matteo Merli: I mean, submitting a zip with deps included
----
2019-01-03 22:40:15 UTC - Grant Wu: ah okay
----
2019-01-03 22:40:25 UTC - Matteo Merli: wheel support should be there in 2.2 if I’m not mistaken
----
2019-01-03 23:42:25 UTC - Grant Wu: ```
Traceback (most recent call last):
File "/Users/grant.wu/fakebin/apache-pulsar-2.2.1/instances/python-instance/python_instance_main.py", line 33, in <module>
import pulsar
File "/Users/grant.wu/fakebin/apache-pulsar-2.2.1/instances/python-instance/pulsar/__init__.py", line 99, in <module>
import _pulsar
ImportError: No module named _pulsar
```
I’m getting this issue with cluster run mode
----
2019-01-03 23:43:14 UTC - Grant Wu: Is there something I’m missing?
----
2019-01-03 23:43:21 UTC - Grant Wu: This is from pulsar standalone logs
----
2019-01-03 23:44:53 UTC - Matteo Merli: you need `pip install pulsar-client` on that machine
----
2019-01-03 23:45:23 UTC - Grant Wu: oh, hrm.
----
2019-01-03 23:53:51 UTC - Grant Wu: Wait - so, to be clear, @Matteo Merli - when deploying a Python pulsar function - every broker needs to have the `pulsar-client` Python package installed?
----
2019-01-03 23:54:06 UTC - Matteo Merli: yes
----
2019-01-03 23:54:29 UTC - Grant Wu: Do you know if the Pulsar Docker image already handles that?
----
2019-01-03 23:54:34 UTC - Matteo Merli: yep
+1 : Grant Wu
----
2019-01-03 23:59:03 UTC - Ali Ahmed: @Grant Wu the default image has python 2.7 runtime and client libs installed
----
2019-01-03 23:59:16 UTC - Grant Wu: oh, hrm.
----
2019-01-03 23:59:47 UTC - Grant Wu: I wish it was Python 3… I think my functions are polyglot though
----
2019-01-04 00:11:38 UTC - Grant Wu: I’m having trouble using the `publish` function on the Pulsar context
----
2019-01-04 00:11:56 UTC - Grant Wu: Is there a way to log from Pulsar functions?
----
2019-01-04 00:17:56 UTC - Grant Wu: Just saw <https://apache-pulsar.slack.com/archives/C5Z4T36F7/p1544624357718900>
----
2019-01-04 00:21:43 UTC - Grant Wu: Print seems to work
----
2019-01-04 01:19:00 UTC - Jon Bock: Here’s a short video on how to use log topics: <https://youtu.be/4LKnkVhsPPk>
----
2019-01-04 02:43:56 UTC - bossbaby: i have a question that have manage offset in pulsart same kafka?
----
2019-01-04 02:47:20 UTC - Matteo Merli: Pulsar manages offsets, though you have option to do manual management, if needed
----
2019-01-04 02:47:53 UTC - Matteo Merli: Also, Pulsar really tracks individual messages acks
----
2019-01-04 02:48:46 UTC - bossbaby: you have a document describe it?
----
2019-01-04 03:14:34 UTC - Matteo Merli: @bossbaby <http://pulsar.apache.org/docs/en/concepts-messaging/#acknowledgement>
----
2019-01-04 03:25:19 UTC - bossbaby: thanks you
----
2019-01-04 03:39:50 UTC - bossbaby: Can Pulsar Server store and manage offset of each consumer?
----
2019-01-04 03:44:40 UTC - Matteo Merli: Of each subscription
----
2019-01-04 04:15:41 UTC - bossbaby: yes, each subscription
----