You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2019/09/10 09:11:03 UTC
Slack digest for #general - 2019-09-10
2019-09-09 10:45:26 UTC - vikash: hello,i have installed packages from above nuget no compilation Error but when i have run it it gives runtime error in visualstudio as System.IO.FileNotFoundException: 'Could not load file or assembly 'Pulsar.Client.Proto, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null'. The system cannot find the file specified.'
----
2019-09-09 11:27:49 UTC - vikash: after added this protobuf-net
System.IO.Pipelines
Pulsar.Client.Proto
----
2019-09-09 11:27:53 UTC - vikash: it works now
----
2019-09-09 12:54:21 UTC - Ravi Shah: I am Running a Load test on standalone Pulsar setup and notice some strange behavior. I am running 5M request.
1. 5M req with 100 concurrency - It fails with Producer queue full error
2. 5M req with 1 concurrency - Its runs successfully
----
2019-09-09 12:54:43 UTC - Ravi Shah: For both the cases i use maxPendingMessages=100000000
----
2019-09-09 12:55:02 UTC - Ravi Shah: Anyone any idea why this strange behavior?
----
2019-09-09 14:29:46 UTC - David Kjerrumgaard: @Ravi Shah What are the failures? Any errors in the logs?
----
2019-09-09 15:15:25 UTC - Ravi Shah: @David Kjerrumgaard Error occurred while producer handler was sending msg from /127.0.0.1:63212:org.apache.pulsar.client.api.PulsarClientException$ProducerQueueIsFullError: Producer send queue is full
----
2019-09-09 16:47:21 UTC - Alex Mault: Hi all, for anyone that is using rust (the language), the team I work on has released a rust-native pulsar client and would appreciate feedback. <https://github.com/wyyerd/pulsar-rs>
We submitted a PR to have it listed in the 3rd party library section. (Maintainers: please let me know if I did something wrong :) )
tada : Matteo Merli, Luke Lu, Sijie Guo, Karthik Ramasamy, Devin G. Bost, Ali Ahmed, Holger Hoffstätte
----
2019-09-09 18:13:30 UTC - Devin G. Bost: Does anyone have an example of a dockerfile used to build the Pulsar Go client (consumer/producer) or Pulsar Node client?
----
2019-09-09 18:23:59 UTC - Axel Barfod: Hi, I am getting the following error: `org.apache.pulsar.client.admin.PulsarAdminException$ServerSideErrorException: Some error occourred on the server
at org.apache.pulsar.client.admin.internal.BaseResource.getApiException(BaseResource.java:162)` when I try to get the subscriptions from a topic, what could cause this error?
----
2019-09-09 18:25:06 UTC - Axel Barfod: this is a partitioned topic and the topic exists in the brokers
----
2019-09-09 18:26:12 UTC - Axel Barfod:
----
2019-09-09 19:26:00 UTC - Subramaniyam: @Subramaniyam has joined the channel
----
2019-09-09 19:50:34 UTC - Subramaniyam: Hi All, When i install nodejs library - npm install pulsar-client , I am getting the below error even i have Python installed my machine and setup PYTHON environment variable in my windows machine..
----
2019-09-09 19:50:59 UTC - Subramaniyam: node-pre-gyp WARN Using request for node-pre-gyp https download
node-pre-gyp WARN Tried to download(404): <https://pulsar.apache.org/docs/en/client-libraries-cpp/libpulsar-v1.0.0-node-v64-win32-x64.tar.gz>
node-pre-gyp WARN Pre-built binaries not found for pulsar-client@1.0.0 and node@10.12.0 (node-v64 ABI, unknown) (falling back to source compile with node-gyp)
gyp ERR! configure error
gyp ERR! stack Error: Command failed: C:\Python\python.exe -c import sys; print "%s.%s.%s" % sys.version_info[:3];
gyp ERR! stack File "<string>", line 1
gyp ERR! stack import sys; print "%s.%s.%s" % sys.version_info[:3];
gyp ERR! stack ^
gyp ERR! stack SyntaxError: invalid syntax
gyp ERR! stack
gyp ERR! stack at ChildProcess.exithandler (child_process.js:289:12)
gyp ERR! stack at ChildProcess.emit (events.js:182:13)
gyp ERR! stack at maybeClose (internal/child_process.js:962:16)
gyp ERR! stack at Process.ChildProcess._handle.onexit (internal/child_process.js:251:5)
gyp ERR! System Windows_NT 10.0.17134
gyp ERR! command "C:\\Program Files\\nodejs\\node.exe" "C:\\Program Files\\nodejs\\node_modules\\npm\\node_modules\\node-gyp\\bin\\node-gyp.js" "configure" "--fallback-to-build" "--module=C:\\Subu\\Pulsar\\node_modules\\pulsar-client\\build\\Release\\libpulsar.node" "--module_name=libpulsar" "--module_path=C:\\Subu\\Pulsar\\node_modules\\pulsar-client\\build\\Release" "--napi_version=3" "--node_abi_napi=napi" "--napi_build_version=0" "--node_napi_label=node-v64" "--python=C:\\Python\\python.exe"
gyp ERR! cwd C:\Subu\Pulsar\node_modules\pulsar-client
gyp ERR! node -v v10.12.0
gyp ERR! node-gyp -v v3.8.0
gyp ERR! not ok
node-pre-gyp ERR! build error
node-pre-gyp ERR! stack Error: Failed to execute 'C:\Program Files\nodejs\node.exe C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\bin\node-gyp.js configure --fallback-to-build --module=C:\Subu\Pulsar\node_modules\pulsar-client\build\Release\libpulsar.node --module_name=libpulsar --module_path=C:\Subu\Pulsar\node_modules\pulsar-client\build\Release --napi_version=3 --node_abi_napi=napi --napi_build_version=0 --node_napi_label=node-v64 --python=C:\Python\python.exe' (1)
node-pre-gyp ERR! stack at ChildProcess.<anonymous> (C:\Subu\Pulsar\node_modules\node-pre-gyp\lib\util\compile.js:83:29)
node-pre-gyp ERR! stack at ChildProcess.emit (events.js:182:13)
node-pre-gyp ERR! stack at maybeClose (internal/child_process.js:962:16)
node-pre-gyp ERR! stack at Process.ChildProcess._handle.onexit (internal/child_process.js:251:5)
node-pre-gyp ERR! System Windows_NT 10.0.17134
node-pre-gyp ERR! command "C:\\Program Files\\nodejs\\node.exe" "C:\\Subu\\Pulsar\\node_modules\\node-pre-gyp\\bin\\node-pre-gyp" "install" "--fallback-to-build"
node-pre-gyp ERR! cwd C:\Subu\Pulsar\node_modules\pulsar-client
node-pre-gyp ERR! node -v v10.12.0
node-pre-gyp ERR! node-pre-gyp -v v0.12.0
node-pre-gyp ERR! not ok
----
2019-09-09 19:51:43 UTC - Subramaniyam: My node and npm version below..
----
2019-09-09 19:51:46 UTC - Subramaniyam: PS C:\Subu\Pulsar> node --version
v10.12.0
PS C:\Subu\Pulsar> npm --version
6.4.1
----
2019-09-09 21:05:21 UTC - Addison Higham: didn't see this till now, on k8s, specifically EKS on AWS
----
2019-09-10 02:27:25 UTC - Vincent Ngan: I have read articles about using Kafka to implement distributed key-value stores. It is also possible to do that with Pulsar and will it be efficient and reliable?
----
2019-09-10 03:09:22 UTC - Ali Ahmed: a version of it is already implements to support pulsar functions state
----
2019-09-10 04:00:07 UTC - Ali Ahmed: <https://www.mtnfog.com/blog/sneak-peek-philter-integrations/>
----
2019-09-10 04:00:13 UTC - Ali Ahmed: ```Apache Pulsar
Philter integrates with Apache Pulsar via Pulsar Functions. A Pulsar Function enables Pulsar to execute functions on the streaming data as it passes through Pulsar. Pulsar is similar to Kafka in its functionality as a massive pub/sub application but unlike Kafka it provides the ability to directly transform the data inside of the application. This is an ideal integration point for Philter and your streaming architectures using Apache Pulsar.```
----
2019-09-10 05:53:05 UTC - Pradeep Mishra: @Pradeep Mishra has joined the channel
----
2019-09-10 06:09:25 UTC - Muthu Lalapet: @Muthu Lalapet has joined the channel
----
2019-09-10 07:43:30 UTC - Mahesh: Hi,
When I try to access state api provided by pulsar-functions. I get this error.
00:33:17.551 [public/default/word-count-0] INFO org.apache.pulsar.functions.instance.JavaInstanceRunnable - Encountered user exception when processing message PulsarRecord(topicName=Optional[<persistent://public/default/source-topic>], partition=0, message=Optional[org.apache.pulsar.client.impl.MessageImpl@47fa81f9], failFunction=org.apache.pulsar.functions.source.PulsarSource$$Lambda$86/208060553@1bf0e59c, ackFunction=org.apache.pulsar.functions.source.PulsarSource$$Lambda$85/1037970913@59151fdb)
java.lang.IllegalStateException: State is not enabled.
at org.apache.pulsar.functions.runtime.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:444) ~[java-instance.jar:2.4.0]
at org.apache.pulsar.functions.instance.ContextImpl.ensureStateEnabled(ContextImpl.java:256) ~[java-instance.jar:2.4.0]
at org.apache.pulsar.functions.instance.ContextImpl.incrCounter(ContextImpl.java:267) ~[java-instance.jar:2.4.0]
at com.tfs.icc.functions.WordCountFunction.lambda$process$0(WordCountFunction.java:13) ~[iccp-pulsar-functions-0.0.1.jar:?]
at java.util.Arrays$ArrayList.forEach(Arrays.java:3880) ~[?:1.8.0_212]
at com.tfs.icc.functions.WordCountFunction.process(WordCountFunction.java:13) ~[iccp-pulsar-functions-0.0.1.jar:?]
at com.tfs.icc.functions.WordCountFunction.process(WordCountFunction.java:8) ~[iccp-pulsar-functions-0.0.1.jar:?]
at org.apache.pulsar.functions.instance.JavaInstance.handleMessage(JavaInstance.java:63) ~[java-instance.jar:2.4.0]
at org.apache.pulsar.functions.instance.JavaInstanceRunnable.run(JavaInstanceRunnable.java:257) [java-instance.jar:2.4.0]
Someone please help me fix this issue ?
----
2019-09-10 08:08:27 UTC - Sijie Guo: Currently it is only enabled in stand-alone mode by default. It requires some settings to enable in cluster mode.
----
2019-09-10 08:27:25 UTC - Mahesh: If you're referring to this entry.
extraServerComponents=org.apache.bookkeeper.stream.server.StreamStorageLifecycleComponent
I have already added this in bookie.conf
----