You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2020/04/13 09:11:03 UTC

Slack digest for #general - 2020-04-13

2020-04-12 11:41:07 UTC - Ebere Abanonu: ```
2020-04-12T11:39:39.581989685Z 2020-04-12T11:39:39.581Z	DEBUG	query-execution-7	com.facebook.presto.execution.QueryStateMachine	Query 20200412_113938_00005_uhitz is FAILED
2020-04-12T11:39:39.582713987Z 2020-04-12T11:39:39.581Z	DEBUG	Query-20200412_113938_00005_uhitz-330	com.facebook.presto.execution.QueryStateMachine	Query 20200412_113938_00005_uhitz failed
2020-04-12T11:39:39.583193589Z java.lang.RuntimeException: org.apache.bookkeeper.mledger.ManagedLedgerException$ManagedLedgerNotFoundException: org.apache.bookkeeper.mledger.ManagedLedgerException$MetadataNotFoundException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
2020-04-12T11:39:39.583457289Z 	at org.apache.pulsar.sql.presto.PulsarSplitManager.getSplits(PulsarSplitManager.java:134)
2020-04-12T11:39:39.58370189Z 	at com.facebook.presto.split.SplitManager.getSplits(SplitManager.java:64)
2020-04-12T11:39:39.583927791Z 	at com.facebook.presto.sql.planner.DistributedExecutionPlanner$Visitor.visitTableScan(DistributedExecutionPlanner.java:146)
2020-04-12T11:39:39.584136792Z 	at com.facebook.presto.sql.planner.DistributedExecutionPlanner$Visitor.visitTableScan(DistributedExecutionPlanner.java:122)
2020-04-12T11:39:39.584348392Z 	at com.facebook.presto.sql.planner.plan.TableScanNode.accept(TableScanNode.java:136)
2020-04-12T11:39:39.584551393Z 	at com.facebook.presto.sql.planner.DistributedExecutionPlanner.doPlan(DistributedExecutionPlanner.java:108)
2020-04-12T11:39:39.584748993Z 	at com.facebook.presto.sql.planner.DistributedExecutionPlanner.doPlan(DistributedExecutionPlanner.java:113)
2020-04-12T11:39:39.584951994Z 	at com.facebook.presto.sql.planner.DistributedExecutionPlanner.doPlan(DistributedExecutionPlanner.java:113)
2020-04-12T11:39:39.585141095Z 	at com.facebook.presto.sql.planner.DistributedExecutionPlanner.plan(DistributedExecutionPlanner.java:85)
2020-04-12T11:39:39.585346995Z 	at com.facebook.presto.execution.SqlQueryExecution.planDistribution(SqlQueryExecution.java:385)
2020-04-12T11:39:39.585540096Z 	at com.facebook.presto.execution.SqlQueryExecution.start(SqlQueryExecution.java:287)
2020-04-12T11:39:39.585745697Z 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2020-04-12T11:39:39.586020197Z 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2020-04-12T11:39:39.586219798Z 	at java.lang.Thread.run(Thread.java:748)
2020-04-12T11:39:39.586472899Z Caused by: org.apache.bookkeeper.mledger.ManagedLedgerException$ManagedLedgerNotFoundException: org.apache.bookkeeper.mledger.ManagedLedgerException$MetadataNotFoundException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
2020-04-12T11:39:39.586701599Z Caused by: org.apache.bookkeeper.mledger.ManagedLedgerException$MetadataNotFoundException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
2020-04-12T11:39:39.5869159Z Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
2020-04-12T11:39:39.587121601Z 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
2020-04-12T11:39:39.587324301Z 	at org.apache.bookkeeper.mledger.impl.MetaStoreImplZookeeper.lambda$null$1(MetaStoreImplZookeeper.java:165)
2020-04-12T11:39:39.587575502Z 	at org.apache.bookkeeper.mledger.util.SafeRun$1.safeRun(SafeRun.java:32)
2020-04-12T11:39:39.587809003Z 	at org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36)
2020-04-12T11:39:39.588036304Z 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2020-04-12T11:39:39.588323704Z 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2020-04-12T11:39:39.588559105Z 	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
2020-04-12T11:39:39.588577605Z 	at java.lang.Thread.run(Thread.java:748)```
----
2020-04-12 14:45:16 UTC - Cornel K.: @Cornel K. has joined the channel
----
2020-04-12 17:23:39 UTC - Ebere Abanonu: @Sijie Guo got what the problem was, the new topics created were partitioned and I ignored that fact. Fixed now
+1 : Penghui Li, Sijie Guo
----
2020-04-12 18:32:17 UTC - Sijie Guo: @Pradeep Mishra the sendAsync only blocks if you have configured blockIfQueueFull and you have too many requests in the queue.
----
2020-04-13 02:48:14 UTC - Anshul Dhyani: @Anshul Dhyani has joined the channel
----
2020-04-13 07:32:26 UTC - Subash Kunjupillai: Hi, We are planning to deploy Pulsar in bare metal. For administration GUI, I see Pulsar Dashboard is deprecated and <http://pulsar.apache.org/docs/en/administration-pulsar-manager/|Pulsar Manager> is only supported in Docker.
Can someone please let me know is it possible to deploy Pulsar Manager in bare metal? If yes, can you please share the steps for the same.
----
2020-04-13 08:05:54 UTC - Sijie Guo: @tuteng can you update the doc with the instructions of deploying Pulsar Manager to bare metal environment?
----
2020-04-13 08:12:04 UTC - tuteng: Now you can refer to this <https://github.com/apache/pulsar-manager/wiki/Release-Candidate-Validation> to deploy the published package. If you want to deploy your own build package, you can refer to this <https://github.com/apache/pulsar-manager/blob/master/src/README.md> and <https://github.com/apache/pulsar-manager/blob/master/front-end/README.md> to build backend and frontend. We will update the document later. @Subramaniyam
----
2020-04-13 08:22:39 UTC - Rattanjot Singh: ```[ERROR] Command execution failed.
<http://java.io|java.io>.IOException: Cannot run program "C:\Users\sifat\Documents\rattan-git\pulsar\docker\pulsar\..\..\pulsar-client-cpp\docker\build-wheels.sh" (in directory "C:\Use
rs\sifat\Documents\rattan-git\pulsar\docker\pulsar\target"): CreateProcess error=193, %1 is not a valid Win32 application
    at java.lang.ProcessBuilder.start (ProcessBuilder.java:1048)
    at java.lang.Runtime.exec (Runtime.java:620)
    at org.apache.commons.exec.launcher.Java13CommandLauncher.exec (Java13CommandLauncher.java:61)
    at org.apache.commons.exec.DefaultExecutor.launch (DefaultExecutor.java:279)
    at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:336)
    at org.apache.commons.exec.DefaultExecutor.execute (DefaultExecutor.java:166)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:804)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:751)
    at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:313)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: <http://java.io|java.io>.IOException: CreateProcess error=193, %1 is not a valid Win32 application
    at java.lang.ProcessImpl.create (Native Method)
    at java.lang.ProcessImpl.&lt;init&gt; (ProcessImpl.java:444)
    at java.lang.ProcessImpl.start (ProcessImpl.java:140)
    at java.lang.ProcessBuilder.start (ProcessBuilder.java:1029)
    at java.lang.Runtime.exec (Runtime.java:620)
    at org.apache.commons.exec.launcher.Java13CommandLauncher.exec (Java13CommandLauncher.java:61)
    at org.apache.commons.exec.DefaultExecutor.launch (DefaultExecutor.java:279)
    at org.apache.commons.exec.DefaultExecutor.executeInternal (DefaultExecutor.java:336)
    at org.apache.commons.exec.DefaultExecutor.execute (DefaultExecutor.java:166)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:804)
    at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:751)
    at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:313)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)```
----
2020-04-13 08:22:39 UTC - Rattanjot Singh: getting this when try to build custom docker image
----
2020-04-13 08:24:54 UTC - Hiroyuki Yamada: Hi, I’m just following <http://pulsar.apache.org/docs/en/deploy-bare-metal/|the doc> to deploy a simple pulsar cluster.
Zookeeper deployment is properly done and `initialize-cluster-metadata` is done with multi-host.
Then I’m facing some Bookkeeper error.
I just updated `zkServes` in `conf/bookkeeper.conf` and did `bin/pulsar-daemon start bookie` .
2 bookkeeper servers are running but 1 bookkeeper server doesn’t start and says
```08:15:51.441 [main] ERROR org.apache.bookkeeper.bookie.Bookie - There are directories without a cookie, and this is neither a new environment, nor is storage expansion enabled. Empty directories are [data/bookkeeper/journal/current, data/bookkeeper/ledgers/current]```
Does anyone have any idea ?
I re-initialized it but the same issue happen…
I can’t find useful information about this on the web. (not much information about this actually)
----