You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@pulsar.apache.org by Apache Pulsar Slack <ap...@gmail.com> on 2020/08/08 09:11:06 UTC
Slack digest for #general - 2020-08-08
2020-08-07 10:03:54 UTC - charles: Hi. Could this be related to the answer given by @Sijie Guo given at: <https://github.com/apache/pulsar/issues/7246>? If you set the retention to "unlimited", your messages reside in the topic's namespace as long as it's not purged. So regardless if you have a consumer or not. Not sure if this relates to your situation though.
My Java code on top of the the admin API looks something like:
``` pulsarAdmin.namespaces().createNamespace(tenantNamespace);
// *** Original working:
int time = 60;
int size = 600;
// See: <https://github.com/apache/pulsar/issues/7246>
// "retentionTimeInMinutes" : -1,
// "retentionSizeInMB" : -1
time = -1;
size = -1;
pulsarAdmin.namespaces().setRetention(tenantNamespace, new RetentionPolicies(time, size));```
----
2020-08-07 10:23:26 UTC - tiny: @tiny has joined the channel
----
2020-08-07 13:33:54 UTC - Shilpy: Hi, i am getting below error in my service after the service has run for quite few hours : org.apache.pulsar.client.api.PulsarClientException$TimeoutException: The producer standalone-0-71 can not send message to the topic <TOPICNAME> with given timeout
Can anybody help in this.
----
2020-08-07 13:39:33 UTC - xue: Can 1 broker cluster create 2 functions-worker clusters？
----
2020-08-07 15:33:22 UTC - Bre Gielissen: I doubt I have the skills to be able to help with that but I am happy to help any way I can.
----
2020-08-07 16:37:21 UTC - Eliseu Cartaxo: @Eliseu Cartaxo has joined the channel
----
2020-08-07 17:37:47 UTC - Rich Adams: Trying to the presto-pulsar-plugin working with version 332 of prestosql. The plugin loads just fine, but then when it tries to startup I get the exception:
```javax.validation.ValidationException: error during validation of PulsarConnectorConfig{brokerServiceUrl='<http://pulsar-broker:8080>'}
at org.apache.bval.jsr.ClassValidator.unrecoverableValidationError(ClassValidator.java:594)
at org.apache.bval.jsr.ClassValidator.validate(ClassValidator.java:144)
at io.airlift.configuration.ConfigurationFactory.validate(ConfigurationFactory.java:414)
at io.airlift.configuration.ConfigurationFactory.build(ConfigurationFactory.java:387)
at io.airlift.configuration.ConfigurationFactory.build(ConfigurationFactory.java:317)
at io.airlift.configuration.ConfigurationProvider.get(ConfigurationProvider.java:67)
at io.airlift.configuration.ConfigurationFactory.validateRegisteredConfigurationProvider(ConfigurationFactory.java:230)
at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:202)
at org.apache.pulsar.sql.presto.PulsarConnectorFactory.create(PulsarConnectorFactory.java:68)
at io.prestosql.connector.ConnectorManager.createConnector(ConnectorManager.java:349)
at io.prestosql.connector.ConnectorManager.createCatalog(ConnectorManager.java:208)
at io.prestosql.connector.ConnectorManager.createCatalog(ConnectorManager.java:200)
at io.prestosql.connector.ConnectorManager.createCatalog(ConnectorManager.java:186)
at io.prestosql.metadata.StaticCatalogStore.loadCatalog(StaticCatalogStore.java:88)
at io.prestosql.metadata.StaticCatalogStore.loadCatalogs(StaticCatalogStore.java:68)
at io.prestosql.server.PrestoServer.run(PrestoServer.java:118)
at io.prestosql.$gen.Presto_332____20200807_075155_1.run(Unknown Source)
at io.prestosql.server.PrestoServer.main(PrestoServer.java:72)
Caused by: java.lang.IllegalArgumentException: java.lang.reflect.InvocationTargetException
at org.apache.bval.util.MethodAccess.get(MethodAccess.java:93)
at org.apache.bval.BeanValidationContext.getPropertyValue(BeanValidationContext.java:170)
at org.apache.bval.jsr.GroupValidationContextImpl.getValidatedValue(GroupValidationContextImpl.java:294)
at org.apache.bval.jsr.ConstraintValidation.validateGroupContext(ConstraintValidation.java:229)
at org.apache.bval.jsr.ConstraintValidation.validate(ConstraintValidation.java:144)
at org.apache.bval.util.ValidationHelper.validateProperty(ValidationHelper.java:234)
at org.apache.bval.jsr.ClassValidator.validateBean(ClassValidator.java:462)
at org.apache.bval.jsr.ClassValidator.validateBeanNet(ClassValidator.java:409)
at org.apache.bval.jsr.ClassValidator.validateBeanWithGroups(ClassValidator.java:154)
at org.apache.bval.jsr.ClassValidator.validate(ClassValidator.java:142)
... 16 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.bval.util.MethodAccess.get(MethodAccess.java:89)
... 25 more
Caused by: java.lang.LinkageError: ClassCastException: attempting to castjar:file:/usr/lib/presto/lib/javax.ws.rs-api-2.1.jar!/javax/ws/rs/client/ClientBuilder.class to jar:file:/usr/lib/presto/plugin/pulsar-presto-connector/jakarta.ws.rs-api-2.1.6.jar!/javax/ws/rs/client/ClientBuilder.class
at javax.ws.rs.client.ClientBuilder.newBuilder(ClientBuilder.java:78)
at org.apache.pulsar.client.admin.PulsarAdmin.<init>(PulsarAdmin.java:174)
at org.apache.pulsar.client.admin.internal.PulsarAdminBuilderImpl.build(PulsarAdminBuilderImpl.java:45)
at org.apache.pulsar.sql.presto.PulsarConnectorConfig.getPulsarAdmin(PulsarConnectorConfig.java:399)
... 30 more```
Anybody have any ideas on how to fix?
----
2020-08-07 17:40:33 UTC - Rich Adams: And I’m using pulsar from current master.
----
2020-08-07 17:59:00 UTC - Caleb Epstein: Maybe try 2.6.0?
----
2020-08-07 17:59:28 UTC - Caleb Epstein: Does look like some kind of interface incompatibility
----
2020-08-07 17:59:45 UTC - Caleb Epstein: Caused by: java.lang.LinkageError: ClassCastException:
----
2020-08-07 18:05:59 UTC - Rich Adams: Yeah from javax to jakarta. I have a version that I built with 2.6.0 but that uses an old version of presto that can’t handle uppercase letters in jdbc table names. Trying to see if I can fix that with a more recent version.
----
2020-08-07 22:45:16 UTC - Jay Sun: @Jay Sun has joined the channel
----
2020-08-07 22:55:37 UTC - Jay Sun: Hi guys, I am new to pulsar. I am trying to create a client with TLS in golang. By diving into the code, I realized that passing the path to the cert and key was the only way to create the authentication. However, I already have the `*tls.certificate` object from memory and don't want to dump the cert/key to some temp files. I am wondering how, if it is possible, to provide a customized provider (the provider interface is private and there is a type check in `auth.impl.go` to try to cast it to `auth.Provider`)?
----
2020-08-08 04:18:30 UTC - Chris Wong: @Chris Wong has joined the channel
----
2020-08-08 04:46:41 UTC - Sijie Guo: I would try to follow up to make it work.
----