JDBC Issue with Postgresql

[Zhihong Zhang <zh...@gmail.com>]

I am running kylin from this binary distribution,
 
https://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-3.0.0/apache-kylin-3.0.0-bin-hadoop3.tar.gz <https://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-3.0.0/apache-kylin-3.0.0-bin-hadoop3.tar.gz>
 
However, couldn’t get Postgresql loading with this configuration,
 
kylin.source.default=16
kylin.source.jdbc.connection-url=jdbc:postgresql://xxx <postgresql://xxx>
kylin.source.jdbc.driver=org.postgresql.Driver
kylin.source.jdbc.dialect=postgresql
kylin.source.jdbc.user=postgres
kylin.source.jdbc.pass=xxx
kylin.source.jdbc.sqoop-home=/home/hadoop/sqoop
kylin.source.jdbc.filed-delimiter=|
kylin.source.jdbc.sqoop-mapper-num=4
kylin.source.jdbc.adaptor=org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor
kylin.query.pushdown.runner-class-name=org.apache.kylin.query.pushdown.PushdownRunnerSDKImpl
 
Someone suggested using PostgresqlAdaptor but it’s not included in this release.
 
Here is the exception I am getting,
 
2020-02-18 22:26:29,274 WARN  [http-nio-7070-exec-7] extensible.JdbcSource:50 : DataSource cannot be connected. This may not be required in a MapReduce job.
java.lang.RuntimeException: Failed to get JdbcConnector from env.
        at org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:45)
        at org.apache.kylin.source.jdbc.extensible.JdbcSource.<init>(JdbcSource.java:48)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.kylin.source.SourceManager.createSource(SourceManager.java:116)
        at org.apache.kylin.source.SourceManager.getCachedSource(SourceManager.java:84)
        at org.apache.kylin.source.SourceManager.getProjectSource(SourceManager.java:93)
        at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:284)
        at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
        at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
 
……
 
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.kylin.sdk.datasource.framework.AdaptorFactory.createJdbcAdaptor(AdaptorFactory.java:26)
        at org.apache.kylin.sdk.datasource.framework.SourceConnectorFactory.getJdbcConnector(SourceConnectorFactory.java:43)
        ... 88 more
Caused by: java.lang.NullPointerException
        at org.apache.kylin.sdk.datasource.adaptor.AbstractJdbcAdaptor.getSourceValidationSql(AbstractJdbcAdaptor.java:100)
        at org.apache.kylin.sdk.datasource.adaptor.AbstractJdbcAdaptor.<init>(AbstractJdbcAdaptor.java:86)
        at org.apache.kylin.sdk.datasource.adaptor.DefaultAdaptor.<init>(DefaultAdaptor.java:43)
        ... 94 more
2020-02-18 22:26:29,279 ERROR [http-nio-7070-exec-7] controller.TableController:198 :
java.lang.NullPointerException
        at org.apache.kylin.source.jdbc.extensible.JdbcExplorer.listDatabases(JdbcExplorer.java:58)
        at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:286)
        at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196)
 
…..
 
Any help is appreciated.
 
Thanks!
 
Zhihong Zhang