You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Gaspare Maria <ga...@gfmintegration.it> on 2015/06/12 17:50:06 UTC
Problem running kylin 0.7.1 with IBM Open Platform with Apache Hadoop
4.0
Hi,
I am trying to test kylin by using as hadoop CLI "BigInsights IBM Open
Platform with Apache Hadoop 4.0".
Environment:
* kylin-0.7.1-incubating-SNAPSHOT
* BigInsights IBM Open Platform with Apache Hadoop 4.0
* KYLIN_HOME=/opt/apache/kylin/kylin-0.7.1-incubating-SNAPSHOT ==>
Directory where I put kylin
* $ java -version
java version "1.7.0_75"
OpenJDK Runtime Environment (rhel-2.5.4.0.el6_6-x86_64 u75-b13)
OpenJDK 64-Bit Server VM (build 24.75-b04, mixed mode)
NOTE: IBM Open Platform with Apache Hadoop 4.0 works with the
openJDK. Anyway, I tried also with SUN JDK but result is the same
* KYLIN_CONF=/etc/kylin ==> I set also
KYLIN_EXTRA_START_OPTS="-DKYLIN_CONF=/etc/kylin" end copied the cfg
files also in /etc/kylin
* Both hadoop CLI and kylin run on the same server
Kylin dosen's start properly and I see the following log related to
problems with ldap.
[localhost-startStop-1]:[2015-06-12
17:25:25,827][INFO][org.apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:544)]
- Use KYLIN_CONF=/etc/kylin
[localhost-startStop-1]:[2015-06-12
17:25:25,863][INFO][org.springframework.core.io.support.PropertiesLoaderSupport.loadProperties(PropertiesLoaderSupport.java:177)]
- Loading properties file from resource loaded through InputStream
[localhost-startStop-1]:[2015-06-12
17:25:25,905][ERROR][org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:307)]
- Context initialization failed
org.springframework.beans.factory.BeanDefinitionStoreException: Invalid
bean definition with name 'ldapSource' defined in class path resource
[kylinSecurity.xml]: Input length must be multiple of 16 when decrypting
with padded cipher
at
org.springframework.beans.factory.config.PlaceholderConfigurerSupport.doProcessProperties(PlaceholderConfigurerSupport.java:209)
at
org.springframework.beans.factory.config.PropertyPlaceholderConfigurer.processProperties(PropertyPlaceholderConfigurer.java:220)
at
org.springframework.beans.factory.config.PropertyResourceConfigurer.postProcessBeanFactory(PropertyResourceConfigurer.java:84)
at
org.springframework.context.support.AbstractApplicationContext.invokeBeanFactoryPostProcessors(AbstractApplicationContext.java:686)
at
org.springframework.context.support.AbstractApplicationContext.invokeBeanFactoryPostProcessors(AbstractApplicationContext.java:661)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:451)
at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:383)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5016)
at
org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5524)
at
org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901)
at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877)
at
org.apache.catalina.core.StandardHost.addChild(StandardHost.java:649)
at
org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1081)
at
org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1877)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Jun 12, 2015 5:25:25 PM org.apache.catalina.core.StandardContext
startInternal
SEVERE: Error listenerStart
Jun 12, 2015 5:25:25 PM org.apache.catalina.core.StandardContext
startInternal
SEVERE: Context [/kylin] startup failed due to previous errors
Jun 12, 2015 5:25:25 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deployment of web application archive
/opt/apache/kylin/kylin-0.7.1-incubating-SNAPSHOT/tomcat/webapps/kylin.war
has finished in 11,533 ms
Jun 12, 2015 5:25:25 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["http-bio-7070"]
Jun 12, 2015 5:25:25 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["ajp-bio-9009"]
Jun 12, 2015 5:25:25 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 11574 ms
rceConfigurer.java:84)
19,1 48%
Is it possible to disable LDAP usage ?
Could you please provide some feedbacks ?
In attach the log file and the cfg files.
Thanks in advance.
BR,
-- gas
Re: Problem running kylin 0.7.1 with IBM Open Platform with Apache
Hadoop 4.0
Posted by "Shi, Shaofeng" <sh...@ebay.com>.
Hi Maria,
Firstly, just for your awareness, from 0.7, Kylin will seek the kylin.properties from $KYLIN_HOME/conf folder by default, so you don’t need set KYLIN_CONF in most of the case, unless you want to manage the config in another location then use KYLIN_CONF;
Regarding the error you got, it is a problem of kylin.sh script; please remove the last line from your kylin.properties and then restart Kylin:
#kylin.sandbox=false
Although this setting was commented, the script wasn’t able to check it, so it still got “false” on this property, then uses the LDAP profile; I will create a JIRA on this;
From: Gaspare Maria <ga...@gfmintegration.it>>
Reply-To: "dev@kylin.incubator.apache.org<ma...@kylin.incubator.apache.org>" <de...@kylin.incubator.apache.org>>
Date: Friday, June 12, 2015 at 11:50 PM
To: "dev@kylin.incubator.apache.org<ma...@kylin.incubator.apache.org>" <de...@kylin.incubator.apache.org>>
Subject: Problem running kylin 0.7.1 with IBM Open Platform with Apache Hadoop 4.0
Hi,
I am trying to test kylin by using as hadoop CLI "BigInsights IBM Open Platform with Apache Hadoop 4.0".
Environment:
* kylin-0.7.1-incubating-SNAPSHOT
* BigInsights IBM Open Platform with Apache Hadoop 4.0
* KYLIN_HOME=/opt/apache/kylin/kylin-0.7.1-incubating-SNAPSHOT ==> Directory where I put kylin
* $ java -version
java version "1.7.0_75"
OpenJDK Runtime Environment (rhel-2.5.4.0.el6_6-x86_64 u75-b13)
OpenJDK 64-Bit Server VM (build 24.75-b04, mixed mode)
NOTE: IBM Open Platform with Apache Hadoop 4.0 works with the openJDK. Anyway, I tried also with SUN JDK but result is the same
* KYLIN_CONF=/etc/kylin ==> I set also KYLIN_EXTRA_START_OPTS="-DKYLIN_CONF=/etc/kylin" end copied the cfg files also in /etc/kylin
* Both hadoop CLI and kylin run on the same server
Kylin dosen's start properly and I see the following log related to problems with ldap.
[localhost-startStop-1]:[2015-06-12 17:25:25,827][INFO][org.apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:544)] - Use KYLIN_CONF=/etc/kylin
[localhost-startStop-1]:[2015-06-12 17:25:25,863][INFO][org.springframework.core.io.support.PropertiesLoaderSupport.loadProperties(PropertiesLoaderSupport.java:177)] - Loading properties file from resource loaded through InputStream
[localhost-startStop-1]:[2015-06-12 17:25:25,905][ERROR][org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:307)] - Context initialization failed
org.springframework.beans.factory.BeanDefinitionStoreException: Invalid bean definition with name 'ldapSource' defined in class path resource [kylinSecurity.xml]: Input length must be multiple of 16 when decrypting with padded cipher
at org.springframework.beans.factory.config.PlaceholderConfigurerSupport.doProcessProperties(PlaceholderConfigurerSupport.java:209)
at org.springframework.beans.factory.config.PropertyPlaceholderConfigurer.processProperties(PropertyPlaceholderConfigurer.java:220)
at org.springframework.beans.factory.config.PropertyResourceConfigurer.postProcessBeanFactory(PropertyResourceConfigurer.java:84)
at org.springframework.context.support.AbstractApplicationContext.invokeBeanFactoryPostProcessors(AbstractApplicationContext.java:686)
at org.springframework.context.support.AbstractApplicationContext.invokeBeanFactoryPostProcessors(AbstractApplicationContext.java:661)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:451)
at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:383)
at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:283)
at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:111)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5016)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5524)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:649)
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1081)
at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1877)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Jun 12, 2015 5:25:25 PM org.apache.catalina.core.StandardContext startInternal
SEVERE: Error listenerStart
Jun 12, 2015 5:25:25 PM org.apache.catalina.core.StandardContext startInternal
SEVERE: Context [/kylin] startup failed due to previous errors
Jun 12, 2015 5:25:25 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deployment of web application archive /opt/apache/kylin/kylin-0.7.1-incubating-SNAPSHOT/tomcat/webapps/kylin.war has finished in 11,533 ms
Jun 12, 2015 5:25:25 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["http-bio-7070"]
Jun 12, 2015 5:25:25 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["ajp-bio-9009"]
Jun 12, 2015 5:25:25 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 11574 ms
rceConfigurer.java:84)
19,1 48%
Is it possible to disable LDAP usage ?
Could you please provide some feedbacks ?
In attach the log file and the cfg files.
Thanks in advance.
BR,
-- gas