You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Santosh Akhilesh <sa...@gmail.com> on 2015/02/12 09:16:20 UTC
About building kylin
Hi All ,
I am building Kylin on Ubuntu which is installed on my laptop.
I dont have sandbox environment.
I have downloaded following from apache site
1. apache-hive-1.0.0
2. hadoop-2.6.0
3. hbase-0.94.26
I have downloaded the staging branch Kylin code and run the
./sandbox_deploy.sh
The deploy scrip fails @ line 116
./sandbox_deploy.sh: line 116: hbase: command not found
ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
Can someone tell me what steps I need to do to make it work. Do I need
to start hbase , hive and hadoop before running the deploy script. If yes
is there any steps in which order to run and any special care need to be
taken.
--
Regards,
Santosh Akhilesh
+91-0-9845482201
Re: About building kylin
Posted by "Zhou, Qianhao" <qi...@ebay.com>.
Hi, Santosh
The log seems that you cannot connect to zookeeper, which port is by
default 2181.
Can you please check if hbase has been started correctly, and the
hbase-site.xml in your hbase classpath has correct configuration of
zookeeper for your VM.
Best Regard
Zhou QianHao
On 2/13/15, 5:08 PM, "Santoshakhilesh" <sa...@huawei.com> wrote:
>Hi Zhou,
> The exceptions I see are below , So it seems Kylin instance is not
>deployed correctly;
>
>WARNING: Failed to scan [file:/contrib/capacity-scheduler/*.jar] from
>classloader hierarchy
>java.io.FileNotFoundException: /contrib/capacity-scheduler/*.jar (No such
>file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:215)
> at java.util.zip.ZipFile.<init>(ZipFile.java:145)
> at java.util.jar.JarFile.<init>(JarFile.java:154)
> at java.util.jar.JarFile.<init>(JarFile.java:91)
>
>Feb 13, 2015 10:27:32 PM org.apache.catalina.startup.ContextConfig
>processResourceJARs
>SEVERE: Failed to processes JAR found at URL
>[jar:file:/contrib/capacity-scheduler/*.jar!/] for static resources to be
>included in context with name
>[jar:file:/contrib/capacity-scheduler/*.jar!/]
>
>resource loaded through InputStream
>[localhost-startStop-1]:[2015-02-13
>22:27:34,475][WARN][org.apache.kylin.common.KylinConfig.getKylinProperties
>(KylinConfig.java:527)] - KYLIN_CONF_HOME has not been set
>2015-02-13 22:27:34,919 INFO [localhost-startStop-1]
>zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x2b5a652e
>connecting to ZooKeeper ensemble=localhost:2181
>
>2015-02-13 22:27:34,958 INFO
>[localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn:
>Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will
>not attempt to authenticate using SASL (unknown error)
>2015-02-13 22:27:34,965 WARN
>[localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn:
>Session 0x0 for server null, unexpected error, closing socket connection
>and attempting reconnect
>java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at
>org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.j
>ava:361)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
>2015-02-13 22:27:35,070 INFO
>[localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn:
>Opening socket connection to server localhost/127.0.0.1:2181. Will not
>attempt to authenticate using SASL (unknown error)
>
>2015-02-13 22:27:51,920 WARN [localhost-startStop-1]
>zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper,
>quorum=localhost:2181,
>exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
>KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
>2015-02-13 22:27:51,921 ERROR [localhost-startStop-1]
>zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 4 attempts
>2015-02-13 22:27:51,921 WARN [localhost-startStop-1] zookeeper.ZKUtil:
>hconnection-0x2b5a652e, quorum=localhost:2181, baseZNode=/hbase Unable to
>set watcher on znode (/hbase/hbaseid)
>org.apache.zookeeper.KeeperException$ConnectionLossException:
>KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
> at
>org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZ
>ooKeeper.java:222)
> at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:479)
> at
>org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKCluster
>Id.java:65)
> at
>org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperReg
>istry.java:83)
> at
>org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementatio
>n.retrieveClusterId(HConnectionManager.java:897)
> at
>org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementatio
>n.<init>(HConnectionManager.java:694)
>
>
>Regards,
>Santosh Akhilesh
>Bangalore R&D
>HUAWEI TECHNOLOGIES CO.,LTD.
>
>www.huawei.com
>--------------------------------------------------------------------------
>-----------------------------------------------------------
>This e-mail and its attachments contain confidential information from
>HUAWEI, which
>is intended only for the person or entity whose address is listed above.
>Any use of the
>information contained herein in any way (including, but not limited to,
>total or partial
>disclosure, reproduction, or dissemination) by persons other than the
>intended
>recipient(s) is prohibited. If you receive this e-mail in error, please
>notify the sender by
>phone or email immediately and delete it!
>
>________________________________________
>From: Zhou, Qianhao [qianzhou@ebay.com]
>Sent: Friday, February 13, 2015 2:07 PM
>To: dev@kylin.incubator.apache.org
>Subject: Re: About building kylin
>
>Hi, Santosh
>Please check tomcat/logs/kylin.log to see if there is any exception
>
>Best Regard
>Zhou QianHao
>
>
>
>
>
>On 2/13/15, 4:24 PM, "Santoshakhilesh" <sa...@huawei.com>
>wrote:
>
>>Hi Zhou,
>> I am able to access the http://127.0.0.17070/kylin using firefox
>> All I get is a blank page , its not 404 , it means I could connect
>>to web server successfully but there is some issue in rendering. I was
>>noty asked for user name and password.
>> When I run start kylin shell file , following prompt really means
>>everuthing went ok , or I should check some log files to know the real
>>status ?
>>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>>
>>Regards,
>>Santosh Akhilesh
>>Bangalore R&D
>>HUAWEI TECHNOLOGIES CO.,LTD.
>>
>>www.huawei.com
>>-------------------------------------------------------------------------
>>-
>>-----------------------------------------------------------
>>This e-mail and its attachments contain confidential information from
>>HUAWEI, which
>>is intended only for the person or entity whose address is listed above.
>>Any use of the
>>information contained herein in any way (including, but not limited to,
>>total or partial
>>disclosure, reproduction, or dissemination) by persons other than the
>>intended
>>recipient(s) is prohibited. If you receive this e-mail in error, please
>>notify the sender by
>>phone or email immediately and delete it!
>>
>>________________________________________
>>From: Zhou, Qianhao [qianzhou@ebay.com]
>>Sent: Friday, February 13, 2015 1:04 PM
>>To: dev@kylin.incubator.apache.org
>>Cc: Kulbhushan Rana
>>Subject: Re: About building kylin
>>
>>Hi, Santosh
>> You will see a kylin.war inside ${KYLIN_HOME}/tomcat/webapps. That is
>>the server war package. The tomcat version is 7.0.59.
>> If you want to bind 0.0.0.0:7070, please refer to the tomcat
>>document,
>>there should be some configurations to let you do that.
>>
>>Best Regard
>>Zhou QianHao
>>
>>
>>
>>
>>
>>On 2/13/15, 1:46 PM, "Santoshakhilesh" <sa...@huawei.com>
>>wrote:
>>
>>>Hi Zhou,
>>> Due to some practical constarints , I have to setup clusster
>>>manually.
>>> I have downloaded all the dependency like hadoop , hbase , hive ,
>>>tomcat and I have run the check-env.sh after it passes , I have run the
>>>start-kylin.sh
>>> Following is the log on console after running the ./start-kylin.sh.
>>> Does this mean everything is ok or I should check some other logs
>>>?
>>>Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin
>>>from outside the machine.
>>> Is it possible to bind it to 0.0.0.0 :7070 so that I can connect
>>>from
>>>outside the lab network ? Where can I configure this ?
>>>
>>> ./start-kylin.sh
>>>Checking KYLIN_HOME...
>>>KYLIN_HOME is set to /opt/kylinb
>>>Checking hbase...
>>>hbase check passed
>>>Checking hive...
>>>hive check passed
>>>Checking hadoop...
>>>hadoop check passed
>>>Logging initialized using configuration in
>>>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hi
>>>v
>>>e
>>>-log4j.properties
>>>SLF4J: Class path contains multiple SLF4J bindings.
>>>SLF4J: Found binding in
>>>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12
>>>-
>>>1
>>>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>>SLF4J: Found binding in
>>>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalo
>>>n
>>>e
>>>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>>explanation.
>>>SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>>hive dependency:
>>>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcat
>>>a
>>>l
>>>og/*
>>>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>>>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>>>(Useranme: ADMIN, Password: KYLIN)
>>>You can check the log at ./../tomcat/logs/kylin.log
>>>
>>>Regards,
>>>Santosh Akhilesh
>>>Bangalore R&D
>>>HUAWEI TECHNOLOGIES CO.,LTD.
>>>
>>>www.huawei.com
>>>------------------------------------------------------------------------
>>>-
>>>-
>>>-----------------------------------------------------------
>>>This e-mail and its attachments contain confidential information from
>>>HUAWEI, which
>>>is intended only for the person or entity whose address is listed above.
>>>Any use of the
>>>information contained herein in any way (including, but not limited to,
>>>total or partial
>>>disclosure, reproduction, or dissemination) by persons other than the
>>>intended
>>>recipient(s) is prohibited. If you receive this e-mail in error, please
>>>notify the sender by
>>>phone or email immediately and delete it!
>>>
>>>________________________________________
>>>From: Zhou, Qianhao [qianzhou@ebay.com]
>>>Sent: Thursday, February 12, 2015 2:59 PM
>>>To: dev@kylin.incubator.apache.org
>>>Subject: Re: About building kylin
>>>
>>>Hi Santosh
>>> Surely you can run kylin on single node.
>>> Currently kylin is depend on
>>> 1. Hive (where source data come from)
>>> 2. HBase (where metadata and pre-computed data stored)
>>> However once you have the hadoop environment ready, it does not
>>>matter
>>>how many vm running in the cluster.
>>> As for your circumstances, a sandbox is strongly recommended which
>>>will
>>>save you a lot of time of setting up the environment. Hortonworks or
>>>Cloudera will be good choice.
>>>
>>>Best Regard
>>>Zhou QianHao
RE: About building kylin
Posted by Santoshakhilesh <sa...@huawei.com>.
I saw the following link about creating the cube.
https://github.com/KylinOLAP/Kylin/wiki/Kylin-Cube-Creation-Tutorial
In this there is already source table EDW exist , But in my environment there is no such table.
How can I create this table manually or I need to export from somewhere ?
Also , how do I insert tables , data in table when I start creating my own cubes and tables ?
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Santoshakhilesh [santosh.akhilesh@huawei.com]
Sent: Friday, February 13, 2015 5:40 PM
To: dev@kylin.incubator.apache.org
Subject: RE: About building kylin
Hi Zhou,
Thanks a million, it was hbase issue , now I am able to login to main interface page.
In the documents I see a section of building cubes. are there any sample cubles I can try with ?
Can you please tell me where can I get them and steps to import and query them.
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Santoshakhilesh [santosh.akhilesh@huawei.com]
Sent: Friday, February 13, 2015 2:38 PM
To: dev@kylin.incubator.apache.org
Cc: Kulbhushan Rana
Subject: RE: About building kylin
Hi Zhou,
The exceptions I see are below , So it seems Kylin instance is not deployed correctly;
WARNING: Failed to scan [file:/contrib/capacity-scheduler/*.jar] from classloader hierarchy
java.io.FileNotFoundException: /contrib/capacity-scheduler/*.jar (No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:91)
Feb 13, 2015 10:27:32 PM org.apache.catalina.startup.ContextConfig processResourceJARs
SEVERE: Failed to processes JAR found at URL [jar:file:/contrib/capacity-scheduler/*.jar!/] for static resources to be included in context with name [jar:file:/contrib/capacity-scheduler/*.jar!/]
resource loaded through InputStream
[localhost-startStop-1]:[2015-02-13 22:27:34,475][WARN][org.apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:527)] - KYLIN_CONF_HOME has not been set
2015-02-13 22:27:34,919 INFO [localhost-startStop-1] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x2b5a652e connecting to ZooKeeper ensemble=localhost:2181
2015-02-13 22:27:34,958 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-02-13 22:27:34,965 WARN [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2015-02-13 22:27:35,070 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-02-13 22:27:51,920 WARN [localhost-startStop-1] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
2015-02-13 22:27:51,921 ERROR [localhost-startStop-1] zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 4 attempts
2015-02-13 22:27:51,921 WARN [localhost-startStop-1] zookeeper.ZKUtil: hconnection-0x2b5a652e, quorum=localhost:2181, baseZNode=/hbase Unable to set watcher on znode (/hbase/hbaseid)
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:222)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:479)
at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:65)
at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:897)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:694)
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Zhou, Qianhao [qianzhou@ebay.com]
Sent: Friday, February 13, 2015 2:07 PM
To: dev@kylin.incubator.apache.org
Subject: Re: About building kylin
Hi, Santosh
Please check tomcat/logs/kylin.log to see if there is any exception
Best Regard
Zhou QianHao
On 2/13/15, 4:24 PM, "Santoshakhilesh" <sa...@huawei.com> wrote:
>Hi Zhou,
> I am able to access the http://127.0.0.17070/kylin using firefox
> All I get is a blank page , its not 404 , it means I could connect
>to web server successfully but there is some issue in rendering. I was
>noty asked for user name and password.
> When I run start kylin shell file , following prompt really means
>everuthing went ok , or I should check some log files to know the real
>status ?
>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>
>Regards,
>Santosh Akhilesh
>Bangalore R&D
>HUAWEI TECHNOLOGIES CO.,LTD.
>
>www.huawei.com
>--------------------------------------------------------------------------
>-----------------------------------------------------------
>This e-mail and its attachments contain confidential information from
>HUAWEI, which
>is intended only for the person or entity whose address is listed above.
>Any use of the
>information contained herein in any way (including, but not limited to,
>total or partial
>disclosure, reproduction, or dissemination) by persons other than the
>intended
>recipient(s) is prohibited. If you receive this e-mail in error, please
>notify the sender by
>phone or email immediately and delete it!
>
>________________________________________
>From: Zhou, Qianhao [qianzhou@ebay.com]
>Sent: Friday, February 13, 2015 1:04 PM
>To: dev@kylin.incubator.apache.org
>Cc: Kulbhushan Rana
>Subject: Re: About building kylin
>
>Hi, Santosh
> You will see a kylin.war inside ${KYLIN_HOME}/tomcat/webapps. That is
>the server war package. The tomcat version is 7.0.59.
> If you want to bind 0.0.0.0:7070, please refer to the tomcat document,
>there should be some configurations to let you do that.
>
>Best Regard
>Zhou QianHao
>
>
>
>
>
>On 2/13/15, 1:46 PM, "Santoshakhilesh" <sa...@huawei.com>
>wrote:
>
>>Hi Zhou,
>> Due to some practical constarints , I have to setup clusster
>>manually.
>> I have downloaded all the dependency like hadoop , hbase , hive ,
>>tomcat and I have run the check-env.sh after it passes , I have run the
>>start-kylin.sh
>> Following is the log on console after running the ./start-kylin.sh.
>> Does this mean everything is ok or I should check some other logs ?
>>Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin
>>from outside the machine.
>> Is it possible to bind it to 0.0.0.0 :7070 so that I can connect from
>>outside the lab network ? Where can I configure this ?
>>
>> ./start-kylin.sh
>>Checking KYLIN_HOME...
>>KYLIN_HOME is set to /opt/kylinb
>>Checking hbase...
>>hbase check passed
>>Checking hive...
>>hive check passed
>>Checking hadoop...
>>hadoop check passed
>>Logging initialized using configuration in
>>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hiv
>>e
>>-log4j.properties
>>SLF4J: Class path contains multiple SLF4J bindings.
>>SLF4J: Found binding in
>>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-
>>1
>>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: Found binding in
>>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalon
>>e
>>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>explanation.
>>SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>hive dependency:
>>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcata
>>l
>>og/*
>>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>>(Useranme: ADMIN, Password: KYLIN)
>>You can check the log at ./../tomcat/logs/kylin.log
>>
>>Regards,
>>Santosh Akhilesh
>>Bangalore R&D
>>HUAWEI TECHNOLOGIES CO.,LTD.
>>
>>www.huawei.com
>>-------------------------------------------------------------------------
>>-
>>-----------------------------------------------------------
>>This e-mail and its attachments contain confidential information from
>>HUAWEI, which
>>is intended only for the person or entity whose address is listed above.
>>Any use of the
>>information contained herein in any way (including, but not limited to,
>>total or partial
>>disclosure, reproduction, or dissemination) by persons other than the
>>intended
>>recipient(s) is prohibited. If you receive this e-mail in error, please
>>notify the sender by
>>phone or email immediately and delete it!
>>
>>________________________________________
>>From: Zhou, Qianhao [qianzhou@ebay.com]
>>Sent: Thursday, February 12, 2015 2:59 PM
>>To: dev@kylin.incubator.apache.org
>>Subject: Re: About building kylin
>>
>>Hi Santosh
>> Surely you can run kylin on single node.
>> Currently kylin is depend on
>> 1. Hive (where source data come from)
>> 2. HBase (where metadata and pre-computed data stored)
>> However once you have the hadoop environment ready, it does not matter
>>how many vm running in the cluster.
>> As for your circumstances, a sandbox is strongly recommended which
>>will
>>save you a lot of time of setting up the environment. Hortonworks or
>>Cloudera will be good choice.
>>
>>Best Regard
>>Zhou QianHao
RE: About building kylin
Posted by Santoshakhilesh <sa...@huawei.com>.
Hi Zhou,
Thanks a million, it was hbase issue , now I am able to login to main interface page.
In the documents I see a section of building cubes. are there any sample cubles I can try with ?
Can you please tell me where can I get them and steps to import and query them.
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Santoshakhilesh [santosh.akhilesh@huawei.com]
Sent: Friday, February 13, 2015 2:38 PM
To: dev@kylin.incubator.apache.org
Cc: Kulbhushan Rana
Subject: RE: About building kylin
Hi Zhou,
The exceptions I see are below , So it seems Kylin instance is not deployed correctly;
WARNING: Failed to scan [file:/contrib/capacity-scheduler/*.jar] from classloader hierarchy
java.io.FileNotFoundException: /contrib/capacity-scheduler/*.jar (No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:91)
Feb 13, 2015 10:27:32 PM org.apache.catalina.startup.ContextConfig processResourceJARs
SEVERE: Failed to processes JAR found at URL [jar:file:/contrib/capacity-scheduler/*.jar!/] for static resources to be included in context with name [jar:file:/contrib/capacity-scheduler/*.jar!/]
resource loaded through InputStream
[localhost-startStop-1]:[2015-02-13 22:27:34,475][WARN][org.apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:527)] - KYLIN_CONF_HOME has not been set
2015-02-13 22:27:34,919 INFO [localhost-startStop-1] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x2b5a652e connecting to ZooKeeper ensemble=localhost:2181
2015-02-13 22:27:34,958 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-02-13 22:27:34,965 WARN [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2015-02-13 22:27:35,070 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-02-13 22:27:51,920 WARN [localhost-startStop-1] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
2015-02-13 22:27:51,921 ERROR [localhost-startStop-1] zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 4 attempts
2015-02-13 22:27:51,921 WARN [localhost-startStop-1] zookeeper.ZKUtil: hconnection-0x2b5a652e, quorum=localhost:2181, baseZNode=/hbase Unable to set watcher on znode (/hbase/hbaseid)
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:222)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:479)
at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:65)
at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:897)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:694)
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Zhou, Qianhao [qianzhou@ebay.com]
Sent: Friday, February 13, 2015 2:07 PM
To: dev@kylin.incubator.apache.org
Subject: Re: About building kylin
Hi, Santosh
Please check tomcat/logs/kylin.log to see if there is any exception
Best Regard
Zhou QianHao
On 2/13/15, 4:24 PM, "Santoshakhilesh" <sa...@huawei.com> wrote:
>Hi Zhou,
> I am able to access the http://127.0.0.17070/kylin using firefox
> All I get is a blank page , its not 404 , it means I could connect
>to web server successfully but there is some issue in rendering. I was
>noty asked for user name and password.
> When I run start kylin shell file , following prompt really means
>everuthing went ok , or I should check some log files to know the real
>status ?
>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>
>Regards,
>Santosh Akhilesh
>Bangalore R&D
>HUAWEI TECHNOLOGIES CO.,LTD.
>
>www.huawei.com
>--------------------------------------------------------------------------
>-----------------------------------------------------------
>This e-mail and its attachments contain confidential information from
>HUAWEI, which
>is intended only for the person or entity whose address is listed above.
>Any use of the
>information contained herein in any way (including, but not limited to,
>total or partial
>disclosure, reproduction, or dissemination) by persons other than the
>intended
>recipient(s) is prohibited. If you receive this e-mail in error, please
>notify the sender by
>phone or email immediately and delete it!
>
>________________________________________
>From: Zhou, Qianhao [qianzhou@ebay.com]
>Sent: Friday, February 13, 2015 1:04 PM
>To: dev@kylin.incubator.apache.org
>Cc: Kulbhushan Rana
>Subject: Re: About building kylin
>
>Hi, Santosh
> You will see a kylin.war inside ${KYLIN_HOME}/tomcat/webapps. That is
>the server war package. The tomcat version is 7.0.59.
> If you want to bind 0.0.0.0:7070, please refer to the tomcat document,
>there should be some configurations to let you do that.
>
>Best Regard
>Zhou QianHao
>
>
>
>
>
>On 2/13/15, 1:46 PM, "Santoshakhilesh" <sa...@huawei.com>
>wrote:
>
>>Hi Zhou,
>> Due to some practical constarints , I have to setup clusster
>>manually.
>> I have downloaded all the dependency like hadoop , hbase , hive ,
>>tomcat and I have run the check-env.sh after it passes , I have run the
>>start-kylin.sh
>> Following is the log on console after running the ./start-kylin.sh.
>> Does this mean everything is ok or I should check some other logs ?
>>Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin
>>from outside the machine.
>> Is it possible to bind it to 0.0.0.0 :7070 so that I can connect from
>>outside the lab network ? Where can I configure this ?
>>
>> ./start-kylin.sh
>>Checking KYLIN_HOME...
>>KYLIN_HOME is set to /opt/kylinb
>>Checking hbase...
>>hbase check passed
>>Checking hive...
>>hive check passed
>>Checking hadoop...
>>hadoop check passed
>>Logging initialized using configuration in
>>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hiv
>>e
>>-log4j.properties
>>SLF4J: Class path contains multiple SLF4J bindings.
>>SLF4J: Found binding in
>>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-
>>1
>>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: Found binding in
>>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalon
>>e
>>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>explanation.
>>SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>hive dependency:
>>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcata
>>l
>>og/*
>>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>>(Useranme: ADMIN, Password: KYLIN)
>>You can check the log at ./../tomcat/logs/kylin.log
>>
>>Regards,
>>Santosh Akhilesh
>>Bangalore R&D
>>HUAWEI TECHNOLOGIES CO.,LTD.
>>
>>www.huawei.com
>>-------------------------------------------------------------------------
>>-
>>-----------------------------------------------------------
>>This e-mail and its attachments contain confidential information from
>>HUAWEI, which
>>is intended only for the person or entity whose address is listed above.
>>Any use of the
>>information contained herein in any way (including, but not limited to,
>>total or partial
>>disclosure, reproduction, or dissemination) by persons other than the
>>intended
>>recipient(s) is prohibited. If you receive this e-mail in error, please
>>notify the sender by
>>phone or email immediately and delete it!
>>
>>________________________________________
>>From: Zhou, Qianhao [qianzhou@ebay.com]
>>Sent: Thursday, February 12, 2015 2:59 PM
>>To: dev@kylin.incubator.apache.org
>>Subject: Re: About building kylin
>>
>>Hi Santosh
>> Surely you can run kylin on single node.
>> Currently kylin is depend on
>> 1. Hive (where source data come from)
>> 2. HBase (where metadata and pre-computed data stored)
>> However once you have the hadoop environment ready, it does not matter
>>how many vm running in the cluster.
>> As for your circumstances, a sandbox is strongly recommended which
>>will
>>save you a lot of time of setting up the environment. Hortonworks or
>>Cloudera will be good choice.
>>
>>Best Regard
>>Zhou QianHao
RE: About building kylin
Posted by Santoshakhilesh <sa...@huawei.com>.
Hi Zhou,
The exceptions I see are below , So it seems Kylin instance is not deployed correctly;
WARNING: Failed to scan [file:/contrib/capacity-scheduler/*.jar] from classloader hierarchy
java.io.FileNotFoundException: /contrib/capacity-scheduler/*.jar (No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:91)
Feb 13, 2015 10:27:32 PM org.apache.catalina.startup.ContextConfig processResourceJARs
SEVERE: Failed to processes JAR found at URL [jar:file:/contrib/capacity-scheduler/*.jar!/] for static resources to be included in context with name [jar:file:/contrib/capacity-scheduler/*.jar!/]
resource loaded through InputStream
[localhost-startStop-1]:[2015-02-13 22:27:34,475][WARN][org.apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:527)] - KYLIN_CONF_HOME has not been set
2015-02-13 22:27:34,919 INFO [localhost-startStop-1] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x2b5a652e connecting to ZooKeeper ensemble=localhost:2181
2015-02-13 22:27:34,958 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-02-13 22:27:34,965 WARN [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2015-02-13 22:27:35,070 INFO [localhost-startStop-1-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-02-13 22:27:51,920 WARN [localhost-startStop-1] zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
2015-02-13 22:27:51,921 ERROR [localhost-startStop-1] zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 4 attempts
2015-02-13 22:27:51,921 WARN [localhost-startStop-1] zookeeper.ZKUtil: hconnection-0x2b5a652e, quorum=localhost:2181, baseZNode=/hbase Unable to set watcher on znode (/hbase/hbaseid)
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:222)
at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(ZKUtil.java:479)
at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:65)
at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:897)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:694)
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Zhou, Qianhao [qianzhou@ebay.com]
Sent: Friday, February 13, 2015 2:07 PM
To: dev@kylin.incubator.apache.org
Subject: Re: About building kylin
Hi, Santosh
Please check tomcat/logs/kylin.log to see if there is any exception
Best Regard
Zhou QianHao
On 2/13/15, 4:24 PM, "Santoshakhilesh" <sa...@huawei.com> wrote:
>Hi Zhou,
> I am able to access the http://127.0.0.17070/kylin using firefox
> All I get is a blank page , its not 404 , it means I could connect
>to web server successfully but there is some issue in rendering. I was
>noty asked for user name and password.
> When I run start kylin shell file , following prompt really means
>everuthing went ok , or I should check some log files to know the real
>status ?
>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>
>Regards,
>Santosh Akhilesh
>Bangalore R&D
>HUAWEI TECHNOLOGIES CO.,LTD.
>
>www.huawei.com
>--------------------------------------------------------------------------
>-----------------------------------------------------------
>This e-mail and its attachments contain confidential information from
>HUAWEI, which
>is intended only for the person or entity whose address is listed above.
>Any use of the
>information contained herein in any way (including, but not limited to,
>total or partial
>disclosure, reproduction, or dissemination) by persons other than the
>intended
>recipient(s) is prohibited. If you receive this e-mail in error, please
>notify the sender by
>phone or email immediately and delete it!
>
>________________________________________
>From: Zhou, Qianhao [qianzhou@ebay.com]
>Sent: Friday, February 13, 2015 1:04 PM
>To: dev@kylin.incubator.apache.org
>Cc: Kulbhushan Rana
>Subject: Re: About building kylin
>
>Hi, Santosh
> You will see a kylin.war inside ${KYLIN_HOME}/tomcat/webapps. That is
>the server war package. The tomcat version is 7.0.59.
> If you want to bind 0.0.0.0:7070, please refer to the tomcat document,
>there should be some configurations to let you do that.
>
>Best Regard
>Zhou QianHao
>
>
>
>
>
>On 2/13/15, 1:46 PM, "Santoshakhilesh" <sa...@huawei.com>
>wrote:
>
>>Hi Zhou,
>> Due to some practical constarints , I have to setup clusster
>>manually.
>> I have downloaded all the dependency like hadoop , hbase , hive ,
>>tomcat and I have run the check-env.sh after it passes , I have run the
>>start-kylin.sh
>> Following is the log on console after running the ./start-kylin.sh.
>> Does this mean everything is ok or I should check some other logs ?
>>Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin
>>from outside the machine.
>> Is it possible to bind it to 0.0.0.0 :7070 so that I can connect from
>>outside the lab network ? Where can I configure this ?
>>
>> ./start-kylin.sh
>>Checking KYLIN_HOME...
>>KYLIN_HOME is set to /opt/kylinb
>>Checking hbase...
>>hbase check passed
>>Checking hive...
>>hive check passed
>>Checking hadoop...
>>hadoop check passed
>>Logging initialized using configuration in
>>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hiv
>>e
>>-log4j.properties
>>SLF4J: Class path contains multiple SLF4J bindings.
>>SLF4J: Found binding in
>>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-
>>1
>>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: Found binding in
>>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalon
>>e
>>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>explanation.
>>SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>hive dependency:
>>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcata
>>l
>>og/*
>>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>>(Useranme: ADMIN, Password: KYLIN)
>>You can check the log at ./../tomcat/logs/kylin.log
>>
>>Regards,
>>Santosh Akhilesh
>>Bangalore R&D
>>HUAWEI TECHNOLOGIES CO.,LTD.
>>
>>www.huawei.com
>>-------------------------------------------------------------------------
>>-
>>-----------------------------------------------------------
>>This e-mail and its attachments contain confidential information from
>>HUAWEI, which
>>is intended only for the person or entity whose address is listed above.
>>Any use of the
>>information contained herein in any way (including, but not limited to,
>>total or partial
>>disclosure, reproduction, or dissemination) by persons other than the
>>intended
>>recipient(s) is prohibited. If you receive this e-mail in error, please
>>notify the sender by
>>phone or email immediately and delete it!
>>
>>________________________________________
>>From: Zhou, Qianhao [qianzhou@ebay.com]
>>Sent: Thursday, February 12, 2015 2:59 PM
>>To: dev@kylin.incubator.apache.org
>>Subject: Re: About building kylin
>>
>>Hi Santosh
>> Surely you can run kylin on single node.
>> Currently kylin is depend on
>> 1. Hive (where source data come from)
>> 2. HBase (where metadata and pre-computed data stored)
>> However once you have the hadoop environment ready, it does not matter
>>how many vm running in the cluster.
>> As for your circumstances, a sandbox is strongly recommended which
>>will
>>save you a lot of time of setting up the environment. Hortonworks or
>>Cloudera will be good choice.
>>
>>Best Regard
>>Zhou QianHao
Re: About building kylin
Posted by "Zhou, Qianhao" <qi...@ebay.com>.
Hi, Santosh
Please check tomcat/logs/kylin.log to see if there is any exception
Best Regard
Zhou QianHao
On 2/13/15, 4:24 PM, "Santoshakhilesh" <sa...@huawei.com> wrote:
>Hi Zhou,
> I am able to access the http://127.0.0.17070/kylin using firefox
> All I get is a blank page , its not 404 , it means I could connect
>to web server successfully but there is some issue in rendering. I was
>noty asked for user name and password.
> When I run start kylin shell file , following prompt really means
>everuthing went ok , or I should check some log files to know the real
>status ?
>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>
>Regards,
>Santosh Akhilesh
>Bangalore R&D
>HUAWEI TECHNOLOGIES CO.,LTD.
>
>www.huawei.com
>--------------------------------------------------------------------------
>-----------------------------------------------------------
>This e-mail and its attachments contain confidential information from
>HUAWEI, which
>is intended only for the person or entity whose address is listed above.
>Any use of the
>information contained herein in any way (including, but not limited to,
>total or partial
>disclosure, reproduction, or dissemination) by persons other than the
>intended
>recipient(s) is prohibited. If you receive this e-mail in error, please
>notify the sender by
>phone or email immediately and delete it!
>
>________________________________________
>From: Zhou, Qianhao [qianzhou@ebay.com]
>Sent: Friday, February 13, 2015 1:04 PM
>To: dev@kylin.incubator.apache.org
>Cc: Kulbhushan Rana
>Subject: Re: About building kylin
>
>Hi, Santosh
> You will see a kylin.war inside ${KYLIN_HOME}/tomcat/webapps. That is
>the server war package. The tomcat version is 7.0.59.
> If you want to bind 0.0.0.0:7070, please refer to the tomcat document,
>there should be some configurations to let you do that.
>
>Best Regard
>Zhou QianHao
>
>
>
>
>
>On 2/13/15, 1:46 PM, "Santoshakhilesh" <sa...@huawei.com>
>wrote:
>
>>Hi Zhou,
>> Due to some practical constarints , I have to setup clusster
>>manually.
>> I have downloaded all the dependency like hadoop , hbase , hive ,
>>tomcat and I have run the check-env.sh after it passes , I have run the
>>start-kylin.sh
>> Following is the log on console after running the ./start-kylin.sh.
>> Does this mean everything is ok or I should check some other logs ?
>>Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin
>>from outside the machine.
>> Is it possible to bind it to 0.0.0.0 :7070 so that I can connect from
>>outside the lab network ? Where can I configure this ?
>>
>> ./start-kylin.sh
>>Checking KYLIN_HOME...
>>KYLIN_HOME is set to /opt/kylinb
>>Checking hbase...
>>hbase check passed
>>Checking hive...
>>hive check passed
>>Checking hadoop...
>>hadoop check passed
>>Logging initialized using configuration in
>>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hiv
>>e
>>-log4j.properties
>>SLF4J: Class path contains multiple SLF4J bindings.
>>SLF4J: Found binding in
>>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-
>>1
>>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: Found binding in
>>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalon
>>e
>>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>explanation.
>>SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>hive dependency:
>>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcata
>>l
>>og/*
>>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>>(Useranme: ADMIN, Password: KYLIN)
>>You can check the log at ./../tomcat/logs/kylin.log
>>
>>Regards,
>>Santosh Akhilesh
>>Bangalore R&D
>>HUAWEI TECHNOLOGIES CO.,LTD.
>>
>>www.huawei.com
>>-------------------------------------------------------------------------
>>-
>>-----------------------------------------------------------
>>This e-mail and its attachments contain confidential information from
>>HUAWEI, which
>>is intended only for the person or entity whose address is listed above.
>>Any use of the
>>information contained herein in any way (including, but not limited to,
>>total or partial
>>disclosure, reproduction, or dissemination) by persons other than the
>>intended
>>recipient(s) is prohibited. If you receive this e-mail in error, please
>>notify the sender by
>>phone or email immediately and delete it!
>>
>>________________________________________
>>From: Zhou, Qianhao [qianzhou@ebay.com]
>>Sent: Thursday, February 12, 2015 2:59 PM
>>To: dev@kylin.incubator.apache.org
>>Subject: Re: About building kylin
>>
>>Hi Santosh
>> Surely you can run kylin on single node.
>> Currently kylin is depend on
>> 1. Hive (where source data come from)
>> 2. HBase (where metadata and pre-computed data stored)
>> However once you have the hadoop environment ready, it does not matter
>>how many vm running in the cluster.
>> As for your circumstances, a sandbox is strongly recommended which
>>will
>>save you a lot of time of setting up the environment. Hortonworks or
>>Cloudera will be good choice.
>>
>>Best Regard
>>Zhou QianHao
RE: About building kylin
Posted by Santoshakhilesh <sa...@huawei.com>.
Hi Zhou,
I am able to access the http://127.0.0.17070/kylin using firefox
All I get is a blank page , its not 404 , it means I could connect to web server successfully but there is some issue in rendering. I was noty asked for user name and password.
When I run start kylin shell file , following prompt really means everuthing went ok , or I should check some log files to know the real status ?
A new Kylin instance is started by root, stop it using "stop-kylin.sh"
Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Zhou, Qianhao [qianzhou@ebay.com]
Sent: Friday, February 13, 2015 1:04 PM
To: dev@kylin.incubator.apache.org
Cc: Kulbhushan Rana
Subject: Re: About building kylin
Hi, Santosh
You will see a kylin.war inside ${KYLIN_HOME}/tomcat/webapps. That is
the server war package. The tomcat version is 7.0.59.
If you want to bind 0.0.0.0:7070, please refer to the tomcat document,
there should be some configurations to let you do that.
Best Regard
Zhou QianHao
On 2/13/15, 1:46 PM, "Santoshakhilesh" <sa...@huawei.com> wrote:
>Hi Zhou,
> Due to some practical constarints , I have to setup clusster
>manually.
> I have downloaded all the dependency like hadoop , hbase , hive ,
>tomcat and I have run the check-env.sh after it passes , I have run the
>start-kylin.sh
> Following is the log on console after running the ./start-kylin.sh.
> Does this mean everything is ok or I should check some other logs ?
>Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin
>from outside the machine.
> Is it possible to bind it to 0.0.0.0 :7070 so that I can connect from
>outside the lab network ? Where can I configure this ?
>
> ./start-kylin.sh
>Checking KYLIN_HOME...
>KYLIN_HOME is set to /opt/kylinb
>Checking hbase...
>hbase check passed
>Checking hive...
>hive check passed
>Checking hadoop...
>hadoop check passed
>Logging initialized using configuration in
>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hive
>-log4j.properties
>SLF4J: Class path contains multiple SLF4J bindings.
>SLF4J: Found binding in
>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1
>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>SLF4J: Found binding in
>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalone
>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>explanation.
>SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>hive dependency:
>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcatal
>og/*
>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>(Useranme: ADMIN, Password: KYLIN)
>You can check the log at ./../tomcat/logs/kylin.log
>
>Regards,
>Santosh Akhilesh
>Bangalore R&D
>HUAWEI TECHNOLOGIES CO.,LTD.
>
>www.huawei.com
>--------------------------------------------------------------------------
>-----------------------------------------------------------
>This e-mail and its attachments contain confidential information from
>HUAWEI, which
>is intended only for the person or entity whose address is listed above.
>Any use of the
>information contained herein in any way (including, but not limited to,
>total or partial
>disclosure, reproduction, or dissemination) by persons other than the
>intended
>recipient(s) is prohibited. If you receive this e-mail in error, please
>notify the sender by
>phone or email immediately and delete it!
>
>________________________________________
>From: Zhou, Qianhao [qianzhou@ebay.com]
>Sent: Thursday, February 12, 2015 2:59 PM
>To: dev@kylin.incubator.apache.org
>Subject: Re: About building kylin
>
>Hi Santosh
> Surely you can run kylin on single node.
> Currently kylin is depend on
> 1. Hive (where source data come from)
> 2. HBase (where metadata and pre-computed data stored)
> However once you have the hadoop environment ready, it does not matter
>how many vm running in the cluster.
> As for your circumstances, a sandbox is strongly recommended which will
>save you a lot of time of setting up the environment. Hortonworks or
>Cloudera will be good choice.
>
>Best Regard
>Zhou QianHao
Re: About building kylin
Posted by "Zhou, Qianhao" <qi...@ebay.com>.
Hi, Santosh
You will see a kylin.war inside ${KYLIN_HOME}/tomcat/webapps. That is
the server war package. The tomcat version is 7.0.59.
If you want to bind 0.0.0.0:7070, please refer to the tomcat document,
there should be some configurations to let you do that.
Best Regard
Zhou QianHao
On 2/13/15, 1:46 PM, "Santoshakhilesh" <sa...@huawei.com> wrote:
>Hi Zhou,
> Due to some practical constarints , I have to setup clusster
>manually.
> I have downloaded all the dependency like hadoop , hbase , hive ,
>tomcat and I have run the check-env.sh after it passes , I have run the
>start-kylin.sh
> Following is the log on console after running the ./start-kylin.sh.
> Does this mean everything is ok or I should check some other logs ?
>Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin
>from outside the machine.
> Is it possible to bind it to 0.0.0.0 :7070 so that I can connect from
>outside the lab network ? Where can I configure this ?
>
> ./start-kylin.sh
>Checking KYLIN_HOME...
>KYLIN_HOME is set to /opt/kylinb
>Checking hbase...
>hbase check passed
>Checking hive...
>hive check passed
>Checking hadoop...
>hadoop check passed
>Logging initialized using configuration in
>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hive
>-log4j.properties
>SLF4J: Class path contains multiple SLF4J bindings.
>SLF4J: Found binding in
>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1
>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>SLF4J: Found binding in
>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalone
>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>explanation.
>SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>hive dependency:
>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcatal
>og/*
>A new Kylin instance is started by root, stop it using "stop-kylin.sh"
>Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes!
>(Useranme: ADMIN, Password: KYLIN)
>You can check the log at ./../tomcat/logs/kylin.log
>
>Regards,
>Santosh Akhilesh
>Bangalore R&D
>HUAWEI TECHNOLOGIES CO.,LTD.
>
>www.huawei.com
>--------------------------------------------------------------------------
>-----------------------------------------------------------
>This e-mail and its attachments contain confidential information from
>HUAWEI, which
>is intended only for the person or entity whose address is listed above.
>Any use of the
>information contained herein in any way (including, but not limited to,
>total or partial
>disclosure, reproduction, or dissemination) by persons other than the
>intended
>recipient(s) is prohibited. If you receive this e-mail in error, please
>notify the sender by
>phone or email immediately and delete it!
>
>________________________________________
>From: Zhou, Qianhao [qianzhou@ebay.com]
>Sent: Thursday, February 12, 2015 2:59 PM
>To: dev@kylin.incubator.apache.org
>Subject: Re: About building kylin
>
>Hi Santosh
> Surely you can run kylin on single node.
> Currently kylin is depend on
> 1. Hive (where source data come from)
> 2. HBase (where metadata and pre-computed data stored)
> However once you have the hadoop environment ready, it does not matter
>how many vm running in the cluster.
> As for your circumstances, a sandbox is strongly recommended which will
>save you a lot of time of setting up the environment. Hortonworks or
>Cloudera will be good choice.
>
>Best Regard
>Zhou QianHao
RE: About building kylin
Posted by Santoshakhilesh <sa...@huawei.com>.
Hi Zhou,
Due to some practical constarints , I have to setup clusster manually.
I have downloaded all the dependency like hadoop , hbase , hive , tomcat and I have run the check-env.sh after it passes , I have run the start-kylin.sh
Following is the log on console after running the ./start-kylin.sh.
Does this mean everything is ok or I should check some other logs ? Currently I am unable to login to http://<your_sandbox_ip>:7070/kylin from outside the machine.
Is it possible to bind it to 0.0.0.0 :7070 so that I can connect from outside the lab network ? Where can I configure this ?
./start-kylin.sh
Checking KYLIN_HOME...
KYLIN_HOME is set to /opt/kylinb
Checking hbase...
hbase check passed
Checking hive...
hive check passed
Checking hadoop...
hadoop check passed
Logging initialized using configuration in jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-common-0.14.0.jar!/hive-log4j.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-0.14.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
hive dependency: /usr/hdp/current/hive-client/conf/:/hive/lib/*:/hive-hcatalog/share/hcatalog/*
A new Kylin instance is started by root, stop it using "stop-kylin.sh"
Please visit http://<your_sandbox_ip>:7070/kylin to play with the cubes! (Useranme: ADMIN, Password: KYLIN)
You can check the log at ./../tomcat/logs/kylin.log
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Zhou, Qianhao [qianzhou@ebay.com]
Sent: Thursday, February 12, 2015 2:59 PM
To: dev@kylin.incubator.apache.org
Subject: Re: About building kylin
Hi Santosh
Surely you can run kylin on single node.
Currently kylin is depend on
1. Hive (where source data come from)
2. HBase (where metadata and pre-computed data stored)
However once you have the hadoop environment ready, it does not matter
how many vm running in the cluster.
As for your circumstances, a sandbox is strongly recommended which will
save you a lot of time of setting up the environment. Hortonworks or
Cloudera will be good choice.
Best Regard
Zhou QianHao
Re: About building kylin
Posted by "Zhou, Qianhao" <qi...@ebay.com>.
Hi Santosh
Surely you can run kylin on single node.
Currently kylin is depend on
1. Hive (where source data come from)
2. HBase (where metadata and pre-computed data stored)
However once you have the hadoop environment ready, it does not matter
how many vm running in the cluster.
As for your circumstances, a sandbox is strongly recommended which will
save you a lot of time of setting up the environment. Hortonworks or
Cloudera will be good choice.
Best Regard
Zhou QianHao
On 2/12/15, 5:01 PM, "Santosh Akhilesh" <sa...@gmail.com> wrote:
>Hi Zhou ,
> Thanks for the binary package , it means I dont need to build Kylin
>manually.
> Just wanted to know if I have hadoop , hbase and hive downloaded , I
>can use Kylin for single node.
> Actually I am evaluating Kylin for our project which might need to
>be
>distributed in future but currently has a single node we need the multi
>dimension analysis.
> If I can run and deploy on single node ?
>Regards,
>Santosh Akhilesh
>
>
>
>On Thu, Feb 12, 2015 at 2:12 PM, Zhou, Qianhao <qi...@ebay.com> wrote:
>
>> Hi Santosh
>> A new download page is now available
>> http://kylin.incubator.apache.org/download/
>>
>> If you are just planning to run sandbox on your work station,
>> You can download the kylin-0.7.1-SNAPSHOT.tgz package,
>> And installation guide is as below
>>
>>https://github.com/KylinOLAP/Kylin/blob/inverted-index/docs/Installation/
>>in
>> stall_and_run.md
>>
>>
>> PS: the tgz package is now stable, please don¹t use in production
>> environment.
>>
>>
>> Best Regard
>> Zhou QianHao
>>
>>
>>
>>
>>
>> On 2/12/15, 4:33 PM, "Santosh Akhilesh" <sa...@gmail.com>
>>wrote:
>>
>> >Hi ,
>> > I modify the deploy the script to point to hbase location
>> > After running , I get following exception , I feel I need to set
>>some
>> >environment variables , can you please help me to know those.
>> >
>> >15/02/12 13:58:32 INFO util.ChecksumType: Checksum can use
>> >java.util.zip.CRC32
>> >15/02/12 13:58:32 DEBUG util.FSUtils: Creating
>> >file=file:/tmp/test6931875838599334487.tmp with permission=rwxrwxrwx
>> >15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
>> >getDefaultReplication
>> >15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
>> >getDefaultBlockSize
>> >15/02/12 13:58:32 WARN util.NativeCodeLoader: Unable to load
>>native-hadoop
>> >library for your platform... using builtin-java classes where
>>applicable
>> >15/02/12 13:58:32 WARN metrics.SchemaConfigured: Could not determine
>>table
>> >and column family of the HFile path
>>file:/tmp/test6931875838599334487.tmp.
>> >Expecting at least 5 path components.
>> >Exception in thread "main" java.lang.NullPointerException
>> > at
>>
>>>com.kylinolap.job.deployment.HbaseConfigPrinter$ConfigLoader$7.loadValue
>>>(H
>> >baseConfigPrinter.java:114)
>> > at
>>
>>>com.kylinolap.job.deployment.HbaseConfigPrinter.printConfigs(HbaseConfig
>>>Pr
>> >inter.java:45)
>> > at
>>
>>>com.kylinolap.job.deployment.HbaseConfigPrinter.main(HbaseConfigPrinter.
>>>ja
>> >va:30)
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>>
>>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
>>>a:
>> >57)
>> > at
>>
>>>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
>>>Im
>> >pl.java:43)
>> > at java.lang.reflect.Method.invoke(Method.java:606)
>> > at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> >ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 1
>> >
>> >---------- Forwarded message ----------
>> >From: Santosh Akhilesh <sa...@gmail.com>
>> >Date: Thu, Feb 12, 2015 at 1:46 PM
>> >Subject: About building kylin
>> >To: dev@kylin.incubator.apache.org
>> >
>> >
>> >Hi All ,
>> > I am building Kylin on Ubuntu which is installed on my laptop.
>> >
>> > I dont have sandbox environment.
>> >
>> > I have downloaded following from apache site
>> > 1. apache-hive-1.0.0
>> > 2. hadoop-2.6.0
>> > 3. hbase-0.94.26
>> >
>> > I have downloaded the staging branch Kylin code and run the
>> >./sandbox_deploy.sh
>> >
>> > The deploy scrip fails @ line 116
>> >./sandbox_deploy.sh: line 116: hbase: command not found
>> >ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
>> >
>> > Can someone tell me what steps I need to do to make it work. Do I
>>need
>> >to start hbase , hive and hadoop before running the deploy script. If
>>yes
>> >is there any steps in which order to run and any special care need to
>>be
>> >taken.
>> >
>> >
>> >--
>> >Regards,
>> >Santosh Akhilesh
>> >+91-0-9845482201
>> >
>> >
>> >
>> >--
>> >Regards,
>> >Santosh Akhilesh
>> >+91-0-9845482201
>>
>>
>
>
>--
>Regards,
>Santosh Akhilesh
>+91-0-9845482201
Re: About building kylin
Posted by Santosh Akhilesh <sa...@gmail.com>.
Hi Zhou ,
Thanks for the binary package , it means I dont need to build Kylin
manually.
Just wanted to know if I have hadoop , hbase and hive downloaded , I
can use Kylin for single node.
Actually I am evaluating Kylin for our project which might need to be
distributed in future but currently has a single node we need the multi
dimension analysis.
If I can run and deploy on single node ?
Regards,
Santosh Akhilesh
On Thu, Feb 12, 2015 at 2:12 PM, Zhou, Qianhao <qi...@ebay.com> wrote:
> Hi Santosh
> A new download page is now available
> http://kylin.incubator.apache.org/download/
>
> If you are just planning to run sandbox on your work station,
> You can download the kylin-0.7.1-SNAPSHOT.tgz package,
> And installation guide is as below
> https://github.com/KylinOLAP/Kylin/blob/inverted-index/docs/Installation/in
> stall_and_run.md
>
>
> PS: the tgz package is now stable, please don¹t use in production
> environment.
>
>
> Best Regard
> Zhou QianHao
>
>
>
>
>
> On 2/12/15, 4:33 PM, "Santosh Akhilesh" <sa...@gmail.com> wrote:
>
> >Hi ,
> > I modify the deploy the script to point to hbase location
> > After running , I get following exception , I feel I need to set some
> >environment variables , can you please help me to know those.
> >
> >15/02/12 13:58:32 INFO util.ChecksumType: Checksum can use
> >java.util.zip.CRC32
> >15/02/12 13:58:32 DEBUG util.FSUtils: Creating
> >file=file:/tmp/test6931875838599334487.tmp with permission=rwxrwxrwx
> >15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
> >getDefaultReplication
> >15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
> >getDefaultBlockSize
> >15/02/12 13:58:32 WARN util.NativeCodeLoader: Unable to load native-hadoop
> >library for your platform... using builtin-java classes where applicable
> >15/02/12 13:58:32 WARN metrics.SchemaConfigured: Could not determine table
> >and column family of the HFile path file:/tmp/test6931875838599334487.tmp.
> >Expecting at least 5 path components.
> >Exception in thread "main" java.lang.NullPointerException
> > at
> >com.kylinolap.job.deployment.HbaseConfigPrinter$ConfigLoader$7.loadValue(H
> >baseConfigPrinter.java:114)
> > at
> >com.kylinolap.job.deployment.HbaseConfigPrinter.printConfigs(HbaseConfigPr
> >inter.java:45)
> > at
> >com.kylinolap.job.deployment.HbaseConfigPrinter.main(HbaseConfigPrinter.ja
> >va:30)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> >57)
> > at
> >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
> >pl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> >ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 1
> >
> >---------- Forwarded message ----------
> >From: Santosh Akhilesh <sa...@gmail.com>
> >Date: Thu, Feb 12, 2015 at 1:46 PM
> >Subject: About building kylin
> >To: dev@kylin.incubator.apache.org
> >
> >
> >Hi All ,
> > I am building Kylin on Ubuntu which is installed on my laptop.
> >
> > I dont have sandbox environment.
> >
> > I have downloaded following from apache site
> > 1. apache-hive-1.0.0
> > 2. hadoop-2.6.0
> > 3. hbase-0.94.26
> >
> > I have downloaded the staging branch Kylin code and run the
> >./sandbox_deploy.sh
> >
> > The deploy scrip fails @ line 116
> >./sandbox_deploy.sh: line 116: hbase: command not found
> >ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
> >
> > Can someone tell me what steps I need to do to make it work. Do I need
> >to start hbase , hive and hadoop before running the deploy script. If yes
> >is there any steps in which order to run and any special care need to be
> >taken.
> >
> >
> >--
> >Regards,
> >Santosh Akhilesh
> >+91-0-9845482201
> >
> >
> >
> >--
> >Regards,
> >Santosh Akhilesh
> >+91-0-9845482201
>
>
--
Regards,
Santosh Akhilesh
+91-0-9845482201
Re: About building kylin
Posted by "Zhou, Qianhao" <qi...@ebay.com>.
Hi Santosh
A new download page is now available
http://kylin.incubator.apache.org/download/
If you are just planning to run sandbox on your work station,
You can download the kylin-0.7.1-SNAPSHOT.tgz package,
And installation guide is as below
https://github.com/KylinOLAP/Kylin/blob/inverted-index/docs/Installation/in
stall_and_run.md
PS: the tgz package is now stable, please don¹t use in production
environment.
Best Regard
Zhou QianHao
On 2/12/15, 4:33 PM, "Santosh Akhilesh" <sa...@gmail.com> wrote:
>Hi ,
> I modify the deploy the script to point to hbase location
> After running , I get following exception , I feel I need to set some
>environment variables , can you please help me to know those.
>
>15/02/12 13:58:32 INFO util.ChecksumType: Checksum can use
>java.util.zip.CRC32
>15/02/12 13:58:32 DEBUG util.FSUtils: Creating
>file=file:/tmp/test6931875838599334487.tmp with permission=rwxrwxrwx
>15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
>getDefaultReplication
>15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
>getDefaultBlockSize
>15/02/12 13:58:32 WARN util.NativeCodeLoader: Unable to load native-hadoop
>library for your platform... using builtin-java classes where applicable
>15/02/12 13:58:32 WARN metrics.SchemaConfigured: Could not determine table
>and column family of the HFile path file:/tmp/test6931875838599334487.tmp.
>Expecting at least 5 path components.
>Exception in thread "main" java.lang.NullPointerException
> at
>com.kylinolap.job.deployment.HbaseConfigPrinter$ConfigLoader$7.loadValue(H
>baseConfigPrinter.java:114)
> at
>com.kylinolap.job.deployment.HbaseConfigPrinter.printConfigs(HbaseConfigPr
>inter.java:45)
> at
>com.kylinolap.job.deployment.HbaseConfigPrinter.main(HbaseConfigPrinter.ja
>va:30)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
>57)
> at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
>pl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 1
>
>---------- Forwarded message ----------
>From: Santosh Akhilesh <sa...@gmail.com>
>Date: Thu, Feb 12, 2015 at 1:46 PM
>Subject: About building kylin
>To: dev@kylin.incubator.apache.org
>
>
>Hi All ,
> I am building Kylin on Ubuntu which is installed on my laptop.
>
> I dont have sandbox environment.
>
> I have downloaded following from apache site
> 1. apache-hive-1.0.0
> 2. hadoop-2.6.0
> 3. hbase-0.94.26
>
> I have downloaded the staging branch Kylin code and run the
>./sandbox_deploy.sh
>
> The deploy scrip fails @ line 116
>./sandbox_deploy.sh: line 116: hbase: command not found
>ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
>
> Can someone tell me what steps I need to do to make it work. Do I need
>to start hbase , hive and hadoop before running the deploy script. If yes
>is there any steps in which order to run and any special care need to be
>taken.
>
>
>--
>Regards,
>Santosh Akhilesh
>+91-0-9845482201
>
>
>
>--
>Regards,
>Santosh Akhilesh
>+91-0-9845482201
Fwd: About building kylin
Posted by Santosh Akhilesh <sa...@gmail.com>.
Hi ,
I modify the deploy the script to point to hbase location
After running , I get following exception , I feel I need to set some
environment variables , can you please help me to know those.
15/02/12 13:58:32 INFO util.ChecksumType: Checksum can use
java.util.zip.CRC32
15/02/12 13:58:32 DEBUG util.FSUtils: Creating
file=file:/tmp/test6931875838599334487.tmp with permission=rwxrwxrwx
15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
getDefaultReplication
15/02/12 13:58:32 INFO util.FSUtils: FileSystem doesn't support
getDefaultBlockSize
15/02/12 13:58:32 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/02/12 13:58:32 WARN metrics.SchemaConfigured: Could not determine table
and column family of the HFile path file:/tmp/test6931875838599334487.tmp.
Expecting at least 5 path components.
Exception in thread "main" java.lang.NullPointerException
at
com.kylinolap.job.deployment.HbaseConfigPrinter$ConfigLoader$7.loadValue(HbaseConfigPrinter.java:114)
at
com.kylinolap.job.deployment.HbaseConfigPrinter.printConfigs(HbaseConfigPrinter.java:45)
at
com.kylinolap.job.deployment.HbaseConfigPrinter.main(HbaseConfigPrinter.java:30)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 1
---------- Forwarded message ----------
From: Santosh Akhilesh <sa...@gmail.com>
Date: Thu, Feb 12, 2015 at 1:46 PM
Subject: About building kylin
To: dev@kylin.incubator.apache.org
Hi All ,
I am building Kylin on Ubuntu which is installed on my laptop.
I dont have sandbox environment.
I have downloaded following from apache site
1. apache-hive-1.0.0
2. hadoop-2.6.0
3. hbase-0.94.26
I have downloaded the staging branch Kylin code and run the
./sandbox_deploy.sh
The deploy scrip fails @ line 116
./sandbox_deploy.sh: line 116: hbase: command not found
ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
Can someone tell me what steps I need to do to make it work. Do I need
to start hbase , hive and hadoop before running the deploy script. If yes
is there any steps in which order to run and any special care need to be
taken.
--
Regards,
Santosh Akhilesh
+91-0-9845482201
--
Regards,
Santosh Akhilesh
+91-0-9845482201
Re: About building kylin
Posted by "Shi, Shaofeng" <sh...@ebay.com>.
Hi Santosh, the single node is okay: actually the HDP Sandbox is a
all-in-one box; You can also use Amabri to setup a cluster which just has
1 node. The point is, that will be much efficient that setup the
individual components (hdfs, zookeeper, hbase, hive, blabla…) manually.
On 2/12/15, 4:46 PM, "Santosh Akhilesh" <sa...@gmail.com> wrote:
>Hi Shi ,
> Thanks for quick response , Is it not possible to have it running it
>on single node as I can run spark ?
> I have already downloaded hbase , hive and hadoop can I make a single
>node cluster and try it ?
>Regards,
>Santosh Akhilesh
>
>
>On Thu, Feb 12, 2015 at 2:04 PM, Shi, Shaofeng <sh...@ebay.com> wrote:
>
>> Hi Santosh,
>>
>> Kylin need be deployed in a hadoop cluster with hbase and hive be
>> installed and configured. It is recommended to use Apache Ambari to
>>setup
>> (if you don¹t have) such a cluster, instead of install by hands; Or you
>> can use HDP Sandbox (a VM image with all packages installed), which is
>> discussed on
>> https://github.com/KylinOLAP/Kylin/wiki/On-Hadoop-CLI-installation
>>
>> Another easy way, if you just want to take a trial, you can run Kylin
>>with
>> docker: https://registry.hub.docker.com/u/sequenceiq/kylin/
>>
>> On 2/12/15, 4:16 PM, "Santosh Akhilesh" <sa...@gmail.com>
>>wrote:
>>
>> >Hi All ,
>> > I am building Kylin on Ubuntu which is installed on my laptop.
>> >
>> > I dont have sandbox environment.
>> >
>> > I have downloaded following from apache site
>> > 1. apache-hive-1.0.0
>> > 2. hadoop-2.6.0
>> > 3. hbase-0.94.26
>> >
>> > I have downloaded the staging branch Kylin code and run the
>> >./sandbox_deploy.sh
>> >
>> > The deploy scrip fails @ line 116
>> >./sandbox_deploy.sh: line 116: hbase: command not found
>> >ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
>> >
>> > Can someone tell me what steps I need to do to make it work. Do I
>>need
>> >to start hbase , hive and hadoop before running the deploy script. If
>>yes
>> >is there any steps in which order to run and any special care need to
>>be
>> >taken.
>> >
>> >
>> >--
>> >Regards,
>> >Santosh Akhilesh
>> >+91-0-9845482201
>>
>>
>
>
>--
>Regards,
>Santosh Akhilesh
>+91-0-9845482201
Re: About building kylin
Posted by Santosh Akhilesh <sa...@gmail.com>.
Hi Shi ,
Thanks for quick response , Is it not possible to have it running it
on single node as I can run spark ?
I have already downloaded hbase , hive and hadoop can I make a single
node cluster and try it ?
Regards,
Santosh Akhilesh
On Thu, Feb 12, 2015 at 2:04 PM, Shi, Shaofeng <sh...@ebay.com> wrote:
> Hi Santosh,
>
> Kylin need be deployed in a hadoop cluster with hbase and hive be
> installed and configured. It is recommended to use Apache Ambari to setup
> (if you don¹t have) such a cluster, instead of install by hands; Or you
> can use HDP Sandbox (a VM image with all packages installed), which is
> discussed on
> https://github.com/KylinOLAP/Kylin/wiki/On-Hadoop-CLI-installation
>
> Another easy way, if you just want to take a trial, you can run Kylin with
> docker: https://registry.hub.docker.com/u/sequenceiq/kylin/
>
> On 2/12/15, 4:16 PM, "Santosh Akhilesh" <sa...@gmail.com> wrote:
>
> >Hi All ,
> > I am building Kylin on Ubuntu which is installed on my laptop.
> >
> > I dont have sandbox environment.
> >
> > I have downloaded following from apache site
> > 1. apache-hive-1.0.0
> > 2. hadoop-2.6.0
> > 3. hbase-0.94.26
> >
> > I have downloaded the staging branch Kylin code and run the
> >./sandbox_deploy.sh
> >
> > The deploy scrip fails @ line 116
> >./sandbox_deploy.sh: line 116: hbase: command not found
> >ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
> >
> > Can someone tell me what steps I need to do to make it work. Do I need
> >to start hbase , hive and hadoop before running the deploy script. If yes
> >is there any steps in which order to run and any special care need to be
> >taken.
> >
> >
> >--
> >Regards,
> >Santosh Akhilesh
> >+91-0-9845482201
>
>
--
Regards,
Santosh Akhilesh
+91-0-9845482201
Re: About building kylin
Posted by "Shi, Shaofeng" <sh...@ebay.com>.
Hi Santosh,
Kylin need be deployed in a hadoop cluster with hbase and hive be
installed and configured. It is recommended to use Apache Ambari to setup
(if you don¹t have) such a cluster, instead of install by hands; Or you
can use HDP Sandbox (a VM image with all packages installed), which is
discussed on
https://github.com/KylinOLAP/Kylin/wiki/On-Hadoop-CLI-installation
Another easy way, if you just want to take a trial, you can run Kylin with
docker: https://registry.hub.docker.com/u/sequenceiq/kylin/
On 2/12/15, 4:16 PM, "Santosh Akhilesh" <sa...@gmail.com> wrote:
>Hi All ,
> I am building Kylin on Ubuntu which is installed on my laptop.
>
> I dont have sandbox environment.
>
> I have downloaded following from apache site
> 1. apache-hive-1.0.0
> 2. hadoop-2.6.0
> 3. hbase-0.94.26
>
> I have downloaded the staging branch Kylin code and run the
>./sandbox_deploy.sh
>
> The deploy scrip fails @ line 116
>./sandbox_deploy.sh: line 116: hbase: command not found
>ERROR exit from ./sandbox_deploy.sh : line 116 with exit code 127
>
> Can someone tell me what steps I need to do to make it work. Do I need
>to start hbase , hive and hadoop before running the deploy script. If yes
>is there any steps in which order to run and any special care need to be
>taken.
>
>
>--
>Regards,
>Santosh Akhilesh
>+91-0-9845482201