You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Damion Reeves <da...@contexti.com> on 2016/09/27 04:49:45 UTC

Kylin installation steps on CDH 5.7.x

Hi,

Can anyone point me towards the installation and configuration steps of
Kylin for Cloudera CDH ?

I have an 11-node Proof-Of-Concept CentOS 7.2 cluster running CDH 5.7.x and
I would like to install Kylin on one of the nodes....

I've used the steps shown in this URL
(http://kylin.apache.org/docs/install/) to install Kylin:


Install Kylin
-------------
1. Download latest Kylin binaries at http://kylin.apache.org/download
2. Export KYLIN_HOME pointing to the extracted Kylin folder
3. Make sure the user has the privilege to run hadoop, hive and hbase cmd in
shell. If you are not so sure, you can run bin/check-env.sh, it will print
out the detail information if you have some environment issues.
4. To start Kylin, simply run bin/kylin.sh start
5. To stop Kylin, simply run bin/kylin.sh stop


But it does explain what HBase/CDH client libraries I may need to install on
the node in order to be able to start Kylin....

I attempt to check the environment using the step below (before actually
trying to start Kylin) and a message regarding "Warning: fs.defaultFS is not
set when running "mkdir" command" is displayed:


[root@{FQDN}]# echo $KYLIN_HOME

/var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin

[root@{FQDN}]# echo $PATH

/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin

[root@{FQDN}]# cd /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin

[root@{FQDN}]# ./check-env.sh

KYLIN_HOME is set to /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin
Warning: fs.defaultFS is not set when running "mkdir" command.


What am I missing ?


Cheers,

Damion.

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/Kylin-installation-steps-on-CDH-5-7-x-tp5906.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: Kylin installation steps on CDH 5.7.x

Posted by Li Yang <li...@apache.org>.
Good to know Kylin works on Cloudara 5.8.1.  :-)


On Wed, Sep 28, 2016 at 3:23 PM, Damion Reeves <da...@contexti.com> wrote:

> Thanks Yang, I installed Cloudara 5.8.1 hive/hbase/client libraries on the
> machine where I installed Kylin and everything is good....
>
> I am able to successfully follow the steps at the URL below and have built
> the  sample OLAP cubes....
>
> http://kylin.apache.org/docs/tutorial/kylin_sample.html
>
> On 28 September 2016 at 17:17, Yang [via Apache Kylin] <
> ml-node+s74782n5915h84@n6.nabble.com> wrote:
>
> > You are pretty good. I think the warning is ignoreable.
> >
> > > But it does explain what HBase/CDH client libraries I may need to
> > install
> > on the node in order to be able to start Kylin....
> >
> > It's briefly mentioned in "3. Make sure the user has the privilege to run
> > hadoop, hive and hbase cmd in shell."
> > The message is, the node need to have client lib and config to connect
> > hadoop/hive/hbase. And the shell commands `hive`, `hbase` must be
> > available, which `kylin.sh` will call to detect dependencies
> > automatically.
> >
> > Cheers
> > Yang
> >
> > On Tue, Sep 27, 2016 at 12:49 PM, Damion Reeves <[hidden email]
> > <http:///user/SendEmail.jtp?type=node&node=5915&i=0>> wrote:
> >
> > > Hi,
> > >
> > > Can anyone point me towards the installation and configuration steps of
> > > Kylin for Cloudera CDH ?
> > >
> > > I have an 11-node Proof-Of-Concept CentOS 7.2 cluster running CDH 5.7.x
> > and
> > > I would like to install Kylin on one of the nodes....
> > >
> > > I've used the steps shown in this URL
> > > (http://kylin.apache.org/docs/install/) to install Kylin:
> > >
> > >
> > > Install Kylin
> > > -------------
> > > 1. Download latest Kylin binaries at http://kylin.apache.org/download
> > > 2. Export KYLIN_HOME pointing to the extracted Kylin folder
> > > 3. Make sure the user has the privilege to run hadoop, hive and hbase
> > cmd
> > > in
> > > shell. If you are not so sure, you can run bin/check-env.sh, it will
> > print
> > > out the detail information if you have some environment issues.
> > > 4. To start Kylin, simply run bin/kylin.sh start
> > > 5. To stop Kylin, simply run bin/kylin.sh stop
> > >
> > >
> > > But it does explain what HBase/CDH client libraries I may need to
> > install
> > > on
> > > the node in order to be able to start Kylin....
> > >
> > > I attempt to check the environment using the step below (before
> actually
> > > trying to start Kylin) and a message regarding "Warning: fs.defaultFS
> is
> > > not
> > > set when running "mkdir" command" is displayed:
> > >
> > >
> > > [root@{FQDN}]# echo $KYLIN_HOME
> > >
> > > /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin
> > >
> > > [root@{FQDN}]# echo $PATH
> > >
> > > /usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/
> > > bin:/root/bin:/var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin
> > >
> > > [root@{FQDN}]# cd /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin
> > >
> > > [root@{FQDN}]# ./check-env.sh
> > >
> > > KYLIN_HOME is set to /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin
> > > Warning: fs.defaultFS is not set when running "mkdir" command.
> > >
> > >
> > > What am I missing ?
> > >
> > >
> > > Cheers,
> > >
> > > Damion.
> > >
> > > --
> > > View this message in context: http://apache-kylin.74782.x6.
> > > nabble.com/Kylin-installation-steps-on-CDH-5-7-x-tp5906.html
> > > Sent from the Apache Kylin mailing list archive at Nabble.com.
> > >
> >
> >
> > ------------------------------
> > If you reply to this email, your message will be added to the discussion
> > below:
> > http://apache-kylin.74782.x6.nabble.com/Kylin-installation-
> > steps-on-CDH-5-7-x-tp5906p5915.html
> > To unsubscribe from Kylin installation steps on CDH 5.7.x, click here
> > <http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=
> unsubscribe_by_code&node=5906&code=ZGFtaW9uQGNvbnRleHRpLmNvbXw1OT
> A2fC05NjYyMDIyNjU=>
> > .
> > NAML
> > <http://apache-kylin.74782.x6.nabble.com/template/
> NamlServlet.jtp?macro=macro_viewer&id=instant_html%
> 21nabble%3Aemail.naml&base=nabble.naml.namespaces.
> BasicNamespace-nabble.view.web.template.NabbleNamespace-
> nabble.view.web.template.NodeNamespace&breadcrumbs=
> notify_subscribers%21nabble%3Aemail.naml-instant_emails%
> 21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
> >
>
>
>
> --
> *Regards,*
>
> *Damion Reeves* | Platform Engineer
>
> *Contexti | Big Data Analytics*
> Level 5, 155 Clarence Street Sydney NSW
> damion@contexti.com | +61 422 927 757 | http://www.contexti.com
>
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Kylin-installation-steps-on-CDH-5-7-x-tp5906p5916.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>

Re: Kylin installation steps on CDH 5.7.x

Posted by Damion Reeves <da...@contexti.com>.
Thanks Yang, I installed Cloudara 5.8.1 hive/hbase/client libraries on the
machine where I installed Kylin and everything is good....

I am able to successfully follow the steps at the URL below and have built
the  sample OLAP cubes....

http://kylin.apache.org/docs/tutorial/kylin_sample.html

On 28 September 2016 at 17:17, Yang [via Apache Kylin] <
ml-node+s74782n5915h84@n6.nabble.com> wrote:

> You are pretty good. I think the warning is ignoreable.
>
> > But it does explain what HBase/CDH client libraries I may need to
> install
> on the node in order to be able to start Kylin....
>
> It's briefly mentioned in "3. Make sure the user has the privilege to run
> hadoop, hive and hbase cmd in shell."
> The message is, the node need to have client lib and config to connect
> hadoop/hive/hbase. And the shell commands `hive`, `hbase` must be
> available, which `kylin.sh` will call to detect dependencies
> automatically.
>
> Cheers
> Yang
>
> On Tue, Sep 27, 2016 at 12:49 PM, Damion Reeves <[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=5915&i=0>> wrote:
>
> > Hi,
> >
> > Can anyone point me towards the installation and configuration steps of
> > Kylin for Cloudera CDH ?
> >
> > I have an 11-node Proof-Of-Concept CentOS 7.2 cluster running CDH 5.7.x
> and
> > I would like to install Kylin on one of the nodes....
> >
> > I've used the steps shown in this URL
> > (http://kylin.apache.org/docs/install/) to install Kylin:
> >
> >
> > Install Kylin
> > -------------
> > 1. Download latest Kylin binaries at http://kylin.apache.org/download
> > 2. Export KYLIN_HOME pointing to the extracted Kylin folder
> > 3. Make sure the user has the privilege to run hadoop, hive and hbase
> cmd
> > in
> > shell. If you are not so sure, you can run bin/check-env.sh, it will
> print
> > out the detail information if you have some environment issues.
> > 4. To start Kylin, simply run bin/kylin.sh start
> > 5. To stop Kylin, simply run bin/kylin.sh stop
> >
> >
> > But it does explain what HBase/CDH client libraries I may need to
> install
> > on
> > the node in order to be able to start Kylin....
> >
> > I attempt to check the environment using the step below (before actually
> > trying to start Kylin) and a message regarding "Warning: fs.defaultFS is
> > not
> > set when running "mkdir" command" is displayed:
> >
> >
> > [root@{FQDN}]# echo $KYLIN_HOME
> >
> > /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin
> >
> > [root@{FQDN}]# echo $PATH
> >
> > /usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/
> > bin:/root/bin:/var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin
> >
> > [root@{FQDN}]# cd /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin
> >
> > [root@{FQDN}]# ./check-env.sh
> >
> > KYLIN_HOME is set to /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin
> > Warning: fs.defaultFS is not set when running "mkdir" command.
> >
> >
> > What am I missing ?
> >
> >
> > Cheers,
> >
> > Damion.
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/Kylin-installation-steps-on-CDH-5-7-x-tp5906.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-kylin.74782.x6.nabble.com/Kylin-installation-
> steps-on-CDH-5-7-x-tp5906p5915.html
> To unsubscribe from Kylin installation steps on CDH 5.7.x, click here
> <http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=5906&code=ZGFtaW9uQGNvbnRleHRpLmNvbXw1OTA2fC05NjYyMDIyNjU=>
> .
> NAML
> <http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>



-- 
*Regards,*

*Damion Reeves* | Platform Engineer

*Contexti | Big Data Analytics*
Level 5, 155 Clarence Street Sydney NSW
damion@contexti.com | +61 422 927 757 | http://www.contexti.com


--
View this message in context: http://apache-kylin.74782.x6.nabble.com/Kylin-installation-steps-on-CDH-5-7-x-tp5906p5916.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: Kylin installation steps on CDH 5.7.x

Posted by Li Yang <li...@apache.org>.
You are pretty good. I think the warning is ignoreable.

> But it does explain what HBase/CDH client libraries I may need to install
on the node in order to be able to start Kylin....

It's briefly mentioned in "3. Make sure the user has the privilege to run
hadoop, hive and hbase cmd in shell."
The message is, the node need to have client lib and config to connect
hadoop/hive/hbase. And the shell commands `hive`, `hbase` must be
available, which `kylin.sh` will call to detect dependencies automatically.

Cheers
Yang

On Tue, Sep 27, 2016 at 12:49 PM, Damion Reeves <da...@contexti.com> wrote:

> Hi,
>
> Can anyone point me towards the installation and configuration steps of
> Kylin for Cloudera CDH ?
>
> I have an 11-node Proof-Of-Concept CentOS 7.2 cluster running CDH 5.7.x and
> I would like to install Kylin on one of the nodes....
>
> I've used the steps shown in this URL
> (http://kylin.apache.org/docs/install/) to install Kylin:
>
>
> Install Kylin
> -------------
> 1. Download latest Kylin binaries at http://kylin.apache.org/download
> 2. Export KYLIN_HOME pointing to the extracted Kylin folder
> 3. Make sure the user has the privilege to run hadoop, hive and hbase cmd
> in
> shell. If you are not so sure, you can run bin/check-env.sh, it will print
> out the detail information if you have some environment issues.
> 4. To start Kylin, simply run bin/kylin.sh start
> 5. To stop Kylin, simply run bin/kylin.sh stop
>
>
> But it does explain what HBase/CDH client libraries I may need to install
> on
> the node in order to be able to start Kylin....
>
> I attempt to check the environment using the step below (before actually
> trying to start Kylin) and a message regarding "Warning: fs.defaultFS is
> not
> set when running "mkdir" command" is displayed:
>
>
> [root@{FQDN}]# echo $KYLIN_HOME
>
> /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin
>
> [root@{FQDN}]# echo $PATH
>
> /usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/
> bin:/root/bin:/var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin
>
> [root@{FQDN}]# cd /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin/bin
>
> [root@{FQDN}]# ./check-env.sh
>
> KYLIN_HOME is set to /var/apache_kylin/apache-kylin-1.5.4-cdh5.7-bin
> Warning: fs.defaultFS is not set when running "mkdir" command.
>
>
> What am I missing ?
>
>
> Cheers,
>
> Damion.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Kylin-installation-steps-on-CDH-5-7-x-tp5906.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>