You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Owen Rumney <ow...@owenrumney.co.uk> on 2015/08/25 16:20:12 UTC
Sample cube
Hi
I’m trying to run the sample cube for Kylin using the bin/sample.sh
I found the path to the sample cube wasn’t correct in the script and it’s looking for files in a lib that doesn’t exist. I’ve clean packaged it and moved the jars to a lib folder and moved the examples/sample_cube up a level but the sample script still doesn’t run after creating the hive tables.
Is there an updated sample.sh I can get hold of?
Thanks,
Owen
Re: Sample cube
Posted by Luke Han <lu...@gmail.com>.
Hi Owen,
Would you mind to draft something like blog or guide about how to run
Kylin on Mac and share to community?
Thanks.
Luke
Best Regards!
---------------------
Luke Han
On Thu, Sep 10, 2015 at 5:42 PM, ShaoFeng Shi <sh...@gmail.com> wrote:
> great, thanks for the update; I think you're the first one to run Kylin on
> Mac, hope it runs well in the next steps :)
>
> 2015-09-10 17:35 GMT+08:00 Owen Rumney <ow...@owenrumney.co.uk>:
>
> > Hi
> >
> > Just to close this - I got it working on OSX. Seems the OSX
> impelmentation
> > of cut doesn't support --output-delimiter
> >
> > I got it working with the following substitution in the
> > find-h*-dependency.sh
> >
> > arr=(`echo $hive_classpath | tr ':' ' '`)
> >
> > Thanks again,
> > Owen
> >
> > On 9 September 2015 at 18:12, Owen Rumney <ow...@owenrumney.co.uk> wrote:
> >
> > > That would make sense – I’ve got hadoop/hive/hbase all running on my
> Mac
> > > using tarballs which works fine but I guess cut is not the same as RHEL
> > or
> > > Ubuntu.
> > >
> > > I’ll have a dig around in find-hbase-dependency.sh and see if I can
> tweak
> > > it to work in my env. Otherwise I guess its a VM.
> > >
> > > Thanks for coming back.
> > >
> > > From: "Shi, Shaofeng"
> > > Date: Wednesday, 9 September 2015 13:44
> > > To: Owen Rumney
> > > Cc: "dev@kylin.incubator.apache.org"
> > > Subject: Re: Sample cube
> > >
> > > Hi Owen, what’s the OS version of your server? It seems that the “cut”
> > > command on your server is different with what we usually use; In
> > > $KYLIN_HOME/bin/find-hbase-dependency.sh and find-hive-dependency we
> use
> > > the cut command to get certain jar files’ path; If the jars were not
> > found,
> > > Kylin will fail to startup.
> > >
> > > From: Owen Rumney <ow...@owenrumney.co.uk>
> > > Date: Wednesday, September 9, 2015 at 6:16 PM
> > > To: "Shi, Shaofeng" <sh...@ebay.com>
> > > Subject: Re: Sample cube
> > >
> > > Hi
> > >
> > > The sample cube has been created, I'm now getting this error output.
> Any
> > > thoughts?
> > >
> > > /usr/local/kylin/bin $ ./kylin.sh start
> > > KYLIN_HOME is set to /usr/local/kylin
> > > 15/09/09 11:15:28 WARN util.NativeCodeLoader: Unable to load
> > native-hadoop
> > > library for your platform... using builtin-java classes where
> applicable
> > >
> > > Logging initialized using configuration in
> > >
> >
> jar:file:/usr/local/cloudera/5.3.1/hive/lib/hive-common-0.13.1-cdh5.3.1.jar!/hive-log4j.properties
> > > cut: illegal option -- -
> > > usage: cut -b list [-n] [file ...]
> > > cut -c list [file ...]
> > > cut -f list [-s] [-d delim] [file ...]
> > > usage: dirname path
> > > find: -printf: unknown primary or operator
> > > hive dependency: ::find: illegal option -- n
> > > cut: illegal option -- -
> > > usage: cut -b list [-n] [file ...]
> > > cut -c list [file ...]
> > > cut -f list [-s] [-d delim] [file ...]
> > > hbase-common lib not found
> > >
> > > On 9 September 2015 at 10:39, Owen Rumney <ow...@owenrumney.co.uk>
> wrote:
> > >
> > >> Hi
> > >>
> > >> I'll check what I was using before, but I'm now using 1.0 and its all
> > >> starting to work out.
> > >>
> > >> Previouysly the sample_cube was in another folder.
> > >>
> > >> Thanks for getting back to me.
> > >> Owen
> > >>
> > >> On 9 September 2015 at 09:17, Shi, Shaofeng <sh...@ebay.com> wrote:
> > >>
> > >>> Hi Owen, which build are you using? what¹s the error when you run
> > >>> bin/sample.sh?
> > >>>
> > >>> On 9/9/15, 4:15 PM, "Owen Rumney" <ow...@owenrumney.co.uk> wrote:
> > >>>
> > >>> >Resend at the request of Luke Han
> > >>> >
> > >>> >
> > >>> >---------- Forwarded message ----------
> > >>> >From: Owen Rumney <ow...@owenrumney.co.uk>
> > >>> >Date: 25 August 2015 at 15:20
> > >>> >Subject: Sample cube
> > >>> >To: dev@kylin.incubator.apache.org
> > >>> >
> > >>> >
> > >>> >Hi
> > >>> >
> > >>> >I¹m trying to run the sample cube for Kylin using the bin/sample.sh
> > >>> >
> > >>> >I found the path to the sample cube wasn¹t correct in the script and
> > >>> it¹s
> > >>> >looking for files in a lib that doesn¹t exist. I¹ve clean packaged
> it
> > >>> and
> > >>> >moved the jars to a lib folder and moved the examples/sample_cube
> up a
> > >>> >level but the sample script still doesn¹t run after creating the
> hive
> > >>> >tables.
> > >>> >
> > >>> >Is there an updated sample.sh I can get hold of?
> > >>> >
> > >>> >Thanks,
> > >>> >Owen
> > >>>
> > >>>
> > >>
> > >
> >
>
Re: Sample cube
Posted by ShaoFeng Shi <sh...@gmail.com>.
great, thanks for the update; I think you're the first one to run Kylin on
Mac, hope it runs well in the next steps :)
2015-09-10 17:35 GMT+08:00 Owen Rumney <ow...@owenrumney.co.uk>:
> Hi
>
> Just to close this - I got it working on OSX. Seems the OSX impelmentation
> of cut doesn't support --output-delimiter
>
> I got it working with the following substitution in the
> find-h*-dependency.sh
>
> arr=(`echo $hive_classpath | tr ':' ' '`)
>
> Thanks again,
> Owen
>
> On 9 September 2015 at 18:12, Owen Rumney <ow...@owenrumney.co.uk> wrote:
>
> > That would make sense – I’ve got hadoop/hive/hbase all running on my Mac
> > using tarballs which works fine but I guess cut is not the same as RHEL
> or
> > Ubuntu.
> >
> > I’ll have a dig around in find-hbase-dependency.sh and see if I can tweak
> > it to work in my env. Otherwise I guess its a VM.
> >
> > Thanks for coming back.
> >
> > From: "Shi, Shaofeng"
> > Date: Wednesday, 9 September 2015 13:44
> > To: Owen Rumney
> > Cc: "dev@kylin.incubator.apache.org"
> > Subject: Re: Sample cube
> >
> > Hi Owen, what’s the OS version of your server? It seems that the “cut”
> > command on your server is different with what we usually use; In
> > $KYLIN_HOME/bin/find-hbase-dependency.sh and find-hive-dependency we use
> > the cut command to get certain jar files’ path; If the jars were not
> found,
> > Kylin will fail to startup.
> >
> > From: Owen Rumney <ow...@owenrumney.co.uk>
> > Date: Wednesday, September 9, 2015 at 6:16 PM
> > To: "Shi, Shaofeng" <sh...@ebay.com>
> > Subject: Re: Sample cube
> >
> > Hi
> >
> > The sample cube has been created, I'm now getting this error output. Any
> > thoughts?
> >
> > /usr/local/kylin/bin $ ./kylin.sh start
> > KYLIN_HOME is set to /usr/local/kylin
> > 15/09/09 11:15:28 WARN util.NativeCodeLoader: Unable to load
> native-hadoop
> > library for your platform... using builtin-java classes where applicable
> >
> > Logging initialized using configuration in
> >
> jar:file:/usr/local/cloudera/5.3.1/hive/lib/hive-common-0.13.1-cdh5.3.1.jar!/hive-log4j.properties
> > cut: illegal option -- -
> > usage: cut -b list [-n] [file ...]
> > cut -c list [file ...]
> > cut -f list [-s] [-d delim] [file ...]
> > usage: dirname path
> > find: -printf: unknown primary or operator
> > hive dependency: ::find: illegal option -- n
> > cut: illegal option -- -
> > usage: cut -b list [-n] [file ...]
> > cut -c list [file ...]
> > cut -f list [-s] [-d delim] [file ...]
> > hbase-common lib not found
> >
> > On 9 September 2015 at 10:39, Owen Rumney <ow...@owenrumney.co.uk> wrote:
> >
> >> Hi
> >>
> >> I'll check what I was using before, but I'm now using 1.0 and its all
> >> starting to work out.
> >>
> >> Previouysly the sample_cube was in another folder.
> >>
> >> Thanks for getting back to me.
> >> Owen
> >>
> >> On 9 September 2015 at 09:17, Shi, Shaofeng <sh...@ebay.com> wrote:
> >>
> >>> Hi Owen, which build are you using? what¹s the error when you run
> >>> bin/sample.sh?
> >>>
> >>> On 9/9/15, 4:15 PM, "Owen Rumney" <ow...@owenrumney.co.uk> wrote:
> >>>
> >>> >Resend at the request of Luke Han
> >>> >
> >>> >
> >>> >---------- Forwarded message ----------
> >>> >From: Owen Rumney <ow...@owenrumney.co.uk>
> >>> >Date: 25 August 2015 at 15:20
> >>> >Subject: Sample cube
> >>> >To: dev@kylin.incubator.apache.org
> >>> >
> >>> >
> >>> >Hi
> >>> >
> >>> >I¹m trying to run the sample cube for Kylin using the bin/sample.sh
> >>> >
> >>> >I found the path to the sample cube wasn¹t correct in the script and
> >>> it¹s
> >>> >looking for files in a lib that doesn¹t exist. I¹ve clean packaged it
> >>> and
> >>> >moved the jars to a lib folder and moved the examples/sample_cube up a
> >>> >level but the sample script still doesn¹t run after creating the hive
> >>> >tables.
> >>> >
> >>> >Is there an updated sample.sh I can get hold of?
> >>> >
> >>> >Thanks,
> >>> >Owen
> >>>
> >>>
> >>
> >
>
Re: Sample cube
Posted by Owen Rumney <ow...@owenrumney.co.uk>.
Hi
Just to close this - I got it working on OSX. Seems the OSX impelmentation
of cut doesn't support --output-delimiter
I got it working with the following substitution in the
find-h*-dependency.sh
arr=(`echo $hive_classpath | tr ':' ' '`)
Thanks again,
Owen
On 9 September 2015 at 18:12, Owen Rumney <ow...@owenrumney.co.uk> wrote:
> That would make sense – I’ve got hadoop/hive/hbase all running on my Mac
> using tarballs which works fine but I guess cut is not the same as RHEL or
> Ubuntu.
>
> I’ll have a dig around in find-hbase-dependency.sh and see if I can tweak
> it to work in my env. Otherwise I guess its a VM.
>
> Thanks for coming back.
>
> From: "Shi, Shaofeng"
> Date: Wednesday, 9 September 2015 13:44
> To: Owen Rumney
> Cc: "dev@kylin.incubator.apache.org"
> Subject: Re: Sample cube
>
> Hi Owen, what’s the OS version of your server? It seems that the “cut”
> command on your server is different with what we usually use; In
> $KYLIN_HOME/bin/find-hbase-dependency.sh and find-hive-dependency we use
> the cut command to get certain jar files’ path; If the jars were not found,
> Kylin will fail to startup.
>
> From: Owen Rumney <ow...@owenrumney.co.uk>
> Date: Wednesday, September 9, 2015 at 6:16 PM
> To: "Shi, Shaofeng" <sh...@ebay.com>
> Subject: Re: Sample cube
>
> Hi
>
> The sample cube has been created, I'm now getting this error output. Any
> thoughts?
>
> /usr/local/kylin/bin $ ./kylin.sh start
> KYLIN_HOME is set to /usr/local/kylin
> 15/09/09 11:15:28 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
>
> Logging initialized using configuration in
> jar:file:/usr/local/cloudera/5.3.1/hive/lib/hive-common-0.13.1-cdh5.3.1.jar!/hive-log4j.properties
> cut: illegal option -- -
> usage: cut -b list [-n] [file ...]
> cut -c list [file ...]
> cut -f list [-s] [-d delim] [file ...]
> usage: dirname path
> find: -printf: unknown primary or operator
> hive dependency: ::find: illegal option -- n
> cut: illegal option -- -
> usage: cut -b list [-n] [file ...]
> cut -c list [file ...]
> cut -f list [-s] [-d delim] [file ...]
> hbase-common lib not found
>
> On 9 September 2015 at 10:39, Owen Rumney <ow...@owenrumney.co.uk> wrote:
>
>> Hi
>>
>> I'll check what I was using before, but I'm now using 1.0 and its all
>> starting to work out.
>>
>> Previouysly the sample_cube was in another folder.
>>
>> Thanks for getting back to me.
>> Owen
>>
>> On 9 September 2015 at 09:17, Shi, Shaofeng <sh...@ebay.com> wrote:
>>
>>> Hi Owen, which build are you using? what¹s the error when you run
>>> bin/sample.sh?
>>>
>>> On 9/9/15, 4:15 PM, "Owen Rumney" <ow...@owenrumney.co.uk> wrote:
>>>
>>> >Resend at the request of Luke Han
>>> >
>>> >
>>> >---------- Forwarded message ----------
>>> >From: Owen Rumney <ow...@owenrumney.co.uk>
>>> >Date: 25 August 2015 at 15:20
>>> >Subject: Sample cube
>>> >To: dev@kylin.incubator.apache.org
>>> >
>>> >
>>> >Hi
>>> >
>>> >I¹m trying to run the sample cube for Kylin using the bin/sample.sh
>>> >
>>> >I found the path to the sample cube wasn¹t correct in the script and
>>> it¹s
>>> >looking for files in a lib that doesn¹t exist. I¹ve clean packaged it
>>> and
>>> >moved the jars to a lib folder and moved the examples/sample_cube up a
>>> >level but the sample script still doesn¹t run after creating the hive
>>> >tables.
>>> >
>>> >Is there an updated sample.sh I can get hold of?
>>> >
>>> >Thanks,
>>> >Owen
>>>
>>>
>>
>
Re: Sample cube
Posted by Owen Rumney <ow...@owenrumney.co.uk>.
That would make sense – I’ve got hadoop/hive/hbase all running on my Mac using tarballs which works fine but I guess cut is not the same as RHEL or Ubuntu.
I’ll have a dig around in find-hbase-dependency.sh and see if I can tweak it to work in my env. Otherwise I guess its a VM.
Thanks for coming back.
From: "Shi, Shaofeng"
Date: Wednesday, 9 September 2015 13:44
To: Owen Rumney
Cc: "dev@kylin.incubator.apache.org"
Subject: Re: Sample cube
Hi Owen, what’s the OS version of your server? It seems that the “cut” command on your server is different with what we usually use; In $KYLIN_HOME/bin/find-hbase-dependency.sh and find-hive-dependency we use the cut command to get certain jar files’ path; If the jars were not found, Kylin will fail to startup.
From: Owen Rumney <ow...@owenrumney.co.uk>
Date: Wednesday, September 9, 2015 at 6:16 PM
To: "Shi, Shaofeng" <sh...@ebay.com>
Subject: Re: Sample cube
Hi
The sample cube has been created, I'm now getting this error output. Any thoughts?
/usr/local/kylin/bin $ ./kylin.sh start
KYLIN_HOME is set to /usr/local/kylin
15/09/09 11:15:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Logging initialized using configuration in jar:file:/usr/local/cloudera/5.3.1/hive/lib/hive-common-0.13.1-cdh5.3.1.jar!/hive-log4j.properties
cut: illegal option -- -
usage: cut -b list [-n] [file ...]
cut -c list [file ...]
cut -f list [-s] [-d delim] [file ...]
usage: dirname path
find: -printf: unknown primary or operator
hive dependency: ::find: illegal option -- n
cut: illegal option -- -
usage: cut -b list [-n] [file ...]
cut -c list [file ...]
cut -f list [-s] [-d delim] [file ...]
hbase-common lib not found
On 9 September 2015 at 10:39, Owen Rumney <ow...@owenrumney.co.uk> wrote:
Hi
I'll check what I was using before, but I'm now using 1.0 and its all starting to work out.
Previouysly the sample_cube was in another folder.
Thanks for getting back to me.
Owen
On 9 September 2015 at 09:17, Shi, Shaofeng <sh...@ebay.com> wrote:
Hi Owen, which build are you using? what¹s the error when you run
bin/sample.sh?
On 9/9/15, 4:15 PM, "Owen Rumney" <ow...@owenrumney.co.uk> wrote:
>Resend at the request of Luke Han
>
>
>---------- Forwarded message ----------
>From: Owen Rumney <ow...@owenrumney.co.uk>
>Date: 25 August 2015 at 15:20
>Subject: Sample cube
>To: dev@kylin.incubator.apache.org
>
>
>Hi
>
>I¹m trying to run the sample cube for Kylin using the bin/sample.sh
>
>I found the path to the sample cube wasn¹t correct in the script and it¹s
>looking for files in a lib that doesn¹t exist. I¹ve clean packaged it and
>moved the jars to a lib folder and moved the examples/sample_cube up a
>level but the sample script still doesn¹t run after creating the hive
>tables.
>
>Is there an updated sample.sh I can get hold of?
>
>Thanks,
>Owen
Re: Sample cube
Posted by "Shi, Shaofeng" <sh...@ebay.com>.
Hi Owen, what’s the OS version of your server? It seems that the “cut” command on your server is different with what we usually use; In $KYLIN_HOME/bin/find-hbase-dependency.sh and find-hive-dependency we use the cut command to get certain jar files’ path; If the jars were not found, Kylin will fail to startup.
From: Owen Rumney <ow...@owenrumney.co.uk>>
Date: Wednesday, September 9, 2015 at 6:16 PM
To: "Shi, Shaofeng" <sh...@ebay.com>>
Subject: Re: Sample cube
Hi
The sample cube has been created, I'm now getting this error output. Any thoughts?
/usr/local/kylin/bin $ ./kylin.sh start
KYLIN_HOME is set to /usr/local/kylin
15/09/09 11:15:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Logging initialized using configuration in jar:file:/usr/local/cloudera/5.3.1/hive/lib/hive-common-0.13.1-cdh5.3.1.jar!/hive-log4j.properties
cut: illegal option -- -
usage: cut -b list [-n] [file ...]
cut -c list [file ...]
cut -f list [-s] [-d delim] [file ...]
usage: dirname path
find: -printf: unknown primary or operator
hive dependency: ::find: illegal option -- n
cut: illegal option -- -
usage: cut -b list [-n] [file ...]
cut -c list [file ...]
cut -f list [-s] [-d delim] [file ...]
hbase-common lib not found
On 9 September 2015 at 10:39, Owen Rumney <ow...@owenrumney.co.uk>> wrote:
Hi
I'll check what I was using before, but I'm now using 1.0 and its all starting to work out.
Previouysly the sample_cube was in another folder.
Thanks for getting back to me.
Owen
On 9 September 2015 at 09:17, Shi, Shaofeng <sh...@ebay.com>> wrote:
Hi Owen, which build are you using? what¹s the error when you run
bin/sample.sh?
On 9/9/15, 4:15 PM, "Owen Rumney" <ow...@owenrumney.co.uk>> wrote:
>Resend at the request of Luke Han
>
>
>---------- Forwarded message ----------
>From: Owen Rumney <ow...@owenrumney.co.uk>>
>Date: 25 August 2015 at 15:20
>Subject: Sample cube
>To: dev@kylin.incubator.apache.org<ma...@kylin.incubator.apache.org>
>
>
>Hi
>
>I¹m trying to run the sample cube for Kylin using the bin/sample.sh
>
>I found the path to the sample cube wasn¹t correct in the script and it¹s
>looking for files in a lib that doesn¹t exist. I¹ve clean packaged it and
>moved the jars to a lib folder and moved the examples/sample_cube up a
>level but the sample script still doesn¹t run after creating the hive
>tables.
>
>Is there an updated sample.sh I can get hold of?
>
>Thanks,
>Owen
Re: Sample cube
Posted by "Shi, Shaofeng" <sh...@ebay.com>.
Hi Owen, which build are you using? what¹s the error when you run
bin/sample.sh?
On 9/9/15, 4:15 PM, "Owen Rumney" <ow...@owenrumney.co.uk> wrote:
>Resend at the request of Luke Han
>
>
>---------- Forwarded message ----------
>From: Owen Rumney <ow...@owenrumney.co.uk>
>Date: 25 August 2015 at 15:20
>Subject: Sample cube
>To: dev@kylin.incubator.apache.org
>
>
>Hi
>
>I¹m trying to run the sample cube for Kylin using the bin/sample.sh
>
>I found the path to the sample cube wasn¹t correct in the script and it¹s
>looking for files in a lib that doesn¹t exist. I¹ve clean packaged it and
>moved the jars to a lib folder and moved the examples/sample_cube up a
>level but the sample script still doesn¹t run after creating the hive
>tables.
>
>Is there an updated sample.sh I can get hold of?
>
>Thanks,
>Owen
Fwd: Sample cube
Posted by Owen Rumney <ow...@owenrumney.co.uk>.
Resend at the request of Luke Han
---------- Forwarded message ----------
From: Owen Rumney <ow...@owenrumney.co.uk>
Date: 25 August 2015 at 15:20
Subject: Sample cube
To: dev@kylin.incubator.apache.org
Hi
I’m trying to run the sample cube for Kylin using the bin/sample.sh
I found the path to the sample cube wasn’t correct in the script and it’s
looking for files in a lib that doesn’t exist. I’ve clean packaged it and
moved the jars to a lib folder and moved the examples/sample_cube up a
level but the sample script still doesn’t run after creating the hive
tables.
Is there an updated sample.sh I can get hold of?
Thanks,
Owen
Re: Sample cube
Posted by hongbin ma <ma...@apache.org>.
did you set KYLIN_HOME?
On Tue, Aug 25, 2015 at 10:20 PM, Owen Rumney <ow...@owenrumney.co.uk> wrote:
> Hi
>
> I’m trying to run the sample cube for Kylin using the bin/sample.sh
>
> I found the path to the sample cube wasn’t correct in the script and it’s
> looking for files in a lib that doesn’t exist. I’ve clean packaged it and
> moved the jars to a lib folder and moved the examples/sample_cube up a
> level but the sample script still doesn’t run after creating the hive
> tables.
>
> Is there an updated sample.sh I can get hold of?
>
> Thanks,
> Owen
>
>
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone