You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Vikram Kone <vi...@gmail.com> on 2015/02/24 19:42:17 UTC
Cube step stuck at step: Extract FAct TAble Distinct columns
Hi,
I was able to successfully install Kylin on an azure based hadoop cluster
(from hortonworks) after a lot of tweaking!! I'll probably write a blog
post about this soon to help others.
Now I'm able to login to the KYLIN web interface and see the test cubes. !!
When I clicked "build" action on one of the default cubes, the job failed
with the following error in step 2:
What does this mean? I checked that TCP port 8088 is public on the VM on
master-02 VM and master-01 VM. Anything else I need to tweak?
#2 Step Name: Extract Fact Table Distinct Columns
Start to execute command:
-conf /etc/kylin/kylin_job_conf.xml -cubename
test_kylin_cube_with_slr_empty -input
/tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/kylin_intermediate_test_kylin_cube_with_slr_desc_19700101000000_20150223000000_6d2bce27_3369_4528_b089_d1f3be5e4fd8
-output /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/test_kylin_cube_with_slr_empty/fact_distinct_columns
-jobname Kylin_Fact_Distinct_Columns_test_kylin_cube_with_slr_empty_Step_1
Command execute return code 0
Get job id job_1424659379295_0005
Get job track url
http://kylin-master-02.cloudapp.net:8088/proxy/application_1424659379295_0005/
Failed to get status from response with url +
http://kylin-master-01:8088/ws/v1/cluster/apps/application_1424659379295_0005?anonymous=true
Exception: Connection refused
Counters: 0
Re: Cube step stuck at step: Extract FAct TAble Distinct columns
Posted by Li Yang <li...@apache.org>.
The error is cannot access
http://kylin-master-01:8088/ws/v1/cluster/apps/application_1424659379295_0005?anonymous=true
You may trouble shoot from browser why this public URL does not work (don't
forget replace the job ID appropriately). "kylin-master-01" must be the
resource manager of your cluster. Update key "
kylin.job.yarn.app.rest.check.status.url" in kylin.properties if it's not.
In the next version 0.7.x, Kylin will figure this out from hadoop conf. For
now, you still have to configure manually.
Cheers
Yang
On Wed, Feb 25, 2015 at 3:08 AM, Vikram Kone <vi...@gmail.com> wrote:
> This is the content of my /etc/hosts file on the kylin-master-01 VM. Looks
> like it does have entries for all the other VMs in the cluster
>
> 127.0.0.1 localhost localhost.localdomain localhost4
> localhost4.localdomain4
> ::1 localhost localhost.localdomain localhost6
> localhost6.localdomain6
> 172.16.0.4 kylin-master-01.cloudapp.net kylin-master-01
> 172.16.0.5 kylin-master-02.cloudapp.net kylin-master-02
> 172.16.0.30 kylin-worker-01.cloudapp.net kylin-worker-01
> 172.16.0.31 kylin-worker-02.cloudapp.net kylin-worker-02
> 172.16.0.32 kylin-worker-03.cloudapp.net kylin-worker-03
>
>
> On Tue, Feb 24, 2015 at 11:00 AM, Vikram Kone <vi...@gmail.com>
> wrote:
>
> > Good question. Isn't that automatically done while installing hadoop on a
> > cluster?
> > If not, how can I check if that's the case or not? And if not, how to
> > modify the hosts file?
> > Sorry.. I'm new to the world of linux and hadoop, so still learning my
> way
> > around .
> > Sample terminal commands would help
> >
> > On Tue, Feb 24, 2015 at 10:52 AM, Jakob Stengård <
> jakob.stengard@gmail.com
> > > wrote:
> >
> >> Are kylin-master-01 and kylin-master-02 present in the hosts file on
> each
> >> VM?
> >>
> >> /J
> >>
> >> On Tue, Feb 24, 2015 at 7:42 PM, Vikram Kone <vi...@gmail.com>
> >> wrote:
> >>
> >> > Hi,
> >> > I was able to successfully install Kylin on an azure based hadoop
> >> cluster
> >> > (from hortonworks) after a lot of tweaking!! I'll probably write a
> blog
> >> > post about this soon to help others.
> >> > Now I'm able to login to the KYLIN web interface and see the test
> >> cubes. !!
> >> > When I clicked "build" action on one of the default cubes, the job
> >> failed
> >> > with the following error in step 2:
> >> >
> >> > What does this mean? I checked that TCP port 8088 is public on the VM
> on
> >> > master-02 VM and master-01 VM. Anything else I need to tweak?
> >> >
> >> > #2 Step Name: Extract Fact Table Distinct Columns
> >> >
> >> > Start to execute command:
> >> > -conf /etc/kylin/kylin_job_conf.xml -cubename
> >> > test_kylin_cube_with_slr_empty -input
> >> >
> >> >
> >>
> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/kylin_intermediate_test_kylin_cube_with_slr_desc_19700101000000_20150223000000_6d2bce27_3369_4528_b089_d1f3be5e4fd8
> >> > -output
> >> >
> >>
> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/test_kylin_cube_with_slr_empty/fact_distinct_columns
> >> > -jobname
> >> Kylin_Fact_Distinct_Columns_test_kylin_cube_with_slr_empty_Step_1
> >> > Command execute return code 0
> >> > Get job id job_1424659379295_0005
> >> > Get job track url
> >> >
> >> >
> >>
> http://kylin-master-02.cloudapp.net:8088/proxy/application_1424659379295_0005/
> >> > Failed to get status from response with url +
> >> >
> >> >
> >>
> http://kylin-master-01:8088/ws/v1/cluster/apps/application_1424659379295_0005?anonymous=true
> >> > Exception: Connection refused
> >> > Counters: 0
> >> >
> >>
> >
> >
>
Re: Cube step stuck at step: Extract FAct TAble Distinct columns
Posted by Vikram Kone <vi...@gmail.com>.
This is the content of my /etc/hosts file on the kylin-master-01 VM. Looks
like it does have entries for all the other VMs in the cluster
127.0.0.1 localhost localhost.localdomain localhost4
localhost4.localdomain4
::1 localhost localhost.localdomain localhost6
localhost6.localdomain6
172.16.0.4 kylin-master-01.cloudapp.net kylin-master-01
172.16.0.5 kylin-master-02.cloudapp.net kylin-master-02
172.16.0.30 kylin-worker-01.cloudapp.net kylin-worker-01
172.16.0.31 kylin-worker-02.cloudapp.net kylin-worker-02
172.16.0.32 kylin-worker-03.cloudapp.net kylin-worker-03
On Tue, Feb 24, 2015 at 11:00 AM, Vikram Kone <vi...@gmail.com> wrote:
> Good question. Isn't that automatically done while installing hadoop on a
> cluster?
> If not, how can I check if that's the case or not? And if not, how to
> modify the hosts file?
> Sorry.. I'm new to the world of linux and hadoop, so still learning my way
> around .
> Sample terminal commands would help
>
> On Tue, Feb 24, 2015 at 10:52 AM, Jakob Stengård <jakob.stengard@gmail.com
> > wrote:
>
>> Are kylin-master-01 and kylin-master-02 present in the hosts file on each
>> VM?
>>
>> /J
>>
>> On Tue, Feb 24, 2015 at 7:42 PM, Vikram Kone <vi...@gmail.com>
>> wrote:
>>
>> > Hi,
>> > I was able to successfully install Kylin on an azure based hadoop
>> cluster
>> > (from hortonworks) after a lot of tweaking!! I'll probably write a blog
>> > post about this soon to help others.
>> > Now I'm able to login to the KYLIN web interface and see the test
>> cubes. !!
>> > When I clicked "build" action on one of the default cubes, the job
>> failed
>> > with the following error in step 2:
>> >
>> > What does this mean? I checked that TCP port 8088 is public on the VM on
>> > master-02 VM and master-01 VM. Anything else I need to tweak?
>> >
>> > #2 Step Name: Extract Fact Table Distinct Columns
>> >
>> > Start to execute command:
>> > -conf /etc/kylin/kylin_job_conf.xml -cubename
>> > test_kylin_cube_with_slr_empty -input
>> >
>> >
>> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/kylin_intermediate_test_kylin_cube_with_slr_desc_19700101000000_20150223000000_6d2bce27_3369_4528_b089_d1f3be5e4fd8
>> > -output
>> >
>> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/test_kylin_cube_with_slr_empty/fact_distinct_columns
>> > -jobname
>> Kylin_Fact_Distinct_Columns_test_kylin_cube_with_slr_empty_Step_1
>> > Command execute return code 0
>> > Get job id job_1424659379295_0005
>> > Get job track url
>> >
>> >
>> http://kylin-master-02.cloudapp.net:8088/proxy/application_1424659379295_0005/
>> > Failed to get status from response with url +
>> >
>> >
>> http://kylin-master-01:8088/ws/v1/cluster/apps/application_1424659379295_0005?anonymous=true
>> > Exception: Connection refused
>> > Counters: 0
>> >
>>
>
>
Re: Cube step stuck at step: Extract FAct TAble Distinct columns
Posted by Vikram Kone <vi...@gmail.com>.
Good question. Isn't that automatically done while installing hadoop on a
cluster?
If not, how can I check if that's the case or not? And if not, how to
modify the hosts file?
Sorry.. I'm new to the world of linux and hadoop, so still learning my way
around .
Sample terminal commands would help
On Tue, Feb 24, 2015 at 10:52 AM, Jakob Stengård <ja...@gmail.com>
wrote:
> Are kylin-master-01 and kylin-master-02 present in the hosts file on each
> VM?
>
> /J
>
> On Tue, Feb 24, 2015 at 7:42 PM, Vikram Kone <vi...@gmail.com> wrote:
>
> > Hi,
> > I was able to successfully install Kylin on an azure based hadoop cluster
> > (from hortonworks) after a lot of tweaking!! I'll probably write a blog
> > post about this soon to help others.
> > Now I'm able to login to the KYLIN web interface and see the test cubes.
> !!
> > When I clicked "build" action on one of the default cubes, the job failed
> > with the following error in step 2:
> >
> > What does this mean? I checked that TCP port 8088 is public on the VM on
> > master-02 VM and master-01 VM. Anything else I need to tweak?
> >
> > #2 Step Name: Extract Fact Table Distinct Columns
> >
> > Start to execute command:
> > -conf /etc/kylin/kylin_job_conf.xml -cubename
> > test_kylin_cube_with_slr_empty -input
> >
> >
> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/kylin_intermediate_test_kylin_cube_with_slr_desc_19700101000000_20150223000000_6d2bce27_3369_4528_b089_d1f3be5e4fd8
> > -output
> >
> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/test_kylin_cube_with_slr_empty/fact_distinct_columns
> > -jobname
> Kylin_Fact_Distinct_Columns_test_kylin_cube_with_slr_empty_Step_1
> > Command execute return code 0
> > Get job id job_1424659379295_0005
> > Get job track url
> >
> >
> http://kylin-master-02.cloudapp.net:8088/proxy/application_1424659379295_0005/
> > Failed to get status from response with url +
> >
> >
> http://kylin-master-01:8088/ws/v1/cluster/apps/application_1424659379295_0005?anonymous=true
> > Exception: Connection refused
> > Counters: 0
> >
>
Re: Cube step stuck at step: Extract FAct TAble Distinct columns
Posted by Jakob Stengård <ja...@gmail.com>.
Are kylin-master-01 and kylin-master-02 present in the hosts file on each
VM?
/J
On Tue, Feb 24, 2015 at 7:42 PM, Vikram Kone <vi...@gmail.com> wrote:
> Hi,
> I was able to successfully install Kylin on an azure based hadoop cluster
> (from hortonworks) after a lot of tweaking!! I'll probably write a blog
> post about this soon to help others.
> Now I'm able to login to the KYLIN web interface and see the test cubes. !!
> When I clicked "build" action on one of the default cubes, the job failed
> with the following error in step 2:
>
> What does this mean? I checked that TCP port 8088 is public on the VM on
> master-02 VM and master-01 VM. Anything else I need to tweak?
>
> #2 Step Name: Extract Fact Table Distinct Columns
>
> Start to execute command:
> -conf /etc/kylin/kylin_job_conf.xml -cubename
> test_kylin_cube_with_slr_empty -input
>
> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/kylin_intermediate_test_kylin_cube_with_slr_desc_19700101000000_20150223000000_6d2bce27_3369_4528_b089_d1f3be5e4fd8
> -output
> /tmp/kylin-6d2bce27-3369-4528-b089-d1f3be5e4fd8/test_kylin_cube_with_slr_empty/fact_distinct_columns
> -jobname Kylin_Fact_Distinct_Columns_test_kylin_cube_with_slr_empty_Step_1
> Command execute return code 0
> Get job id job_1424659379295_0005
> Get job track url
>
> http://kylin-master-02.cloudapp.net:8088/proxy/application_1424659379295_0005/
> Failed to get status from response with url +
>
> http://kylin-master-01:8088/ws/v1/cluster/apps/application_1424659379295_0005?anonymous=true
> Exception: Connection refused
> Counters: 0
>