You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 彭鱼宴 <46...@qq.com> on 2018/06/27 15:59:32 UTC
回复： Question about deploying kylin and hive
Hi Shaofeng，
Thanks for your reply and help. And here is one more question: is there any restful API that could let me add project and model? From the website, I could find the API that help me build cube and load hive table, without any mention about adding project and model. If yes, if you could provide me with some links which have examples?
Best,
Zhefu Peng
------------------ 原始邮件 ------------------
发件人: "ShaoFeng Shi"<sh...@apache.org>;
发送时间: 2018年6月27日(星期三) 晚上9:08
收件人: "user"<us...@kylin.apache.org>;
主题: Re: Question about deploying kylin and hive
He zhefu,
On Kylin node, you need to deploy hive CLI (or beeline), with the proper configuration file (hive-site.xml). Kylin will load the configuration file from Classpath, and use the CLI to send commands to Hive server. Hope this answers your question.
2018-06-27 20:49 GMT+08:00 彭鱼宴 <46...@qq.com>:
Hi,
I have a question when I want to deploy the kylin and hive. May I deploy hive and kylin on two different servers? Since kylin relies on hive, or should I deploy them on the same server?
Looking forward to your help and reply soon.
Best,
Zhefu Peng
--
Best regards,
Shaofeng Shi 史少锋
Re: Question about deploying kylin and hive
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Zhefu,
Maybe my message isn't clear above, let me try again.
By design, Kylin expects the user to create new project/model/cube with
Kylin's web wizard, instead of using REST API, so they were not in the API
doc.
The reason is, the model/cube data structure is complex and may change over
time; they are something like implementations, not API.
If you feel Kylin's web wizard is unfriendly, or you have an alternative
way to design it, please share your experiences. We hope the wizard easy to
use.
2018-06-28 9:53 GMT+08:00 彭鱼宴 <46...@qq.com>:
> Shaofeng,
>
> Sorry for my unclear explaining. I mean, now I could use the REST API that
> kylin provides to write shell script, to auto update the cube I already
> built regularly, for example, every day. Since I could auto update the hive
> table regularly, then I could rebuild the cube, just like update the cube
> in some way. However, from the page http://kylin.apache.org/
> docs/howto/howto_use_restapi.html I cannot find the introduction about
> how to add a new project or create a new model , or create a new cube. With
> using REST API, and I cannot add project or model with writing a shell
> script, with using REST API.
>
> I wonder if there are some ways to use REST API to add new project, or
> create new model and new cube. If yes, it would be my pleasure you can
> offer some links.
>
> Thanks!
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "ShaoFeng Shi"<sh...@apache.org>;
> *发送时间:* 2018年6月28日(星期四) 上午9:22
> *收件人:* "user"<us...@kylin.apache.org>;
> *主题:* Re: Question about deploying kylin and hive
>
> Hi Zhefu,
>
> The project/model/cube creations/updates are not part of the public APIs;
> They incline to change over versions when introducing new features or
> enhancements. Kylin's web GUI can ensure the behavior consistent, but if
> you're doing from outside, we can't ensure that.
>
> Could you please share how you plan to do from outside? If you have
> implemented another wizard or GUI, what's the advantage of that? Thanks!
>
> 2018-06-27 23:59 GMT+08:00 彭鱼宴 <46...@qq.com>:
>
>>
>> Hi Shaofeng，
>>
>> Thanks for your reply and help. And here is one more question: is there
>> any restful API that could let me add project and model? From the website,
>> I could find the API that help me build cube and load hive table, without
>> any mention about adding project and model. If yes, if you could provide me
>> with some links which have examples?
>>
>> Best,
>> Zhefu Peng
>>
>> ------------------ 原始邮件 ------------------
>> *发件人:* "ShaoFeng Shi"<sh...@apache.org>;
>> *发送时间:* 2018年6月27日(星期三) 晚上9:08
>> *收件人:* "user"<us...@kylin.apache.org>;
>> *主题:* Re: Question about deploying kylin and hive
>>
>> He zhefu,
>>
>> On Kylin node, you need to deploy hive CLI (or beeline), with the proper
>> configuration file (hive-site.xml). Kylin will load the configuration file
>> from Classpath, and use the CLI to send commands to Hive server. Hope this
>> answers your question.
>>
>> 2018-06-27 20:49 GMT+08:00 彭鱼宴 <46...@qq.com>:
>>
>>> Hi,
>>>
>>> I have a question when I want to deploy the kylin and hive. May I deploy
>>> hive and kylin on two different servers? Since kylin relies on hive, or
>>> should I deploy them on the same server?
>>>
>>> Looking forward to your help and reply soon.
>>>
>>> Best,
>>> Zhefu Peng
>>>
>>
>>
>>
>> --
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋
回复： Question about deploying kylin and hive
Posted by 彭鱼宴 <46...@qq.com>.
Shaofeng,
Sorry for my unclear explaining. I mean, now I could use the REST API that kylin provides to write shell script, to auto update the cube I already built regularly, for example, every day. Since I could auto update the hive table regularly, then I could rebuild the cube, just like update the cube in some way. However, from the page http://kylin.apache.org/docs/howto/howto_use_restapi.html I cannot find the introduction about how to add a new project or create a new model , or create a new cube. With using REST API, and I cannot add project or model with writing a shell script, with using REST API.
I wonder if there are some ways to use REST API to add new project, or create new model and new cube. If yes, it would be my pleasure you can offer some links.
Thanks!
------------------ 原始邮件 ------------------
发件人: "ShaoFeng Shi"<sh...@apache.org>;
发送时间: 2018年6月28日(星期四) 上午9:22
收件人: "user"<us...@kylin.apache.org>;
主题: Re: Question about deploying kylin and hive
Hi Zhefu,
The project/model/cube creations/updates are not part of the public APIs; They incline to change over versions when introducing new features or enhancements. Kylin's web GUI can ensure the behavior consistent, but if you're doing from outside, we can't ensure that.
Could you please share how you plan to do from outside? If you have implemented another wizard or GUI, what's the advantage of that? Thanks!
2018-06-27 23:59 GMT+08:00 彭鱼宴 <46...@qq.com>:
Hi Shaofeng，
Thanks for your reply and help. And here is one more question: is there any restful API that could let me add project and model? From the website, I could find the API that help me build cube and load hive table, without any mention about adding project and model. If yes, if you could provide me with some links which have examples?
Best,
Zhefu Peng
------------------ 原始邮件 ------------------
发件人: "ShaoFeng Shi"<sh...@apache.org>;
发送时间: 2018年6月27日(星期三) 晚上9:08
收件人: "user"<us...@kylin.apache.org>;
主题: Re: Question about deploying kylin and hive
He zhefu,
On Kylin node, you need to deploy hive CLI (or beeline), with the proper configuration file (hive-site.xml). Kylin will load the configuration file from Classpath, and use the CLI to send commands to Hive server. Hope this answers your question.
2018-06-27 20:49 GMT+08:00 彭鱼宴 <46...@qq.com>:
Hi,
I have a question when I want to deploy the kylin and hive. May I deploy hive and kylin on two different servers? Since kylin relies on hive, or should I deploy them on the same server?
Looking forward to your help and reply soon.
Best,
Zhefu Peng
--
Best regards,
Shaofeng Shi 史少锋
--
Best regards,
Shaofeng Shi 史少锋
Re: Question about deploying kylin and hive
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Zhefu,
The project/model/cube creations/updates are not part of the public APIs;
They incline to change over versions when introducing new features or
enhancements. Kylin's web GUI can ensure the behavior consistent, but if
you're doing from outside, we can't ensure that.
Could you please share how you plan to do from outside? If you have
implemented another wizard or GUI, what's the advantage of that? Thanks!
2018-06-27 23:59 GMT+08:00 彭鱼宴 <46...@qq.com>:
>
> Hi Shaofeng，
>
> Thanks for your reply and help. And here is one more question: is there
> any restful API that could let me add project and model? From the website,
> I could find the API that help me build cube and load hive table, without
> any mention about adding project and model. If yes, if you could provide me
> with some links which have examples?
>
> Best,
> Zhefu Peng
>
> ------------------ 原始邮件 ------------------
> *发件人:* "ShaoFeng Shi"<sh...@apache.org>;
> *发送时间:* 2018年6月27日(星期三) 晚上9:08
> *收件人:* "user"<us...@kylin.apache.org>;
> *主题:* Re: Question about deploying kylin and hive
>
> He zhefu,
>
> On Kylin node, you need to deploy hive CLI (or beeline), with the proper
> configuration file (hive-site.xml). Kylin will load the configuration file
> from Classpath, and use the CLI to send commands to Hive server. Hope this
> answers your question.
>
> 2018-06-27 20:49 GMT+08:00 彭鱼宴 <46...@qq.com>:
>
>> Hi,
>>
>> I have a question when I want to deploy the kylin and hive. May I deploy
>> hive and kylin on two different servers? Since kylin relies on hive, or
>> should I deploy them on the same server?
>>
>> Looking forward to your help and reply soon.
>>
>> Best,
>> Zhefu Peng
>>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋