You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "wangxianbin1987@gmail.com" <wa...@gmail.com> on 2016/04/21 07:19:31 UTC
回复: hive table change
hi!
what do you mean by "original hive table position"?
do you mean hive "external table" or hive table that specific new hdfs location by hive 'location' keywords?
if it is so, you don't have to do extro config
if you mean hive that not deploy with kylin, it seem like that it is not supported by kylin(need comfirm by others)
best regards!
wangxianbin1987@gmail.com
发件人： 耳东
发送时间： 2016-04-21 11:34
收件人： dev
主题： hive table change
hi all：
In my cluster there is another application which create some hive tables not in the original hive table position. where should I configure to access these hive tables？
回复: 回复： hive table change
Posted by "wangxianbin1987@gmail.com" <wa...@gmail.com>.
hi!
kylin have access to hive through CLI, pls refer to kylin.properties when you deploy kylin, detail as follow:
# If true, job engine will not assume that hadoop CLI reside on the same server as it self
# you will have to specify kylin.job.remote.cli.hostname, kylin.job.remote.cli.username and kylin.job.remote.cli.password
kylin.job.run.as.remote.cmd=false
# Only necessary when kylin.job.run.as.remote.cmd=true
kylin.job.remote.cli.hostname=sandbox
# Only necessary when kylin.job.run.as.remote.cmd=true
kylin.job.remote.cli.username=root
# Only necessary when kylin.job.run.as.remote.cmd=true
kylin.job.remote.cli.password=hadoop
best regards!
wangxianbin1987@gmail.com
发件人： 耳东
发送时间： 2016-04-21 14:57
收件人： dev
主题： 回复： hive table change
How does kylin access the hive table , where can I configure to change the hive metadata kylin access.
------------------ 原始邮件 ------------------
发件人: "wangxianbin1987@gmail.com";<wa...@gmail.com>;
发送时间: 2016年4月21日(星期四) 中午1:19
收件人: "dev"<de...@kylin.apache.org>;
主题: 回复: hive table change
hi!
what do you mean by "original hive table position"?
do you mean hive "external table" or hive table that specific new hdfs location by hive 'location' keywords?
if it is so, you don't have to do extro config
if you mean hive that not deploy with kylin, it seem like that it is not supported by kylin(need comfirm by others)
best regards!
wangxianbin1987@gmail.com
发件人： 耳东
发送时间： 2016-04-21 11:34
收件人： dev
主题： hive table change
hi all：
In my cluster there is another application which create some hive tables not in the original hive table position. where should I configure to access these hive tables？
回复： 回复： hive table change
Posted by 耳东 <77...@qq.com>.
yes,as you said Kylin see the same tables as the hive shell in the server. however in my cluster there is another app which invoke hive and create some hive tables, of which the metadata and store location is different from the hive shell. how can i make the kylin to access these tables?
------------------ 原始邮件 ------------------
发件人: "hongbin ma";<ma...@apache.org>;
发送时间: 2016年4月21日(星期四) 晚上6:31
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: 回复： hive table change
I want to clarify that kylin.job.remote.cli.hostname is usually used for
developing purpose, it's not related to hive table syncing.
The way how Kylin gets aware of hive table is through HCatlog. When kylin
starts, it will look for hive settings where Kylin resides to initialize
HCatlog. So basically kylin will see same tables as the hive shell in the
that server.
On Thu, Apr 21, 2016 at 3:20 PM, wangxianbin1987@gmail.com <
wangxianbin1987@gmail.com> wrote:
> hi!
>
> for clarifying, hive can deploy in remote mode, kylin access it by
> "SSHClient"
>
> best regards!
>
>
> wangxianbin1987@gmail.com
>
> 发件人： 耳东
> 发送时间： 2016-04-21 14:57
> 收件人： dev
> 主题： 回复： hive table change
> How does kylin access the hive table , where can I configure to change the
> hive metadata kylin access.
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "wangxianbin1987@gmail.com";<wa...@gmail.com>;
> 发送时间: 2016年4月21日(星期四) 中午1:19
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: 回复: hive table change
>
>
>
> hi!
>
> what do you mean by "original hive table position"?
>
> do you mean hive "external table" or hive table that specific new hdfs
> location by hive 'location' keywords?
>
> if it is so, you don't have to do extro config
>
> if you mean hive that not deploy with kylin, it seem like that it is not
> supported by kylin(need comfirm by others)
>
> best regards!
>
>
>
> wangxianbin1987@gmail.com
> 发件人： 耳东
> 发送时间： 2016-04-21 11:34
> 收件人： dev
> 主题： hive table change
> hi all：
> In my cluster there is another application which create some hive
> tables not in the original hive table position. where should I configure to
> access these hive tables？
>
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone
Re: 回复： hive table change
Posted by hongbin ma <ma...@apache.org>.
I want to clarify that kylin.job.remote.cli.hostname is usually used for
developing purpose, it's not related to hive table syncing.
The way how Kylin gets aware of hive table is through HCatlog. When kylin
starts, it will look for hive settings where Kylin resides to initialize
HCatlog. So basically kylin will see same tables as the hive shell in the
that server.
On Thu, Apr 21, 2016 at 3:20 PM, wangxianbin1987@gmail.com <
wangxianbin1987@gmail.com> wrote:
> hi!
>
> for clarifying, hive can deploy in remote mode, kylin access it by
> "SSHClient"
>
> best regards!
>
>
> wangxianbin1987@gmail.com
>
> 发件人： 耳东
> 发送时间： 2016-04-21 14:57
> 收件人： dev
> 主题： 回复： hive table change
> How does kylin access the hive table , where can I configure to change the
> hive metadata kylin access.
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "wangxianbin1987@gmail.com";<wa...@gmail.com>;
> 发送时间: 2016年4月21日(星期四) 中午1:19
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: 回复: hive table change
>
>
>
> hi!
>
> what do you mean by "original hive table position"?
>
> do you mean hive "external table" or hive table that specific new hdfs
> location by hive 'location' keywords?
>
> if it is so, you don't have to do extro config
>
> if you mean hive that not deploy with kylin, it seem like that it is not
> supported by kylin(need comfirm by others)
>
> best regards!
>
>
>
> wangxianbin1987@gmail.com
> 发件人： 耳东
> 发送时间： 2016-04-21 11:34
> 收件人： dev
> 主题： hive table change
> hi all：
> In my cluster there is another application which create some hive
> tables not in the original hive table position. where should I configure to
> access these hive tables？
>
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone
回复: 回复： hive table change
Posted by "wangxianbin1987@gmail.com" <wa...@gmail.com>.
hi!
for clarifying, hive can deploy in remote mode, kylin access it by "SSHClient"
best regards!
wangxianbin1987@gmail.com
发件人： 耳东
发送时间： 2016-04-21 14:57
收件人： dev
主题： 回复： hive table change
How does kylin access the hive table , where can I configure to change the hive metadata kylin access.
------------------ 原始邮件 ------------------
发件人: "wangxianbin1987@gmail.com";<wa...@gmail.com>;
发送时间: 2016年4月21日(星期四) 中午1:19
收件人: "dev"<de...@kylin.apache.org>;
主题: 回复: hive table change
hi!
what do you mean by "original hive table position"?
do you mean hive "external table" or hive table that specific new hdfs location by hive 'location' keywords?
if it is so, you don't have to do extro config
if you mean hive that not deploy with kylin, it seem like that it is not supported by kylin(need comfirm by others)
best regards!
wangxianbin1987@gmail.com
发件人： 耳东
发送时间： 2016-04-21 11:34
收件人： dev
主题： hive table change
hi all：
In my cluster there is another application which create some hive tables not in the original hive table position. where should I configure to access these hive tables？
回复： hive table change
Posted by 耳东 <77...@qq.com>.
How does kylin access the hive table , where can I configure to change the hive metadata kylin access.
------------------ 原始邮件 ------------------
发件人: "wangxianbin1987@gmail.com";<wa...@gmail.com>;
发送时间: 2016年4月21日(星期四) 中午1:19
收件人: "dev"<de...@kylin.apache.org>;
主题: 回复: hive table change
hi!
what do you mean by "original hive table position"?
do you mean hive "external table" or hive table that specific new hdfs location by hive 'location' keywords?
if it is so, you don't have to do extro config
if you mean hive that not deploy with kylin, it seem like that it is not supported by kylin(need comfirm by others)
best regards!
wangxianbin1987@gmail.com
发件人： 耳东
发送时间： 2016-04-21 11:34
收件人： dev
主题： hive table change
hi all：
In my cluster there is another application which create some hive tables not in the original hive table position. where should I configure to access these hive tables？