You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by sai chaitanya tirumerla <ti...@gmail.com> on 2014/07/29 01:28:47 UTC
Passing hive conf variables through ODBC/JDBC
Hi,
We are connecting ODBC/JDBC tools to hiveserver2 using <ipaddr:10000> and
ldap authentication and wanted to pass hiveconf variables explicitly
through it.
Can anybody help me how to pass the hiveconf variables explicitly when the
connection is made to hiveserver2.
It works perfectly fine from cli as hive takes hiveconf variables
explicitly.
Example hiveconf variables:
hive -hiveconf fs.s3.awsAccessKeyId=xxxxxxx -hiveconf
fs.s3.awsSecretAccesskey=xxxxxx
This works fine in hive cli but is there anyway that we can pass to
hiveserver2 through ODBC/JDBC tools.
Thanks in Advance!!
--Sai
Re: Passing hive conf variables through ODBC/JDBC
Posted by sai chaitanya tirumerla <ti...@gmail.com>.
Hi,
Thanks Lars. I'm using hive 0.11 and it throws "can't execute after
statement is closed" error when doing it(jdbc:hive2://foobar:10000/database?
fs.s3.awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx) from sql
workbench.
i have tried different methods to make it work like
jdbc:hive2://foobar:10000/database;fs.s3.awsAccessKeyId=xxxxxxx;fs.s3.
awsSecretAccesskey=xxxxxx
jdbc:hive2://foobar:10000/database;fs.s3.awsAccessKeyId=xxxxxxx?fs.s3.
awsSecretAccesskey=xxxxxx
and none of them worked.Could you please give me some insights if i'm
missing anything.
Thanks
On Mon, Jul 28, 2014 at 5:10 PM, Lars Francke <la...@gmail.com>
wrote:
> Hi,
>
> 1. I'm afraid I have no idea about ODBC
> 2. No need to specify anything on the client side when using LDAP. That
> was just an example
>
> So it'd look like this for you: jdbc:hive2://foobar:10000/database?fs.s3.
> awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx
>
> Cheers,
> Lars
>
>
>
> On Tue, Jul 29, 2014 at 1:56 AM, sai chaitanya tirumerla <
> tirumerla@gmail.com> wrote:
>
>> Hi Lars,
>>
>> Thank you so much for the information. I have couple of questions here
>> 1. I would like to also access from ODBC tools , can i do it in any other
>> way?
>> 2. What if my authentication is LDAP , can i use
>>
>> jdbc:hive2://foobar:10000/database;auth=*LDAP*?
>> fs.s3.awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx
>>
>>
>> Thanks
>>
>>
>> On Mon, Jul 28, 2014 at 4:42 PM, Lars Francke <la...@gmail.com>
>> wrote:
>>
>>> Yes there is.
>>>
>>> The format
>>> is: jdbc:hive2://<host>:<port>/dbName;sess_var_list?hive_conf_list#hive_var_list
>>>
>>> Example:
>>> jdbc:hive2://foobar:10000/database;auth=noSasl?
>>> fs.s3.awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx#foo=bar
>>>
>>> Cheers,
>>> Lars
>>>
>>>
>>> On Tue, Jul 29, 2014 at 1:28 AM, sai chaitanya tirumerla <
>>> tirumerla@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> We are connecting ODBC/JDBC tools to hiveserver2 using <ipaddr:10000>
>>>> and ldap authentication and wanted to pass hiveconf variables explicitly
>>>> through it.
>>>> Can anybody help me how to pass the hiveconf variables explicitly when
>>>> the connection is made to hiveserver2.
>>>> It works perfectly fine from cli as hive takes hiveconf variables
>>>> explicitly.
>>>>
>>>> Example hiveconf variables:
>>>> hive -hiveconf fs.s3.awsAccessKeyId=xxxxxxx -hiveconf
>>>> fs.s3.awsSecretAccesskey=xxxxxx
>>>>
>>>> This works fine in hive cli but is there anyway that we can pass to
>>>> hiveserver2 through ODBC/JDBC tools.
>>>>
>>>>
>>>> Thanks in Advance!!
>>>>
>>>>
>>>> --Sai
>>>>
>>>>
>>>>
>>>
>>
>
Re: Passing hive conf variables through ODBC/JDBC
Posted by Lars Francke <la...@gmail.com>.
Hi,
1. I'm afraid I have no idea about ODBC
2. No need to specify anything on the client side when using LDAP. That was
just an example
So it'd look like this for you: jdbc:hive2://foobar:10000/database?fs.s3.
awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx
Cheers,
Lars
On Tue, Jul 29, 2014 at 1:56 AM, sai chaitanya tirumerla <
tirumerla@gmail.com> wrote:
> Hi Lars,
>
> Thank you so much for the information. I have couple of questions here
> 1. I would like to also access from ODBC tools , can i do it in any other
> way?
> 2. What if my authentication is LDAP , can i use
>
> jdbc:hive2://foobar:10000/database;auth=*LDAP*?
> fs.s3.awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx
>
>
> Thanks
>
>
> On Mon, Jul 28, 2014 at 4:42 PM, Lars Francke <la...@gmail.com>
> wrote:
>
>> Yes there is.
>>
>> The format
>> is: jdbc:hive2://<host>:<port>/dbName;sess_var_list?hive_conf_list#hive_var_list
>>
>> Example:
>> jdbc:hive2://foobar:10000/database;auth=noSasl?
>> fs.s3.awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx#foo=bar
>>
>> Cheers,
>> Lars
>>
>>
>> On Tue, Jul 29, 2014 at 1:28 AM, sai chaitanya tirumerla <
>> tirumerla@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> We are connecting ODBC/JDBC tools to hiveserver2 using <ipaddr:10000>
>>> and ldap authentication and wanted to pass hiveconf variables explicitly
>>> through it.
>>> Can anybody help me how to pass the hiveconf variables explicitly when
>>> the connection is made to hiveserver2.
>>> It works perfectly fine from cli as hive takes hiveconf variables
>>> explicitly.
>>>
>>> Example hiveconf variables:
>>> hive -hiveconf fs.s3.awsAccessKeyId=xxxxxxx -hiveconf
>>> fs.s3.awsSecretAccesskey=xxxxxx
>>>
>>> This works fine in hive cli but is there anyway that we can pass to
>>> hiveserver2 through ODBC/JDBC tools.
>>>
>>>
>>> Thanks in Advance!!
>>>
>>>
>>> --Sai
>>>
>>>
>>>
>>
>
Re: Passing hive conf variables through ODBC/JDBC
Posted by sai chaitanya tirumerla <ti...@gmail.com>.
Hi Lars,
Thank you so much for the information. I have couple of questions here
1. I would like to also access from ODBC tools , can i do it in any other
way?
2. What if my authentication is LDAP , can i use
jdbc:hive2://foobar:10000/database;auth=*LDAP*?fs.s3.awsAccessKeyId=xxxxxxx;
fs.s3.awsSecretAccesskey=xxxxxx
Thanks
On Mon, Jul 28, 2014 at 4:42 PM, Lars Francke <la...@gmail.com>
wrote:
> Yes there is.
>
> The format
> is: jdbc:hive2://<host>:<port>/dbName;sess_var_list?hive_conf_list#hive_var_list
>
> Example:
> jdbc:hive2://foobar:10000/database;auth=noSasl?
> fs.s3.awsAccessKeyId=xxxxxxx;fs.s3.awsSecretAccesskey=xxxxxx#foo=bar
>
> Cheers,
> Lars
>
>
> On Tue, Jul 29, 2014 at 1:28 AM, sai chaitanya tirumerla <
> tirumerla@gmail.com> wrote:
>
>> Hi,
>>
>> We are connecting ODBC/JDBC tools to hiveserver2 using <ipaddr:10000> and
>> ldap authentication and wanted to pass hiveconf variables explicitly
>> through it.
>> Can anybody help me how to pass the hiveconf variables explicitly when
>> the connection is made to hiveserver2.
>> It works perfectly fine from cli as hive takes hiveconf variables
>> explicitly.
>>
>> Example hiveconf variables:
>> hive -hiveconf fs.s3.awsAccessKeyId=xxxxxxx -hiveconf
>> fs.s3.awsSecretAccesskey=xxxxxx
>>
>> This works fine in hive cli but is there anyway that we can pass to
>> hiveserver2 through ODBC/JDBC tools.
>>
>>
>> Thanks in Advance!!
>>
>>
>> --Sai
>>
>>
>>
>
Re: Passing hive conf variables through ODBC/JDBC
Posted by Lars Francke <la...@gmail.com>.
Yes there is.
The format
is: jdbc:hive2://<host>:<port>/dbName;sess_var_list?hive_conf_list#hive_var_list
Example:
jdbc:hive2://foobar:10000/database;auth=noSasl?fs.s3.awsAccessKeyId=xxxxxxx;
fs.s3.awsSecretAccesskey=xxxxxx#foo=bar
Cheers,
Lars
On Tue, Jul 29, 2014 at 1:28 AM, sai chaitanya tirumerla <
tirumerla@gmail.com> wrote:
> Hi,
>
> We are connecting ODBC/JDBC tools to hiveserver2 using <ipaddr:10000> and
> ldap authentication and wanted to pass hiveconf variables explicitly
> through it.
> Can anybody help me how to pass the hiveconf variables explicitly when the
> connection is made to hiveserver2.
> It works perfectly fine from cli as hive takes hiveconf variables
> explicitly.
>
> Example hiveconf variables:
> hive -hiveconf fs.s3.awsAccessKeyId=xxxxxxx -hiveconf
> fs.s3.awsSecretAccesskey=xxxxxx
>
> This works fine in hive cli but is there anyway that we can pass to
> hiveserver2 through ODBC/JDBC tools.
>
>
> Thanks in Advance!!
>
>
> --Sai
>
>
>