You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Mich Talebzadeh <mi...@gmail.com> on 2016/03/10 16:46:46 UTC
ODBC drivers for Hive 2
Hi,
The best ODBC drivers that I found to work with Hive 2 is Progress Data
Direct driver for Hive (ODBC 3 compliant)..
I tried Cloudera one very shaky (although I tried that on Hive 1.2.1).
Tried Microsoft ones but it hangs. Just to be clear I am using 64-bit
drivers.
This is not direct data fetch from Hive tables. I have used Power Designer
to create a Physical Mo from Hive schema/database using ODBC3 connection
(Power designer does not have Hive in list of its databases so ODB3 is the
choice).
I then intend to create a logical model from this physical model.
Anyone has better suggestions(s) for Hive ODBC drivers
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
Re: ODBC drivers for Hive 2
Posted by Mich Talebzadeh <mi...@gmail.com>.
I guess these vendor drivers are variants of generic ODBC 3 drivers. Some
of them like Progress direct do bespoke drivers. They used to be called
Merant drivers that made drivers for Oracle, Sybase and so forth and now
rebadged as Progress DataDirect ODBC drivers.
The issue is that I don't intend to fetch data from Hive. I am interested
in Hive metadata that actually is a schema stored in Oracle database in my
case. Also the physical model in Hive does not show table indexes or
constraints. Certainly These exist in Hive schema like below
[image: Inline images 2]
But not shown in Power Designer Physical model.
Does anyone know of a tool that shows full Hive schema with storage types
the table is built on etc?
Thanks
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
On 10 March 2016 at 21:03, Jörn Franke <jo...@gmail.com> wrote:
>
> Just out of curiosity: what is the code base for the odbc drivers by
> Hortonworks, cloudera & co? Did they develop them on their own?
>
> If yes, maybe one should think about an open source one, which is reliable
> and supports a richer set of Odbc functionality.
>
> Especially in the light of Orc,parquet, llap, tez and spark on Hive the
> odbc driver has actually now some use cases for interactive analytics. I
> can see already some improvements that could be made especially for visual
> analytic tools, such as Tableau or Spotfire.
>
> On 10 Mar 2016, at 21:49, Toby Allsopp <to...@wherescape.com>
> wrote:
>
> I've had the best luck with the Hortonworks driver (32-bit Windows). The
> Cloudera and Microsoft ones have seemed flaky (crashes, some SQL not
> supported). I haven't tried the Data Direct driver.
>
> Cheers,
> Toby.
>
> On Fri, Mar 11, 2016 at 4:46 AM, Mich Talebzadeh <
> mich.talebzadeh@gmail.com> wrote:
>
>> Hi,
>>
>> The best ODBC drivers that I found to work with Hive 2 is Progress Data
>> Direct driver for Hive (ODBC 3 compliant)..
>>
>> I tried Cloudera one very shaky (although I tried that on Hive 1.2.1).
>> Tried Microsoft ones but it hangs. Just to be clear I am using 64-bit
>> drivers.
>>
>> This is not direct data fetch from Hive tables. I have used Power
>> Designer to create a Physical Mo from Hive schema/database using ODBC3
>> connection (Power designer does not have Hive in list of its databases so
>> ODB3 is the choice).
>>
>> I then intend to create a logical model from this physical model.
>>
>> Anyone has better suggestions(s) for Hive ODBC drivers
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>
>
Re: ODBC drivers for Hive 2
Posted by Mich Talebzadeh <mi...@gmail.com>.
The problem with Tableau is that it tries to optimize the code itself which
really does not work for something that uses generic ODBC 3. We used to
have it with Tableau connecting to Oracle TimesTen IMDB (that did not have
its dedicated ODBC driver in Tableau so had to use ODBC 2, even an older
version). I am sure until Tableau knows how to optimize the query for Hive,
it would not really work. Optimizing joins in Hive etc at the moment I am
not sure.
I checked Tableau connectivity but they seem to suggest drivers from
Hortonworks and Cloudera and also their propriety Hadoop tools.
Cheers,
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
On 10 March 2016 at 23:49, Gopal Vijayaraghavan <go...@apache.org> wrote:
>
> > If yes, maybe one should think about an open source one, which is
> >reliable and supports a richer set of Odbc functionality.
>
> I had a similar thought last week, which ended up with me discovering that
> the hive/odbc folder is full of dead code.
>
> I'm going to rm -rvf odbc/ with
> https://issues.apache.org/jira/browse/HIVE-13234
>
> > I can see already some improvements that could be made especially for
> >visual analytic tools, such as Tableau or Spotfire.
>
> The ODBC capabilities bitsets need to be upgraded for something like
> Tableau's "Add to Context" to create a temporary table instead of running
> the full query everytime, for instance.
>
> Cheers,
> Gopal
>
>
>
Re: ODBC drivers for Hive 2
Posted by Gopal Vijayaraghavan <go...@apache.org>.
> If yes, maybe one should think about an open source one, which is
>reliable and supports a richer set of Odbc functionality.
I had a similar thought last week, which ended up with me discovering that
the hive/odbc folder is full of dead code.
I'm going to rm -rvf odbc/ with
https://issues.apache.org/jira/browse/HIVE-13234
> I can see already some improvements that could be made especially for
>visual analytic tools, such as Tableau or Spotfire.
The ODBC capabilities bitsets need to be upgraded for something like
Tableau's "Add to Context" to create a temporary table instead of running
the full query everytime, for instance.
Cheers,
Gopal
Re: ODBC drivers for Hive 2
Posted by Jörn Franke <jo...@gmail.com>.
Just out of curiosity: what is the code base for the odbc drivers by Hortonworks, cloudera & co? Did they develop them on their own?
If yes, maybe one should think about an open source one, which is reliable and supports a richer set of Odbc functionality.
Especially in the light of Orc,parquet, llap, tez and spark on Hive the odbc driver has actually now some use cases for interactive analytics. I can see already some improvements that could be made especially for visual analytic tools, such as Tableau or Spotfire.
> On 10 Mar 2016, at 21:49, Toby Allsopp <to...@wherescape.com> wrote:
>
> I've had the best luck with the Hortonworks driver (32-bit Windows). The Cloudera and Microsoft ones have seemed flaky (crashes, some SQL not supported). I haven't tried the Data Direct driver.
>
> Cheers,
> Toby.
>
>> On Fri, Mar 11, 2016 at 4:46 AM, Mich Talebzadeh <mi...@gmail.com> wrote:
>> Hi,
>>
>> The best ODBC drivers that I found to work with Hive 2 is Progress Data Direct driver for Hive (ODBC 3 compliant)..
>>
>> I tried Cloudera one very shaky (although I tried that on Hive 1.2.1). Tried Microsoft ones but it hangs. Just to be clear I am using 64-bit drivers.
>>
>> This is not direct data fetch from Hive tables. I have used Power Designer to create a Physical Mo from Hive schema/database using ODBC3 connection (Power designer does not have Hive in list of its databases so ODB3 is the choice).
>>
>> I then intend to create a logical model from this physical model.
>>
>> Anyone has better suggestions(s) for Hive ODBC drivers
>>
>> Dr Mich Talebzadeh
>>
>> LinkedIn https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>
>> http://talebzadehmich.wordpress.com
>
Re: ODBC drivers for Hive 2
Posted by Toby Allsopp <to...@wherescape.com>.
I've had the best luck with the Hortonworks driver (32-bit Windows). The
Cloudera and Microsoft ones have seemed flaky (crashes, some SQL not
supported). I haven't tried the Data Direct driver.
Cheers,
Toby.
On Fri, Mar 11, 2016 at 4:46 AM, Mich Talebzadeh <mi...@gmail.com>
wrote:
> Hi,
>
> The best ODBC drivers that I found to work with Hive 2 is Progress Data
> Direct driver for Hive (ODBC 3 compliant)..
>
> I tried Cloudera one very shaky (although I tried that on Hive 1.2.1).
> Tried Microsoft ones but it hangs. Just to be clear I am using 64-bit
> drivers.
>
> This is not direct data fetch from Hive tables. I have used Power Designer
> to create a Physical Mo from Hive schema/database using ODBC3 connection
> (Power designer does not have Hive in list of its databases so ODB3 is the
> choice).
>
> I then intend to create a logical model from this physical model.
>
> Anyone has better suggestions(s) for Hive ODBC drivers
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>