You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Artur Brandys <ar...@onwelo.com> on 2022/10/25 12:40:35 UTC
DeltaLake hive table reading problem in Zeppelin
Hi.
I have problem with reading DeltaLake hive table when I try to execute select statement in %spark.sql interpreter and I get this error:
java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: Error in loading
storage handler.io.delta.hive.DeltaStorageHandler
I add some configuration to my spark interpreter using this article:
https://towardsdatascience.com/deep-dive-into-delta-lake-via-apache-zeppelin-d59db1673584
but it isn't working.
What can be wrong?
Artur Brandys
Administrator Data Lake
Onwelo SA
www.onwelo.com<https://www.onwelo.com/>
[Logo Onwelo SA]
[LinkedIn Icon]<https://pl.linkedin.com/company/onwelo> [Facebook Icon] <https://pl-pl.facebook.com/onwelo> [Twitter] <https://twitter.com/onwelo_sa> [Instagram Icon] <https://www.instagram.com/onwelo_com/>
RE: DeltaLake hive table reading problem in Zeppelin
Posted by Artur Brandys <ar...@onwelo.com>.
Yes I use the same configuration as in this article.
When I try to create the table from the article I get an error:
Table is marked as a manged table but is not transactional.
For our needs we are using external tables for creating DeltaLake tables.
Artur Brandys
Administrator Data Lake
Onwelo SA
www.onwelo.com<https://www.onwelo.com/>
[Logo Onwelo SA]
[LinkedIn Icon]<https://pl.linkedin.com/company/onwelo> [Facebook Icon] <https://pl-pl.facebook.com/onwelo> [Twitter] <https://twitter.com/onwelo_sa> [Instagram Icon] <https://www.instagram.com/onwelo_com/>
From: Jeff Zhang <zj...@gmail.com>
Sent: Tuesday, October 25, 2022 3:59 PM
To: users@zeppelin.apache.org
Subject: Re: DeltaLake hive table reading problem in Zeppelin
Do you use the same configuration as this article? Can you run the sample code in this article?
On Tue, Oct 25, 2022 at 8:42 PM Artur Brandys <ar...@onwelo.com>> wrote:
Hi.
I have problem with reading DeltaLake hive table when I try to execute select statement in %spark.sql interpreter and I get this error:
java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: Error in loading
storage handler.io.delta.hive.DeltaStorageHandler
I add some configuration to my spark interpreter using this article:
https://towardsdatascience.com/deep-dive-into-delta-lake-via-apache-zeppelin-d59db1673584
but it isn’t working.
What can be wrong?
Artur Brandys
Administrator Data Lake
Onwelo SA
www.onwelo.com<https://www.onwelo.com/>
[Logo Onwelo SA]
[LinkedIn Icon]<https://pl.linkedin.com/company/onwelo> [Facebook Icon] <https://pl-pl.facebook.com/onwelo> [Twitter] <https://twitter.com/onwelo_sa> [Instagram Icon] <https://www.instagram.com/onwelo_com/>
--
Best Regards
Jeff Zhang
Re: DeltaLake hive table reading problem in Zeppelin
Posted by Jeff Zhang <zj...@gmail.com>.
Do you use the same configuration as this article? Can you run the sample
code in this article?
On Tue, Oct 25, 2022 at 8:42 PM Artur Brandys <ar...@onwelo.com>
wrote:
> Hi.
>
> I have problem with reading DeltaLake hive table when I try to execute
> select statement in %spark.sql interpreter and I get this error:
>
>
>
> *java.lang.RuntimeException:*
>
> * org.apache.hadoop.hive.ql.metadata.HiveException: Error in loading
> storage handler.io.delta.hive.DeltaStorageHandler*
>
>
>
> I add some configuration to my spark interpreter using this article:
>
>
> https://towardsdatascience.com/deep-dive-into-delta-lake-via-apache-zeppelin-d59db1673584
>
> but it isn’t working.
>
>
>
> What can be wrong?
>
>
>
>
>
> *Artur Brandys*
>
> Administrator Data Lake
>
> Onwelo SA
> www.onwelo.com
> [image: Logo Onwelo SA]
>
> [image: LinkedIn Icon] <https://pl.linkedin.com/company/onwelo> [image:
> Facebook Icon] <https://pl-pl.facebook.com/onwelo> [image: Twitter]
> <https://twitter.com/onwelo_sa> [image: Instagram Icon]
> <https://www.instagram.com/onwelo_com/>
>
>
>
--
Best Regards
Jeff Zhang