You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gravitino.apache.org by "shashihoushengqia (via GitHub)" <gi...@apache.org> on 2026/01/28 06:47:46 UTC
[D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
GitHub user shashihoushengqia created a discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
When I started Spark using kyuubi and then connected to it through DataGrip and DBeaver, I encountered an error.
Error operating GetSchemas: java.lang.IllegalArgumentException: Doesn't support listing namespaces with db_dev
at org.apache.gravitino.shaded.com.google.common.base.Preconditions.checkArgument(Preconditions.java:143)
at org.apache.gravitino.spark.connector.catalog.BaseCatalog.listNamespaces(BaseCatalog.java:346)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.$anonfun$listAllNamespaces$1(SparkCatalogUtils.scala:113)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.$anonfun$listAllNamespaces$1$adapted(SparkCatalogUtils.scala:112)
at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:293)
at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
at scala.collection.TraversableLike.flatMap(TraversableLike.scala:293)
at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:290)
at scala.collection.mutable.ArrayOps$ofRef.flatMap(ArrayOps.scala:198)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.listAllNamespaces(SparkCatalogUtils.scala:112)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.listAllNamespaces(SparkCatalogUtils.scala:129)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.getSchemasWithPattern(SparkCatalogUtils.scala:145)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.getSchemas(SparkCatalogUtils.scala:98)
at org.apache.kyuubi.engine.spark.operation.GetSchemas.runInternal(GetSchemas.scala:43)
at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:185)
at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:104)
at org.apache.kyuubi.engine.spark.session.SparkSessionImpl.runOperation(SparkSessionImpl.scala:109)
at org.apache.kyuubi.session.AbstractSession.getSchemas(AbstractSession.scala:155)
at org.apache.kyuubi.service.AbstractBackendService.getSchemas(AbstractBackendService.scala:83)
at org.apache.kyuubi.service.TFrontendService.GetSchemas(TFrontendService.scala:307)
at org.apache.kyuubi.shaded.hive.service.rpc.thrift.TCLIService$Processor$GetSchemas.getResult(TCLIService.java:1745)
at org.apache.kyuubi.shaded.hive.service.rpc.thrift.TCLIService$Processor$GetSchemas.getResult(TCLIService.java:1725)
at org.apache.kyuubi.shaded.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.kyuubi.shaded.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:35)
at org.apache.kyuubi.shaded.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:250)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829).
This would cause both DataGrip and DBeaver to fail to display the database name of Iceberg properly. However, when I used SQL commands such as "show catalogs", "show databases", "show namespaces", and "show tables", everything worked normally and I was also able to query the data within the tables normally.I'm not sure whether this is a problem with gravitino or with kyuubi.
<img width="3018" height="957" alt="image" src="https://github.com/user-attachments/assets/4192d40f-2a60-4e37-9f5b-ee733c266668" />
GitHub link: https://github.com/apache/gravitino/discussions/9819
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "FANNG1 (via GitHub)" <gi...@apache.org>.
GitHub user FANNG1 added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
Be curious why calling of the listing namespaces API is under db_dev?
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625722
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
> Be curious why calling of the listing namespaces API is under db_dev?
I've identified the problem. It's a configuration error.
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15628368
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "FANNG1 (via GitHub)" <gi...@apache.org>.
GitHub user FANNG1 added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
Do you have a nested namespace in your environment? It seems you are listing namespaces under `db_dev`. Currently, Gravitino does not support nested namespaces.
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625191
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
GitHub user jerqi edited a comment on the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
@FANNG1 Could u reply this question?
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625184
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
> Do you have a nested namespace in your environment? It seems you are listing namespaces under `db_dev`. Currently, Gravitino does not support nested namespaces.
<img width="3041" height="988" alt="image" src="https://github.com/user-attachments/assets/14dca248-55c7-4fb9-93e1-6865dd90d7c7" />
This is the normal situation when I use the "Static Catalog Configuration Provider".
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625421
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia closed a discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
When I started Spark using kyuubi and then connected to it through DataGrip and DBeaver, I encountered an error.
Error operating GetSchemas: java.lang.IllegalArgumentException: Doesn't support listing namespaces with db_dev
at org.apache.gravitino.shaded.com.google.common.base.Preconditions.checkArgument(Preconditions.java:143)
at org.apache.gravitino.spark.connector.catalog.BaseCatalog.listNamespaces(BaseCatalog.java:346)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.$anonfun$listAllNamespaces$1(SparkCatalogUtils.scala:113)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.$anonfun$listAllNamespaces$1$adapted(SparkCatalogUtils.scala:112)
at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:293)
at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
at scala.collection.TraversableLike.flatMap(TraversableLike.scala:293)
at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:290)
at scala.collection.mutable.ArrayOps$ofRef.flatMap(ArrayOps.scala:198)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.listAllNamespaces(SparkCatalogUtils.scala:112)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.listAllNamespaces(SparkCatalogUtils.scala:129)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.getSchemasWithPattern(SparkCatalogUtils.scala:145)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.getSchemas(SparkCatalogUtils.scala:98)
at org.apache.kyuubi.engine.spark.operation.GetSchemas.runInternal(GetSchemas.scala:43)
at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:185)
at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:104)
at org.apache.kyuubi.engine.spark.session.SparkSessionImpl.runOperation(SparkSessionImpl.scala:109)
at org.apache.kyuubi.session.AbstractSession.getSchemas(AbstractSession.scala:155)
at org.apache.kyuubi.service.AbstractBackendService.getSchemas(AbstractBackendService.scala:83)
at org.apache.kyuubi.service.TFrontendService.GetSchemas(TFrontendService.scala:307)
at org.apache.kyuubi.shaded.hive.service.rpc.thrift.TCLIService$Processor$GetSchemas.getResult(TCLIService.java:1745)
at org.apache.kyuubi.shaded.hive.service.rpc.thrift.TCLIService$Processor$GetSchemas.getResult(TCLIService.java:1725)
at org.apache.kyuubi.shaded.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.kyuubi.shaded.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:35)
at org.apache.kyuubi.shaded.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:250)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829).
This would cause both DataGrip and DBeaver to fail to display the database name of Iceberg properly. However, when I used SQL commands such as "show catalogs", "show databases", "show namespaces", and "show tables", everything worked normally and I was also able to query the data within the tables normally.I'm not sure whether this is a problem with gravitino or with kyuubi.
<img width="3018" height="957" alt="image" src="https://github.com/user-attachments/assets/4192d40f-2a60-4e37-9f5b-ee733c266668" />
GitHub link: https://github.com/apache/gravitino/discussions/9819
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
> Do you have a nested namespace in your environment? It seems you are listing namespaces under `db_dev`. Currently, Gravitino does not support nested namespaces.
<img width="2106" height="674" alt="image" src="https://github.com/user-attachments/assets/2145e909-445b-4c96-bec7-d405f555bba6" />
"catalog" is "iceberg_catalog_yizhihangmu", "database" is "db_dev", and "table" is "tab_test01". There should be no nested namespaces. Additionally, I previously used "Static catalog configuration provider", and this issue did not occur. Both Datagrip and DBeaver can display the database name normally.
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625244
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia deleted a comment on the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
> Be curious why calling of the listing namespaces API is under db_dev?
I've identified the problem. It's a configuration error.
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15628364
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia edited a comment on the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
I was assigned the catalog for the gravitino iceberg rest catalog through the dynamic-config-provider.My settings in gravitino are as follows：
<img width="445" height="1036" alt="image" src="https://github.com/user-attachments/assets/abe69edf-475a-469e-beb2-5ca4ce67978b" />
<img width="2200" height="982" alt="image" src="https://github.com/user-attachments/assets/c994ea20-9ae0-45e3-ac5a-d9c177439236" />
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625038
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
I was assigned the catalog for the gravitino iceberg rest catalog through the dynamic-config-provider.My settings in gravitino are as follows：
<img width="445" height="1036" alt="image" src="https://github.com/user-attachments/assets/abe69edf-475a-469e-beb2-5ca4ce67978b" />
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625038
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
GitHub user jerqi added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
@FANNG1
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15625184
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org
Re: [D] An error in the integration of Kyuubi, Gravitino, and Iceberg. [gravitino]
Posted by "shashihoushengqia (via GitHub)" <gi...@apache.org>.
GitHub user shashihoushengqia added a comment to the discussion: An error in the integration of Kyuubi, Gravitino, and Iceberg.
> Be curious why calling of the listing namespaces API is under db_dev?
I've identified the problem. It's a configuration error.
GitHub link: https://github.com/apache/gravitino/discussions/9819#discussioncomment-15628364
----
This is an automatically sent email for dev@gravitino.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@gravitino.apache.org