You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amoro.apache.org by "XingChenBigData (via GitHub)" <gi...@apache.org> on 2025/06/08 10:29:12 UTC
[I] [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file? [amoro]
XingChenBigData opened a new issue, #3603:
URL: https://github.com/apache/amoro/issues/3603
### What happened?
Multiple catalogs are configured in the Amoro environment, and the Amoro Web Terminal supports users to dynamically switch between these catalogs. For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file, or can it be done directly by executing Spark-SQL statements?
### Affects Versions
0.7.1
### What table formats are you seeing the problem on?
_No response_
### What engines are you seeing the problem on?
_No response_
### How to reproduce
_No response_
### Relevant log output
```shell
```
### Anything else
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's Code of Conduct
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file? [amoro]
Posted by "XingChenBigData (via GitHub)" <gi...@apache.org>.
XingChenBigData commented on issue #3603:
URL: https://github.com/apache/amoro/issues/3603#issuecomment-2954451832
#应用 Spark Extensions
spark.sql.extensions=org.apache.amoro.spark.MixedFormatSparkExtensions
#配置 Amoro Catalog
spark.sql.defaultCatalog=mixed_catalog
spark.sql.catalog.mixed_catalog=org.apache.amoro.spark.MixedFormatSparkCatalog
spark.sql.catalog.mixed_catalog.url=thrift://172.18.0.4:1260/mixed_catalog
#第二个catalog
spark.sql.catalog.kyuubi_mixed_iceberg_catalog=org.apache.amoro.spark.MixedFormatSparkCatalog
spark.sql.catalog.kyuubi_mixed_iceberg_catalog.url=thrift://172.18.0.4:1260/kyuubi_mixed_iceberg_catalog
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file? [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3603:
URL: https://github.com/apache/amoro/issues/3603#issuecomment-3621390520
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file? [amoro]
Posted by "XingChenBigData (via GitHub)" <gi...@apache.org>.
XingChenBigData commented on issue #3603:
URL: https://github.com/apache/amoro/issues/3603#issuecomment-2954470605
#编辑kyuubi配置文件，增加下面内容
#vi /etc/kyuubi/conf/kyuubi-defaults.conf
spark.sql.defaultCatalog=amoro_external_catalog_for_iceberg
spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions
spark.sql.catalog.spark_catalog=org.apache.iceberg.spark.SparkSessionCatalog
spark.sql.catalog.spark_catalog.type=hive
spark.sql.catalog.amoro_external_catalog_for_iceberg=org.apache.iceberg.spark.SparkCatalog
spark.sql.catalog.local.type=hive
spark.sql.catalog.local.uri=thrift://hadoop-master1.orb.local:9083
spark.sql.catalog.amoro_external_catalog_for_iceberg.warehouse=hdfs://hadoop-master1.orb.local:8020/warehouse
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file? [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #3603: [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file?
URL: https://github.com/apache/amoro/issues/3603
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file? [amoro]
Posted by "XingChenBigData (via GitHub)" <gi...@apache.org>.
XingChenBigData commented on issue #3603:
URL: https://github.com/apache/amoro/issues/3603#issuecomment-2953934101
You need to add spark.sql.extensions to the configuration file /etc/kyuubi/conf/kyuubi-defaults.conf to register custom extension classes. Mainly, there should be no spaces.
#vi /etc/kyuubi/conf/kyuubi-defaults.conf
spark.sql.defaultCatalog=mixed_catalog
##First catalog
spark.sql.catalog.mixed_catalog=org.apache.amoro.spark.MixedFormatSparkCatalog
spark.sql.catalog.mixed_catalog.url=thrift://172.18.0.4:1260/mixed_catalog
##Second catalog
spark.sql.catalog.kyuubi_mixed_iceberg_catalog=org.apache.amoro.spark.MixedFormatSparkCatalog
spark.sql.catalog.kyuubi_mixed_iceberg_catalog.url=thrift://172.18.0.4:1260/kyuubi_mixed_iceberg_catalog
#Restart kyuubi
/opt/kyuubi/bin/kyuubi restart
#Enter the kyuubi command line
kyuubi-beeline -u "jdbc:hive2://127.0.0.1:10009/"
0: jdbc:hive2://127.0.0.1:10009/> show catalogs;
+----------------+
| catalog |
+----------------+
| mixed_catalog |
| tpcds |
| tpch |
+----------------+
Why is there no separate kyuubi_mixed_iceberg_catalog catalog?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: For Kyuubi services accessed through the command line, how should users switch between different catalogs? Does this operation have to be done by modifying the Kyuubi configuration file? [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3603:
URL: https://github.com/apache/amoro/issues/3603#issuecomment-3679759277
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org