You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Cribbee (via GitHub)" <gi...@apache.org> on 2025/06/18 07:36:05 UTC
[I] [Feature] Hope to retrieve FileStoreTable information via HMS in SparkSource#loadTable. [paimon]
Cribbee opened a new issue, #5770:
URL: https://github.com/apache/paimon/issues/5770
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Motivation
In the current implementation, when writing to an existing Paimon table via Spark DataFrame (e.g., df.write.format("paimon").mode("append").option("path",xxx).save()), the SparkTable initialization can only create a FileStoreTable instance through CoreOptions.path(options), even if a Hive Catalog has already been configured.
While using table-path for initialization is ok, there exists a scenario where the path of an existing Paimon table does not conform to the standard path format. This results in validation failure and write errors, with the following message:
"Path 'xxx' is not a valid path. Please use a catalog table path instead: 'warehouse_path/your_database.db/your_table'."
### Solution
Add a method in CoreOptions to retrieve TABLE_ID (the full name of the table), then instantiate a FileStoreTable via HiveCatalog to resolve the aforementioned issues.
### Anything else?
_No response_
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org