You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by mo...@apache.org on 2023/04/16 14:36:23 UTC
[doris] branch master updated: [doc][multi-catalog] add timed refresh en (#18705)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new b7d7525e9d [doc][multi-catalog] add timed refresh en (#18705)
b7d7525e9d is described below
commit b7d7525e9d2982262b8aa3c5dcb95ece675ea21d
Author: q763562998 <49...@users.noreply.github.com>
AuthorDate: Sun Apr 16 22:36:16 2023 +0800
[doc][multi-catalog] add timed refresh en (#18705)
For a catalog, we can set the metadata_refresh_interval_sec parameter to specify a timed refresh
---
.../docs/lakehouse/multi-catalog/multi-catalog.md | 21 +++++++++++++++++++++
1 file changed, 21 insertions(+)
diff --git a/docs/en/docs/lakehouse/multi-catalog/multi-catalog.md b/docs/en/docs/lakehouse/multi-catalog/multi-catalog.md
index 6ac5f4470b..d0f76713a6 100644
--- a/docs/en/docs/lakehouse/multi-catalog/multi-catalog.md
+++ b/docs/en/docs/lakehouse/multi-catalog/multi-catalog.md
@@ -313,6 +313,8 @@ Users need to manually update the metadata using the [REFRESH CATALOG](https://
<version since="1.2.2"></version>
+#### Hive Metastore
+
Currently, Doris only supports automatic update of metadata in Hive Metastore (HMS). It perceives changes in metadata by the FE node which regularly reads the notification events from HMS. The supported events are as follows:
| Event | Corresponding Update Operation |
@@ -356,3 +358,22 @@ To enable automatic update, you need to modify the hive-site.xml of HMS and then
```
> Note: To enable automatic update, whether for existing Catalogs or newly created Catalogs, all you need is to set `enable_hms_events_incremental_sync` to `true`, and then restart the FE node. You don't need to manually update the metadata before or after the restart.
+
+#### Timing Refresh
+
+When creating a catalog, specify the refresh time parameter `metadata_refresh_interval_sec` in the properties, in seconds. If this parameter is set when creating a catalog, the master node of FE will refresh the catalog regularly according to the parameter value. Three types are currently supported
+
+- hms: Hive MetaStore
+-es: Elasticsearch
+- jdbc: Standard interface for database access (JDBC)
+
+##### Example
+
+```
+-- Set the catalog refresh interval to 20 seconds
+CREATE CATALOG es PROPERTIES (
+ "type"="es",
+ "hosts"="http://127.0.0.1:9200",
+ "metadata_refresh_interval_sec"="20"
+);
+```
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org