You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by ur...@apache.org on 2023/03/31 01:40:18 UTC
[pulsar-site] branch main updated: Docs sync done from apache/pulsar (#68c10ee)
This is an automated email from the ASF dual-hosted git repository.
urfree pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/pulsar-site.git
The following commit(s) were added to refs/heads/main by this push:
new e0cff988bec Docs sync done from apache/pulsar (#68c10ee)
e0cff988bec is described below
commit e0cff988beca31d3403cf0798f73265edbef8a85
Author: github-actions[bot] <41...@users.noreply.github.com>
AuthorDate: Fri Mar 31 01:40:12 2023 +0000
Docs sync done from apache/pulsar (#68c10ee)
---
.../next/config/reference-configuration-broker.md | 47 +++++++++++++---------
.../config/reference-configuration-standalone.md | 47 +++++++++++++---------
static/swagger/master/swagger.json | 36 +++++++++++++++++
static/swagger/master/v2/swagger.json | 36 +++++++++++++++++
4 files changed, 130 insertions(+), 36 deletions(-)
diff --git a/static/reference/next/config/reference-configuration-broker.md b/static/reference/next/config/reference-configuration-broker.md
index 23183c168bf..a20fe7d2209 100644
--- a/static/reference/next/config/reference-configuration-broker.md
+++ b/static/reference/next/config/reference-configuration-broker.md
@@ -550,12 +550,12 @@ In FlowOrQpsEquallyDivideBundleSplitAlgorithm, if msgRate \>= loadBalancerNamesp
**Category**: Load Balancer
-### loadBalanceUnloadDelayInSeconds
+### loadBalanceSheddingDelayInSeconds
Delay (in seconds) to the next unloading cycle after unloading. The logic tries to give enough time for brokers to recompute load after unloading. The bigger value will delay the next unloading cycle longer. (only used in load balancer extension TransferSheddeer)
**Type**: `long`
-**Default**: `600`
+**Default**: `180`
**Dynamic**: `true`
@@ -671,17 +671,6 @@ Usage threshold to determine a broker whether to start threshold shedder
**Category**: Load Balancer
-### loadBalancerBundleLoadReportPercentage
-Percentage of bundles to compute topK bundle load data from each broker. The load balancer distributes bundles across brokers, based on topK bundle load data and other broker load data.The bigger value will increase the overhead of reporting many bundles in load data. (only used in load balancer extension logics)
-
-**Type**: `double`
-
-**Default**: `10.0`
-
-**Dynamic**: `true`
-
-**Category**: Load Balancer
-
### loadBalancerBundleUnloadMinThroughputThreshold
Bundle unload minimum throughput threshold (MB)
@@ -792,8 +781,8 @@ load balance load shedding strategy (It requires broker restart if value is chan
**Category**: Load Balancer
-### loadBalancerMaxNumberOfBrokerTransfersPerCycle
-Maximum number of brokers to transfer bundle load for each unloading cycle. The bigger value will incur more unloading/transfers for each unloading cycle. (only used in load balancer extension TransferSheddeer)
+### loadBalancerMaxNumberOfBrokerSheddingPerCycle
+Maximum number of brokers to unload bundle load for each unloading cycle. The bigger value will incur more unloading/transfers for each unloading cycle. (only used in load balancer extension TransferSheddeer)
**Type**: `int`
@@ -803,6 +792,17 @@ Maximum number of brokers to transfer bundle load for each unloading cycle. The
**Category**: Load Balancer
+### loadBalancerMaxNumberOfBundlesInBundleLoadReport
+Max number of bundles in bundle load report from each broker. The load balancer distributes bundles across brokers, based on topK bundle load data and other broker load data.The bigger value will increase the overhead of reporting many bundles in load data. (only used in load balancer extension logics)
+
+**Type**: `int`
+
+**Default**: `10`
+
+**Dynamic**: `true`
+
+**Category**: Load Balancer
+
### loadBalancerMaxNumberOfBundlesToSplitPerCycle
Max number of bundles to split to per cycle. (only used in load balancer extension logics)
@@ -880,12 +880,12 @@ maximum topics in a bundle, otherwise bundle split will be triggered
**Category**: Load Balancer
-### loadBalancerNamespaceBundleSplitConditionThreshold
+### loadBalancerNamespaceBundleSplitConditionHitCountThreshold
Threshold to the consecutive count of fulfilled split conditions. If the split scheduler consecutively finds bundles that meet split conditions many times bigger than this threshold, the scheduler will trigger splits on the bundles (if the number of bundles is less than loadBalancerNamespaceMaximumBundles). (only used in load balancer extension logics)
**Type**: `int`
-**Default**: `5`
+**Default**: `3`
**Dynamic**: `true`
@@ -979,6 +979,17 @@ Option to automatically unload namespace bundles with affinity(isolation) or ant
**Category**: Load Balancer
+### loadBalancerSheddingConditionHitCountThreshold
+Threshold to the consecutive count of fulfilled shedding(unload) conditions. If the unload scheduler consecutively finds bundles that meet unload conditions many times bigger than this threshold, the scheduler will shed the bundles. The bigger value will incur less bundle unloading/transfers. (only used in load balancer extension TransferSheddeer)
+
+**Type**: `int`
+
+**Default**: `3`
+
+**Dynamic**: `true`
+
+**Category**: Load Balancer
+
### loadBalancerSheddingEnabled
Enable/disable automatic bundle unloading for load-shedding
@@ -2599,7 +2610,7 @@ Size of the lookahead window to use when detecting if all the messages in the to
**Category**: Server
### delayedDeliveryMaxIndexesPerBucketSnapshotSegment
-The max number of delayed message index in per bucket snapshot segment, -1 means no limitationafter reaching the max number limitation, the snapshot segment will be cut off.
+The max number of delayed message index in per bucket snapshot segment, -1 means no limitation, after reaching the max number limitation, the snapshot segment will be cut off.
**Type**: `int`
diff --git a/static/reference/next/config/reference-configuration-standalone.md b/static/reference/next/config/reference-configuration-standalone.md
index 23183c168bf..a20fe7d2209 100644
--- a/static/reference/next/config/reference-configuration-standalone.md
+++ b/static/reference/next/config/reference-configuration-standalone.md
@@ -550,12 +550,12 @@ In FlowOrQpsEquallyDivideBundleSplitAlgorithm, if msgRate \>= loadBalancerNamesp
**Category**: Load Balancer
-### loadBalanceUnloadDelayInSeconds
+### loadBalanceSheddingDelayInSeconds
Delay (in seconds) to the next unloading cycle after unloading. The logic tries to give enough time for brokers to recompute load after unloading. The bigger value will delay the next unloading cycle longer. (only used in load balancer extension TransferSheddeer)
**Type**: `long`
-**Default**: `600`
+**Default**: `180`
**Dynamic**: `true`
@@ -671,17 +671,6 @@ Usage threshold to determine a broker whether to start threshold shedder
**Category**: Load Balancer
-### loadBalancerBundleLoadReportPercentage
-Percentage of bundles to compute topK bundle load data from each broker. The load balancer distributes bundles across brokers, based on topK bundle load data and other broker load data.The bigger value will increase the overhead of reporting many bundles in load data. (only used in load balancer extension logics)
-
-**Type**: `double`
-
-**Default**: `10.0`
-
-**Dynamic**: `true`
-
-**Category**: Load Balancer
-
### loadBalancerBundleUnloadMinThroughputThreshold
Bundle unload minimum throughput threshold (MB)
@@ -792,8 +781,8 @@ load balance load shedding strategy (It requires broker restart if value is chan
**Category**: Load Balancer
-### loadBalancerMaxNumberOfBrokerTransfersPerCycle
-Maximum number of brokers to transfer bundle load for each unloading cycle. The bigger value will incur more unloading/transfers for each unloading cycle. (only used in load balancer extension TransferSheddeer)
+### loadBalancerMaxNumberOfBrokerSheddingPerCycle
+Maximum number of brokers to unload bundle load for each unloading cycle. The bigger value will incur more unloading/transfers for each unloading cycle. (only used in load balancer extension TransferSheddeer)
**Type**: `int`
@@ -803,6 +792,17 @@ Maximum number of brokers to transfer bundle load for each unloading cycle. The
**Category**: Load Balancer
+### loadBalancerMaxNumberOfBundlesInBundleLoadReport
+Max number of bundles in bundle load report from each broker. The load balancer distributes bundles across brokers, based on topK bundle load data and other broker load data.The bigger value will increase the overhead of reporting many bundles in load data. (only used in load balancer extension logics)
+
+**Type**: `int`
+
+**Default**: `10`
+
+**Dynamic**: `true`
+
+**Category**: Load Balancer
+
### loadBalancerMaxNumberOfBundlesToSplitPerCycle
Max number of bundles to split to per cycle. (only used in load balancer extension logics)
@@ -880,12 +880,12 @@ maximum topics in a bundle, otherwise bundle split will be triggered
**Category**: Load Balancer
-### loadBalancerNamespaceBundleSplitConditionThreshold
+### loadBalancerNamespaceBundleSplitConditionHitCountThreshold
Threshold to the consecutive count of fulfilled split conditions. If the split scheduler consecutively finds bundles that meet split conditions many times bigger than this threshold, the scheduler will trigger splits on the bundles (if the number of bundles is less than loadBalancerNamespaceMaximumBundles). (only used in load balancer extension logics)
**Type**: `int`
-**Default**: `5`
+**Default**: `3`
**Dynamic**: `true`
@@ -979,6 +979,17 @@ Option to automatically unload namespace bundles with affinity(isolation) or ant
**Category**: Load Balancer
+### loadBalancerSheddingConditionHitCountThreshold
+Threshold to the consecutive count of fulfilled shedding(unload) conditions. If the unload scheduler consecutively finds bundles that meet unload conditions many times bigger than this threshold, the scheduler will shed the bundles. The bigger value will incur less bundle unloading/transfers. (only used in load balancer extension TransferSheddeer)
+
+**Type**: `int`
+
+**Default**: `3`
+
+**Dynamic**: `true`
+
+**Category**: Load Balancer
+
### loadBalancerSheddingEnabled
Enable/disable automatic bundle unloading for load-shedding
@@ -2599,7 +2610,7 @@ Size of the lookahead window to use when detecting if all the messages in the to
**Category**: Server
### delayedDeliveryMaxIndexesPerBucketSnapshotSegment
-The max number of delayed message index in per bucket snapshot segment, -1 means no limitationafter reaching the max number limitation, the snapshot segment will be cut off.
+The max number of delayed message index in per bucket snapshot segment, -1 means no limitation, after reaching the max number limitation, the snapshot segment will be cut off.
**Type**: `int`
diff --git a/static/swagger/master/swagger.json b/static/swagger/master/swagger.json
index a26a71086e6..07c056da1e9 100644
--- a/static/swagger/master/swagger.json
+++ b/static/swagger/master/swagger.json
@@ -1720,6 +1720,12 @@
"format": "int64",
"type": "integer"
},
+ "bucketDelayedIndexStats": {
+ "additionalProperties": {
+ "$ref": "#/definitions/TopicMetricBean"
+ },
+ "type": "object"
+ },
"bytesInCounter": {
"format": "int64",
"type": "integer"
@@ -2138,6 +2144,12 @@
"format": "int64",
"type": "integer"
},
+ "bucketDelayedIndexStats": {
+ "additionalProperties": {
+ "$ref": "#/definitions/TopicMetricBean"
+ },
+ "type": "object"
+ },
"bytesInCounter": {
"format": "int64",
"type": "integer"
@@ -2580,6 +2592,12 @@
"format": "int64",
"type": "integer"
},
+ "bucketDelayedIndexStats": {
+ "additionalProperties": {
+ "$ref": "#/definitions/TopicMetricBean"
+ },
+ "type": "object"
+ },
"bytesInCounter": {
"format": "int64",
"type": "integer"
@@ -3959,6 +3977,24 @@
},
"type": "object"
},
+ "TopicMetricBean": {
+ "properties": {
+ "labelsAndValues": {
+ "items": {
+ "type": "string"
+ },
+ "type": "array"
+ },
+ "name": {
+ "type": "string"
+ },
+ "value": {
+ "format": "double",
+ "type": "number"
+ }
+ },
+ "type": "object"
+ },
"TopicStats": {
"properties": {
"averageMsgSize": {
diff --git a/static/swagger/master/v2/swagger.json b/static/swagger/master/v2/swagger.json
index a26a71086e6..07c056da1e9 100644
--- a/static/swagger/master/v2/swagger.json
+++ b/static/swagger/master/v2/swagger.json
@@ -1720,6 +1720,12 @@
"format": "int64",
"type": "integer"
},
+ "bucketDelayedIndexStats": {
+ "additionalProperties": {
+ "$ref": "#/definitions/TopicMetricBean"
+ },
+ "type": "object"
+ },
"bytesInCounter": {
"format": "int64",
"type": "integer"
@@ -2138,6 +2144,12 @@
"format": "int64",
"type": "integer"
},
+ "bucketDelayedIndexStats": {
+ "additionalProperties": {
+ "$ref": "#/definitions/TopicMetricBean"
+ },
+ "type": "object"
+ },
"bytesInCounter": {
"format": "int64",
"type": "integer"
@@ -2580,6 +2592,12 @@
"format": "int64",
"type": "integer"
},
+ "bucketDelayedIndexStats": {
+ "additionalProperties": {
+ "$ref": "#/definitions/TopicMetricBean"
+ },
+ "type": "object"
+ },
"bytesInCounter": {
"format": "int64",
"type": "integer"
@@ -3959,6 +3977,24 @@
},
"type": "object"
},
+ "TopicMetricBean": {
+ "properties": {
+ "labelsAndValues": {
+ "items": {
+ "type": "string"
+ },
+ "type": "array"
+ },
+ "name": {
+ "type": "string"
+ },
+ "value": {
+ "format": "double",
+ "type": "number"
+ }
+ },
+ "type": "object"
+ },
"TopicStats": {
"properties": {
"averageMsgSize": {