You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by bo...@apache.org on 2022/05/18 08:40:25 UTC

[pulsar] branch master updated: [feature][doc][config]Add missing transaction config in standalone.conf and broker.conf (#15614)

This is an automated email from the ASF dual-hosted git repository.

bogong pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pulsar.git


The following commit(s) were added to refs/heads/master by this push:
     new 3c60063716d [feature][doc][config]Add missing transaction config in standalone.conf and broker.conf (#15614)
3c60063716d is described below

commit 3c60063716d3cdd561bf1e956a551a2297869fd9
Author: Xiangying Meng <55...@users.noreply.github.com>
AuthorDate: Wed May 18 16:40:13 2022 +0800

    [feature][doc][config]Add missing transaction config in standalone.conf and broker.conf (#15614)
    
    Add doc for https://github.com/apache/pulsar/pull/15137
    ### Motivation & Modification
    Add missing transaction config in standalone.conf and broker.conf
---
 conf/broker.conf                      |  2 +-
 conf/standalone.conf                  |  2 +-
 site2/docs/reference-configuration.md | 12 ++++++++++--
 3 files changed, 12 insertions(+), 4 deletions(-)

diff --git a/conf/broker.conf b/conf/broker.conf
index 654bacdcc45..48a576667c1 100644
--- a/conf/broker.conf
+++ b/conf/broker.conf
@@ -1395,7 +1395,7 @@ fileSystemURI=
 transactionCoordinatorEnabled=false
 transactionMetadataStoreProviderClassName=org.apache.pulsar.transaction.coordinator.impl.MLTransactionMetadataStoreProvider
 
-# Transaction buffer take snapshot transaction count
+# Transaction buffer takes a snapshot after the number of transaction operations reaches this value.
 transactionBufferSnapshotMaxTransactionCount=1000
 
 # Transaction buffer take snapshot interval time
diff --git a/conf/standalone.conf b/conf/standalone.conf
index e07352d8b52..aa29911a56a 100644
--- a/conf/standalone.conf
+++ b/conf/standalone.conf
@@ -1043,7 +1043,7 @@ defaultNumPartitions=1
 transactionCoordinatorEnabled=false
 transactionMetadataStoreProviderClassName=org.apache.pulsar.transaction.coordinator.impl.MLTransactionMetadataStoreProvider
 
-# Transaction buffer take snapshot transaction count
+# Transaction buffer takes a snapshot after the number of transaction operations reaches this value.
 transactionBufferSnapshotMaxTransactionCount=1000
 
 # Transaction buffer take snapshot interval time
diff --git a/site2/docs/reference-configuration.md b/site2/docs/reference-configuration.md
index 030605f6bdc..b9c91325bcd 100644
--- a/site2/docs/reference-configuration.md
+++ b/site2/docs/reference-configuration.md
@@ -333,7 +333,11 @@ brokerServiceCompactionThresholdInBytes|If the estimated backlog size is greater
 |replicatorPrefix|  Replicator prefix used for replicator producer name and cursor name pulsar.repl||
 |transactionBufferClientOperationTimeoutInMills|The transaction buffer client's operation timeout in milliseconds.|3000|
 |transactionCoordinatorEnabled|Whether to enable transaction coordinator in broker.|true|
-|transactionMetadataStoreProviderClassName| |org.apache.pulsar.transaction.coordinator.impl.InMemTransactionMetadataStoreProvider|
+|transactionMetadataStoreProviderClassName|The class name of transactionMetadataStoreProvider.|org.apache.pulsar.transaction.coordinator.impl.MLTransactionMetadataStoreProvider|
+|transactionBufferSnapshotMaxTransactionCount|Transaction buffer takes a snapshot after the number of transaction operations reaches this value.|1000|
+|transactionBufferSnapshotMinTimeInMillis| The interval between two snapshots that the transaction buffer takes (in milliseconds).|5000|
+|transactionPendingAckLogIndexMinLag| The minimum lag between transaction pendingAck log indexes (keys). It can be used to determine the cleanup frequency of transaction pendingAck logs. Setting a larger lag leads to more consumption of hard disk resources; setting a smaller lag leads to more memory consumption. |500|
+|transactionBufferClientMaxConcurrentRequests|The max concurrent requests for transaction buffer client.|1000|
 |defaultRetentionTimeInMinutes| Default message retention time  |0|
 |defaultRetentionSizeInMB|  Default retention size  |0|
 |keepAliveIntervalSeconds|  How often to check whether the connections are still alive  |30|
@@ -703,7 +707,11 @@ You can set the log level and configuration in the  [log4j2.yaml](https://github
 |replicationConnectionsPerBroker|   |16|
 |replicationProducerQueueSize|    |1000|
 | replicationPolicyCheckDurationSeconds | Duration to check replication policy to avoid replicator inconsistency due to missing ZooKeeper watch. When the value is set to 0, disable checking replication policy. | 600 |
-|transactionBufferClientOperationTimeoutInMills|The transaction buffer client's operation timeout in milliseconds.|3000|
+|transactionCoordinatorEnabled| Whether to enable transaction coordinator in broker.|false|                                                                                                                                                                                                                                                                                                                                                                                                                  [...]
+|transactionMetadataStoreProviderClassName| The class name of transactionMetadataStoreProvider.|org.apache.pulsar.transaction.coordinator.impl.MLTransactionMetadataStoreProvider|
+|transactionBufferClientOperationTimeoutInMills| The transaction buffer client's operation timeout in milliseconds.|3000|
+|transactionBufferSnapshotMaxTransactionCount| Transaction buffer takes a snapshot after the number of transaction operations reaches this value.|1000|
+|transactionBufferSnapshotMinTimeInMillis| The interval between two snapshots that the transaction buffer takes (in milliseconds).|5000|
 |defaultRetentionTimeInMinutes|   |0|
 |defaultRetentionSizeInMB|    |0|
 |keepAliveIntervalSeconds|    |30|