You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@asterixdb.apache.org by im...@apache.org on 2018/05/31 21:43:27 UTC
[02/43] asterixdb git commit: [ASTERIXDB-2347][DOC] Update
Configurable Parameters
[ASTERIXDB-2347][DOC] Update Configurable Parameters
- user model changes: no
- storage format changes: no
- interface changes: no
Details:
- Update added/removed configurable parameters and
fix defaults.
Change-Id: I92c6c1493e8ba5c76671169529653b9141ee748c
Reviewed-on: https://asterix-gerrit.ics.uci.edu/2583
Sonar-Qube: Jenkins <je...@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <je...@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <je...@fulliautomatix.ics.uci.edu>
Contrib: Jenkins <je...@fulliautomatix.ics.uci.edu>
Reviewed-by: Michael Blow <mb...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/asterixdb/repo
Commit: http://git-wip-us.apache.org/repos/asf/asterixdb/commit/ce86b6e8
Tree: http://git-wip-us.apache.org/repos/asf/asterixdb/tree/ce86b6e8
Diff: http://git-wip-us.apache.org/repos/asf/asterixdb/diff/ce86b6e8
Branch: refs/heads/release-0.9.4-pre-rc
Commit: ce86b6e87d80b6d88679e46a94b6d0f2309e31d3
Parents: e20c7ee
Author: Murtadha Hubail <mh...@apache.org>
Authored: Wed Apr 11 07:28:46 2018 +0300
Committer: Murtadha Hubail <mh...@apache.org>
Committed: Wed Apr 11 15:48:38 2018 -0700
----------------------------------------------------------------------
asterixdb/asterix-doc/src/site/markdown/ncservice.md | 9 +++++----
.../apache/hyracks/control/common/controllers/CCConfig.java | 3 ++-
2 files changed, 7 insertions(+), 5 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/asterixdb/blob/ce86b6e8/asterixdb/asterix-doc/src/site/markdown/ncservice.md
----------------------------------------------------------------------
diff --git a/asterixdb/asterix-doc/src/site/markdown/ncservice.md b/asterixdb/asterix-doc/src/site/markdown/ncservice.md
index 1d174e9..d9df232 100644
--- a/asterixdb/asterix-doc/src/site/markdown/ncservice.md
+++ b/asterixdb/asterix-doc/src/site/markdown/ncservice.md
@@ -270,6 +270,7 @@ The following parameters are for the master process, under the "[cc]" section.
| cc | cluster.topology | Sets the XML file that defines the cluster topology | <undefined> |
| cc | console.listen.address | Sets the listen address for the Cluster Controller | same as address |
| cc | console.listen.port | Sets the http port for the Cluster Controller) | 16001 |
+| cc | cores.multiplier | The factor to multiply by the number of cores to determine maximum query concurrent execution level | 3 |
| cc | heartbeat.max.misses | Sets the maximum number of missed heartbeats before a node is marked as dead | 5 |
| cc | heartbeat.period | Sets the time duration between two heartbeats from each node controller in milliseconds | 10000 |
| cc | job.history.size | Limits the number of historical jobs remembered by the system to the specified value | 10 |
@@ -324,13 +325,12 @@ The following parameters for slave processes, under "[nc]" sections.
| nc | result.ttl | Limits the amount of time results for asynchronous jobs should be retained by the system in milliseconds | 86400000 |
| nc | storage.buffercache.maxopenfiles | The maximum number of open files in the buffer cache | 2147483647 |
| nc | storage.buffercache.pagesize | The page size in bytes for pages in the buffer cache | 131072 (128 kB) |
-| nc | storage.buffercache.size | The size of memory allocated to the disk buffer cache. The value should be a multiple of the buffer cache page size. | 715915264 (682.75 MB) |
+| nc | storage.buffercache.size | The size of memory allocated to the disk buffer cache. The value should be a multiple of the buffer cache page size. | 1/4 of the JVM allocated memory |
| nc | storage.lsm.bloomfilter.falsepositiverate | The maximum acceptable false positive rate for bloom filters associated with LSM indexes | 0.01 |
-| nc | storage.memorycomponent.globalbudget | The size of memory allocated to the memory components. The value should be a multiple of the memory component page size | 715915264 (682.75 MB) |
+| nc | storage.memorycomponent.globalbudget | The size of memory allocated to the memory components. The value should be a multiple of the memory component page size | 1/4 of the JVM allocated memory |
| nc | storage.memorycomponent.numcomponents | The number of memory components to be used per lsm index | 2 |
-| nc | storage.memorycomponent.numpages | The number of pages to allocate for a memory component. This budget is shared by all the memory components of the primary index and all its secondary indexes across all I/O devices on a node. Note: in-memory components usually has fill factor of 75% since the pages are 75% full and the remaining 25% is un-utilized | 1/16th of the storage.memorycomponent.globalbudget value |
| nc | storage.memorycomponent.pagesize | The page size in bytes for pages allocated to memory components | 131072 (128 kB) |
-| nc | storage.metadata.memorycomponent.numpages | The number of pages to allocate for a metadata memory component | 1/64th of the storage.memorycomponent.globalbudget value or 256, whichever is larger |
+| nc | storage.metadata.memorycomponent.numpages | The number of pages to allocate for a metadata memory component | 8 |
| nc | storage.subdir | The subdirectory name under each iodevice used for storage | storage |
| nc | txn.log.dir | The directory where transaction logs should be stored | ${java.io.tmpdir}/asterixdb/txn-log |
@@ -360,6 +360,7 @@ The following parameters are configured under the "[common]" section.
| common | replication.log.buffer.pagesize | The size in bytes of each log buffer page | 131072 (128 kB) |
| common | replication.max.remote.recovery.attempts | The maximum number of times to attempt to recover from a replica on failure before giving up | 5 |
| common | replication.timeout | The time in seconds to timeout when trying to contact a replica, before assuming it is dead | 15 |
+| common | storage.max.active.writable.datasets | The maximum number of datasets that can be concurrently modified | 8 |
| common | txn.commitprofiler.enabled | Enable output of commit profiler logs | false |
| common | txn.commitprofiler.reportinterval | Interval (in seconds) to report commit profiler logs | 5 |
| common | txn.job.recovery.memorysize | The memory budget (in bytes) used for recovery | 67108864 (64 MB) |
http://git-wip-us.apache.org/repos/asf/asterixdb/blob/ce86b6e8/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
----------------------------------------------------------------------
diff --git a/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java b/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
index 13e4504..889e140 100644
--- a/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
+++ b/hyracks-fullstack/hyracks/hyracks-control/hyracks-control-common/src/main/java/org/apache/hyracks/control/common/controllers/CCConfig.java
@@ -163,7 +163,8 @@ public class CCConfig extends ControllerConfig {
return "A flag indicating if runtime should enforce frame writer protocol and detect "
+ "bad behaving operators";
case CORES_MULTIPLIER:
- return "Specifies the multiplier to use on the cluster available cores";
+ return "the factor to multiply by the number of cores to determine maximum query concurrent "
+ + "execution level";
case CONTROLLER_ID:
return "The 16-bit (0-65535) id of this Cluster Controller";
default: