You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by br...@apache.org on 2017/05/24 15:48:12 UTC
[1/2] hadoop git commit: HDFS-11849. JournalNode startup failure
exception should be logged in log file. Contributed By Surendra Singh
Lilhore.
Repository: hadoop
Updated Branches:
refs/heads/branch-2.8 94a80974d -> 462c6fb5b
HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore.
(cherry picked from commit 9cab42cc797986081fef184748044f1790a4f039)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a7f06357
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a7f06357
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/a7f06357
Branch: refs/heads/branch-2.8
Commit: a7f063576cbb557176f64b2b1ae816f54876144f
Parents: 94a8097
Author: Brahma Reddy Battula <br...@apache.org>
Authored: Tue May 23 02:39:19 2017 +0800
Committer: Brahma Reddy Battula <br...@apache.org>
Committed: Wed May 24 23:45:57 2017 +0800
----------------------------------------------------------------------
.../org/apache/hadoop/hdfs/qjournal/server/JournalNode.java | 9 ++++++++-
1 file changed, 8 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/a7f06357/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalNode.java
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalNode.java b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalNode.java
index 39a8034..5caccf7 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalNode.java
+++ b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/qjournal/server/JournalNode.java
@@ -17,6 +17,8 @@
*/
package org.apache.hadoop.hdfs.qjournal.server;
+import static org.apache.hadoop.util.ExitUtil.terminate;
+
import java.io.File;
import java.io.FileFilter;
import java.io.IOException;
@@ -307,7 +309,12 @@ public class JournalNode implements Tool, Configurable, JournalNodeMXBean {
public static void main(String[] args) throws Exception {
StringUtils.startupShutdownMessage(JournalNode.class, args, LOG);
- System.exit(ToolRunner.run(new JournalNode(), args));
+ try {
+ System.exit(ToolRunner.run(new JournalNode(), args));
+ } catch (Throwable e) {
+ LOG.error("Failed to start journalnode.", e);
+ terminate(-1, e);
+ }
}
public void discardSegments(String journalId, long startTxId)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org
[2/2] hadoop git commit: HDFS-11864. Document Metrics to track usage
of memory for writes. Contributed by Yiqun Lin.
Posted by br...@apache.org.
HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
(cherry picked from commit 52661e0912a79d1e851afc2b46c941ce952ca63f)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/462c6fb5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/462c6fb5
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/462c6fb5
Branch: refs/heads/branch-2.8
Commit: 462c6fb5b1ea9faf670096e1eae7bccd8670def8
Parents: a7f0635
Author: Brahma Reddy Battula <br...@apache.org>
Authored: Tue May 23 23:52:42 2017 +0800
Committer: Brahma Reddy Battula <br...@apache.org>
Committed: Wed May 24 23:47:20 2017 +0800
----------------------------------------------------------------------
.../hadoop-common/src/site/markdown/Metrics.md | 15 +++++++++++++++
1 file changed, 15 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/462c6fb5/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
index 8294e80..85adfdc 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
@@ -284,6 +284,21 @@ Each metrics record contains tags such as SessionId and Hostname as additional i
| `WritesFromLocalClient` | Total number of write operations from local client |
| `WritesFromRemoteClient` | Total number of write operations from remote client |
| `BlocksGetLocalPathInfo` | Total number of operations to get local path names of blocks |
+| `RamDiskBlocksWrite` | Total number of blocks written to memory |
+| `RamDiskBlocksWriteFallback` | Total number of blocks written to memory but not satisfied (failed-over to disk) |
+| `RamDiskBytesWrite` | Total number of bytes written to memory |
+| `RamDiskBlocksReadHits` | Total number of times a block in memory was read |
+| `RamDiskBlocksEvicted` | Total number of blocks evicted in memory |
+| `RamDiskBlocksEvictedWithoutRead` | Total number of blocks evicted in memory without ever being read from memory |
+| `RamDiskBlocksEvictionWindowMsNumOps` | Number of blocks evicted in memory|
+| `RamDiskBlocksEvictionWindowMsAvgTime` | Average time of blocks in memory before being evicted in milliseconds |
+| `RamDiskBlocksEvictionWindows`*num*`s(50|75|90|95|99)thPercentileLatency` | The 50/75/90/95/99th percentile of latency between memory write and eviction in milliseconds. Percentile measurement is off by default, by watching no intervals. The intervals are specified by `dfs.metrics.percentiles.intervals`. |
+| `RamDiskBlocksLazyPersisted` | Total number of blocks written to disk by lazy writer |
+| `RamDiskBlocksDeletedBeforeLazyPersisted` | Total number of blocks deleted by application before being persisted to disk |
+| `RamDiskBytesLazyPersisted` | Total number of bytes written to disk by lazy writer |
+| `RamDiskBlocksLazyPersistWindowMsNumOps` | Number of blocks written to disk by lazy writer |
+| `RamDiskBlocksLazyPersistWindowMsAvgTime` | Average time of blocks written to disk by lazy writer in milliseconds |
+| `RamDiskBlocksLazyPersistWindows`*num*`s(50|75|90|95|99)thPercentileLatency` | The 50/75/90/95/99th percentile of latency between memory write and disk persist in milliseconds. Percentile measurement is off by default, by watching no intervals. The intervals are specified by `dfs.metrics.percentiles.intervals`. |
| `FsyncCount` | Total number of fsync |
| `VolumeFailures` | Total number of volume failures occurred |
| `ReadBlockOpNumOps` | Total number of read operations |
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org