You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by cn...@apache.org on 2016/03/01 22:30:37 UTC
[1/3] hadoop git commit: HADOOP-12853. Change WASB documentation
regarding page blob support. Contributed by Madhumita Chakraborty.
Repository: hadoop
Updated Branches:
refs/heads/branch-2 023c2d2e5 -> bce33b517
refs/heads/branch-2.8 c50f79d83 -> f563c5353
refs/heads/trunk 5c465df90 -> f98dff329
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f98dff32
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f98dff32
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f98dff32
Branch: refs/heads/trunk
Commit: f98dff329b1f94c9f53022baf0209fc1a7aaf7c2
Parents: 5c465df
Author: Chris Nauroth <cn...@apache.org>
Authored: Tue Mar 1 13:18:42 2016 -0800
Committer: Chris Nauroth <cn...@apache.org>
Committed: Tue Mar 1 13:18:42 2016 -0800
----------------------------------------------------------------------
hadoop-common-project/hadoop-common/CHANGES.txt | 3 +++
hadoop-tools/hadoop-azure/src/site/markdown/index.md | 6 +++---
2 files changed, 6 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f98dff32/hadoop-common-project/hadoop-common/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt
index b3413cc..401df94 100644
--- a/hadoop-common-project/hadoop-common/CHANGES.txt
+++ b/hadoop-common-project/hadoop-common/CHANGES.txt
@@ -1218,6 +1218,9 @@ Release 2.8.0 - UNRELEASED
HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly
and non-directly buffer cases. (szetszwo)
+ HADOOP-12853. Change WASB documentation regarding page blob support.
+ (Madhumita Chakraborty via cnauroth)
+
BUG FIXES
HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f98dff32/hadoop-tools/hadoop-azure/src/site/markdown/index.md
----------------------------------------------------------------------
diff --git a/hadoop-tools/hadoop-azure/src/site/markdown/index.md b/hadoop-tools/hadoop-azure/src/site/markdown/index.md
index d231f22..a4a7615 100644
--- a/hadoop-tools/hadoop-azure/src/site/markdown/index.md
+++ b/hadoop-tools/hadoop-azure/src/site/markdown/index.md
@@ -40,8 +40,8 @@ on the additional artifacts it requires, notably the
* Present a hierarchical file system view by implementing the standard Hadoop
[`FileSystem`](../api/org/apache/hadoop/fs/FileSystem.html) interface.
* Supports configuration of multiple Azure Blob Storage accounts.
-* Supports both page blobs (suitable for most use cases, such as MapReduce) and
- block blobs (suitable for continuous write use cases, such as an HBase
+* Supports both block blobs (suitable for most use cases, such as MapReduce) and
+ page blobs (suitable for continuous write use cases, such as an HBase
write-ahead log).
* Reference file system paths using URLs using the `wasb` scheme.
* Also reference file system paths using URLs with the `wasbs` scheme for SSL
@@ -168,9 +168,9 @@ can be written any number of times, whereas block blobs can only be appended to
work for HBase logs, so page blob support was introduced to overcome this
limitation.
-Page blobs can be used for other purposes beyond just HBase log files though.
Page blobs can be up to 1TB in size, larger than the maximum 200GB size for block
blobs.
+You should stick to block blobs for most usage, and page blobs are only tested in context of HBase write-ahead logs.
In order to have the files you create be page blobs, you must set the
configuration variable `fs.azure.page.blob.dir` to a comma-separated list of
[2/3] hadoop git commit: HADOOP-12853. Change WASB documentation
regarding page blob support. Contributed by Madhumita Chakraborty.
Posted by cn...@apache.org.
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/bce33b51
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/bce33b51
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/bce33b51
Branch: refs/heads/branch-2
Commit: bce33b51790b90f0655e36df3a0394f5691f8d6e
Parents: 023c2d2
Author: Chris Nauroth <cn...@apache.org>
Authored: Tue Mar 1 13:18:42 2016 -0800
Committer: Chris Nauroth <cn...@apache.org>
Committed: Tue Mar 1 13:18:57 2016 -0800
----------------------------------------------------------------------
hadoop-common-project/hadoop-common/CHANGES.txt | 3 +++
hadoop-tools/hadoop-azure/src/site/markdown/index.md | 6 +++---
2 files changed, 6 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bce33b51/hadoop-common-project/hadoop-common/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt
index 300414b..97cd13d 100644
--- a/hadoop-common-project/hadoop-common/CHANGES.txt
+++ b/hadoop-common-project/hadoop-common/CHANGES.txt
@@ -567,6 +567,9 @@ Release 2.8.0 - UNRELEASED
HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly
and non-directly buffer cases. (szetszwo)
+ HADOOP-12853. Change WASB documentation regarding page blob support.
+ (Madhumita Chakraborty via cnauroth)
+
BUG FIXES
HADOOP-12617. SPNEGO authentication request to non-default realm gets
http://git-wip-us.apache.org/repos/asf/hadoop/blob/bce33b51/hadoop-tools/hadoop-azure/src/site/markdown/index.md
----------------------------------------------------------------------
diff --git a/hadoop-tools/hadoop-azure/src/site/markdown/index.md b/hadoop-tools/hadoop-azure/src/site/markdown/index.md
index d231f22..a4a7615 100644
--- a/hadoop-tools/hadoop-azure/src/site/markdown/index.md
+++ b/hadoop-tools/hadoop-azure/src/site/markdown/index.md
@@ -40,8 +40,8 @@ on the additional artifacts it requires, notably the
* Present a hierarchical file system view by implementing the standard Hadoop
[`FileSystem`](../api/org/apache/hadoop/fs/FileSystem.html) interface.
* Supports configuration of multiple Azure Blob Storage accounts.
-* Supports both page blobs (suitable for most use cases, such as MapReduce) and
- block blobs (suitable for continuous write use cases, such as an HBase
+* Supports both block blobs (suitable for most use cases, such as MapReduce) and
+ page blobs (suitable for continuous write use cases, such as an HBase
write-ahead log).
* Reference file system paths using URLs using the `wasb` scheme.
* Also reference file system paths using URLs with the `wasbs` scheme for SSL
@@ -168,9 +168,9 @@ can be written any number of times, whereas block blobs can only be appended to
work for HBase logs, so page blob support was introduced to overcome this
limitation.
-Page blobs can be used for other purposes beyond just HBase log files though.
Page blobs can be up to 1TB in size, larger than the maximum 200GB size for block
blobs.
+You should stick to block blobs for most usage, and page blobs are only tested in context of HBase write-ahead logs.
In order to have the files you create be page blobs, you must set the
configuration variable `fs.azure.page.blob.dir` to a comma-separated list of
[3/3] hadoop git commit: HADOOP-12853. Change WASB documentation
regarding page blob support. Contributed by Madhumita Chakraborty.
Posted by cn...@apache.org.
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)
(cherry picked from commit bce33b51790b90f0655e36df3a0394f5691f8d6e)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/f563c535
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/f563c535
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/f563c535
Branch: refs/heads/branch-2.8
Commit: f563c53535a7d89f594d26e7dcdacb85bdad36ef
Parents: c50f79d
Author: Chris Nauroth <cn...@apache.org>
Authored: Tue Mar 1 13:18:42 2016 -0800
Committer: Chris Nauroth <cn...@apache.org>
Committed: Tue Mar 1 13:19:03 2016 -0800
----------------------------------------------------------------------
hadoop-common-project/hadoop-common/CHANGES.txt | 3 +++
hadoop-tools/hadoop-azure/src/site/markdown/index.md | 6 +++---
2 files changed, 6 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f563c535/hadoop-common-project/hadoop-common/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt
index a9a796e..b3b29d6 100644
--- a/hadoop-common-project/hadoop-common/CHANGES.txt
+++ b/hadoop-common-project/hadoop-common/CHANGES.txt
@@ -490,6 +490,9 @@ Release 2.8.0 - UNRELEASED
HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly
and non-directly buffer cases. (szetszwo)
+ HADOOP-12853. Change WASB documentation regarding page blob support.
+ (Madhumita Chakraborty via cnauroth)
+
BUG FIXES
HADOOP-12617. SPNEGO authentication request to non-default realm gets
http://git-wip-us.apache.org/repos/asf/hadoop/blob/f563c535/hadoop-tools/hadoop-azure/src/site/markdown/index.md
----------------------------------------------------------------------
diff --git a/hadoop-tools/hadoop-azure/src/site/markdown/index.md b/hadoop-tools/hadoop-azure/src/site/markdown/index.md
index d231f22..a4a7615 100644
--- a/hadoop-tools/hadoop-azure/src/site/markdown/index.md
+++ b/hadoop-tools/hadoop-azure/src/site/markdown/index.md
@@ -40,8 +40,8 @@ on the additional artifacts it requires, notably the
* Present a hierarchical file system view by implementing the standard Hadoop
[`FileSystem`](../api/org/apache/hadoop/fs/FileSystem.html) interface.
* Supports configuration of multiple Azure Blob Storage accounts.
-* Supports both page blobs (suitable for most use cases, such as MapReduce) and
- block blobs (suitable for continuous write use cases, such as an HBase
+* Supports both block blobs (suitable for most use cases, such as MapReduce) and
+ page blobs (suitable for continuous write use cases, such as an HBase
write-ahead log).
* Reference file system paths using URLs using the `wasb` scheme.
* Also reference file system paths using URLs with the `wasbs` scheme for SSL
@@ -168,9 +168,9 @@ can be written any number of times, whereas block blobs can only be appended to
work for HBase logs, so page blob support was introduced to overcome this
limitation.
-Page blobs can be used for other purposes beyond just HBase log files though.
Page blobs can be up to 1TB in size, larger than the maximum 200GB size for block
blobs.
+You should stick to block blobs for most usage, and page blobs are only tested in context of HBase write-ahead logs.
In order to have the files you create be page blobs, you must set the
configuration variable `fs.azure.page.blob.dir` to a comma-separated list of