You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by sa...@apache.org on 2023/03/28 06:27:13 UTC
[hadoop] branch trunk updated (926993cb73f -> b5e8269d9b4)
This is an automated email from the ASF dual-hosted git repository.
sammichen pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
from 926993cb73f YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation. (#5496)
add b5e8269d9b4 HADOOP-18458: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS (#4912)
No new revisions were added by this update.
Summary of changes:
.../fs/aliyun/oss/AliyunOSSBlockOutputStream.java | 213 +++++++----
.../hadoop/fs/aliyun/oss/AliyunOSSFileSystem.java | 33 +-
.../fs/aliyun/oss/AliyunOSSFileSystemStore.java | 63 +++-
.../org/apache/hadoop/fs/aliyun/oss/Constants.java | 53 +++
.../hadoop/fs/aliyun/oss/OSSDataBlocks.java} | 417 ++++++++++++++-------
.../statistics/BlockOutputStreamStatistics.java | 50 ++-
.../statistics/impl/OutputStreamStatistics.java | 98 +++++
.../aliyun/oss/statistics/impl}/package-info.java | 9 +-
.../fs/aliyun/oss/statistics}/package-info.java | 4 +-
.../src/site/markdown/tools/hadoop-aliyun/index.md | 50 ++-
.../aliyun/oss/TestAliyunOSSBlockOutputStream.java | 193 +++++++++-
11 files changed, 917 insertions(+), 266 deletions(-)
copy hadoop-tools/{hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ADataBlocks.java => hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/OSSDataBlocks.java} (72%)
copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/ContainerUpdateType.java => hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/statistics/BlockOutputStreamStatistics.java (54%)
create mode 100644 hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/statistics/impl/OutputStreamStatistics.java
copy {hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/codec => hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/statistics/impl}/package-info.java (79%)
copy {hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/util => hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/statistics}/package-info.java (84%)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org