You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by st...@apache.org on 2021/09/15 21:27:54 UTC
[hadoop] branch trunk updated (43f0a34 -> 52c024c)
This is an automated email from the ASF dual-hosted git repository.
stevel pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from 43f0a34 YARN-10935. AM Total Queue Limit goes below per-user AM Limit if parent is full. Contributed by Eric Payne.
add 52c024c HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS (#3406)
No new revisions were added by this update.
Summary of changes:
.../apache/hadoop/fs/CommonConfigurationKeys.java | 5 +
.../hadoop/fs/statistics/StreamStatisticNames.java | 12 +
.../store/BlockUploadStatistics.java} | 16 +-
.../org/apache/hadoop/fs/store/DataBlocks.java | 411 ++++++++++++------
.../src/main/resources/core-default.xml | 7 +
.../org/apache/hadoop/fs/store/TestDataBlocks.java | 138 ++++++
.../hadoop/fs/azurebfs/AzureBlobFileSystem.java | 42 +-
.../fs/azurebfs/AzureBlobFileSystemStore.java | 165 ++++++--
.../fs/azurebfs/constants/ConfigurationKeys.java | 31 ++
.../constants/FileSystemConfigurations.java | 18 +
.../fs/azurebfs/services/AbfsOutputStream.java | 469 ++++++++++++---------
.../azurebfs/services/AbfsOutputStreamContext.java | 107 +++++
.../services/AbfsOutputStreamStatistics.java | 4 +-
.../services/AbfsOutputStreamStatisticsImpl.java | 25 +-
.../fs/azure/integration/AzureTestConstants.java | 13 +
.../fs/azurebfs/AbstractAbfsIntegrationTest.java | 2 +-
.../hadoop/fs/azurebfs/AbstractAbfsScaleTest.java | 17 +-
.../hadoop/fs/azurebfs/ITestAbfsHugeFiles.java | 97 +++++
.../fs/azurebfs/ITestAzureBlobFileSystemLease.java | 8 +-
.../fs/azurebfs/services/TestAbfsOutputStream.java | 176 ++++++--
20 files changed, 1354 insertions(+), 409 deletions(-)
copy hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/{metrics2/MetricType.java => fs/store/BlockUploadStatistics.java} (80%)
copy hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ADataBlocks.java => hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/store/DataBlocks.java (67%)
create mode 100644 hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/store/TestDataBlocks.java
create mode 100644 hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsHugeFiles.java
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org