[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

["Steve Loughran (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807181#comment-17807181 ] 

Steve Loughran commented on HADOOP-19039:
-----------------------------------------

+ java17 support
+ where the logging is right now. This is the first Log4j 2 release.
+ what have we cut?

Here is some markdown text regarding S3A changes.

------

This release of Hadoop moves the S3A connector to Amazon S3 to the V2 SDK. This is a significant change which offers a number of new features including the ability to work with Amazon S3 Express One Zone Storage -the new high performance, single AZ storage class. Inevitably, there will be some surprises -there is ongoing work to address some performance regressions and resilience to network problems.
* There is documentation on how to migrate to the new SDK -there is explicit support for moving V1 credential provider implementations; everything else will need rework.
* There is also documentation on the third-party S3 store support; the SDK's focus on having coolers specify the AWS region rather than the S3 Service and point complicates migration. We have successfully tested it against Dell ECS S3 and Google GS Storage -validation with other "S3 compatible" stores would be very much appreciated.n
* If you encounter issues, please look for HADOOP JIRA entries on the same topic -and if there are none create a new issues under [HADOOP-18886](https://issues.apache.org/jira/browse/HADOOP-18886) _S3A: AWS SDK V2 Migration: stabilization and S3Express_. We will try to Address these as soon as they have been identified.

-------


> Hadoop 3.4.0 Highlight big features and improvements.
> -----------------------------------------------------
>
>                 Key: HADOOP-19039
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19039
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: common
>    Affects Versions: 3.4.0
>            Reporter: Shilun Fan
>            Assignee: Shilun Fan
>            Priority: Major
>
> While preparing for the release of Hadoop-3.4.0, I've noticed the inclusion of numerous commits in this version.  Therefore, highlighting significant features and improvements becomes crucial.  I've completed the initial version and now seek the review of more experienced partner to ensure the finalization of the version's highlights.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org