You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2017/03/02 11:07:45 UTC
[jira] [Created] (HADOOP-14138) Remove S3A ref from META-INF
service discovery, rely on existing core-default entry
Steve Loughran created HADOOP-14138:
---------------------------------------
Summary: Remove S3A ref from META-INF service discovery, rely on existing core-default entry
Key: HADOOP-14138
URL: https://issues.apache.org/jira/browse/HADOOP-14138
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3
Affects Versions: 2.9.0
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Critical
As discussed in HADOOP-14132, the shaded AWS library is killing performance starting all hadoop operations, due to classloading on FS service discovery.
This is despite the fact that there is an entry for fs.s3a.impl in core-default.xml, *we don't need service discovery here*
Proposed:
# cut the entry from {/hadoop-aws/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem}}
# when HADOOP-14132 is in, move to that, including declaring an XML file exclusively for s3a entries
I want this one in first as its a major performance regression, and one we coula actually backport to 2.7.x, just to improve load time slightly there too
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org