You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2017/04/13 15:40:42 UTC
[jira] [Commented] (HADOOP-14216) Improve Configuration XML Parsing
Performance
[ https://issues.apache.org/jira/browse/HADOOP-14216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967754#comment-15967754 ]
Steve Loughran commented on HADOOP-14216:
-----------------------------------------
Just tracked this down as the likely cause of my S3A test failures. This is pulling in core-site.xml, which then xincludes auth-keys.xml, which finally references an absolute path, {{file://home/stevel/(secret)/aws-keys.xml}}. This is failing for me even with the latest patch in. Either transient XIncludes aren't being picked up or
{code}
testProviderAbstractClass(org.apache.hadoop.fs.s3a.TestS3AAWSCredentialsProvider) Time elapsed: 0.005 sec <<< ERROR!
java.lang.RuntimeException: java.io.IOException: Fetch fail on include with no fallback while loading 'core-site.xml'
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2831)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2777)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2657)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2545)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1238)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1210)
at org.apache.hadoop.fs.s3a.TestS3AAWSCredentialsProvider.expectProviderInstantiationFailure(TestS3AAWSCredentialsProvider.java:224)
at org.apache.hadoop.fs.s3a.TestS3AAWSCredentialsProvider.testProviderAbstractClass(TestS3AAWSCredentialsProvider.java:60)
{code}
Note also I think the error could be improved. 1. It's in the included file where the problem appears to lie and 2. we should really know the missing entry. Perhaps a wiki link too: I had to read the XInclude spec to work out what was going on here before I could go back to finding the cause
> Improve Configuration XML Parsing Performance
> ---------------------------------------------
>
> Key: HADOOP-14216
> URL: https://issues.apache.org/jira/browse/HADOOP-14216
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Fix For: 2.9.0, 3.0.0-alpha3
>
> Attachments: HADOOP-14216.1.patch, HADOOP-14216.2-branch-2.patch, HADOOP-14216.2.patch, HADOOP-14216.addendum.1.patch
>
>
> JIRA is to improve XML parsing performance through reuse and a change in XML parser (STAX)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org