You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/10/06 14:10:20 UTC

[jira] [Commented] (HADOOP-13323) Downgrade stack trace on FS load from Warn to debug

    [ https://issues.apache.org/jira/browse/HADOOP-13323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552025#comment-15552025 ] 

Steve Loughran commented on HADOOP-13323:
-----------------------------------------

There's also one other thing to consider: could we somehow isolate things so that we'd know the schema of a failing FS, even before  instantiating teh class. I doubt we could do it with an FS, but I could imagine having a different service of a FS declaration class, which would be much simpler
{code}
class FsDeclaration {
 String getSchema()
 String getFileSystemClassName()
 String getFileContextClassName()
}
{code}

it'd only give the names of the classes, so not needing any transitive classloader problems. Any issues with loading a class become postponed until needed, at which point they fail with a meaningful error, rather than just "unknown schema"

> Downgrade stack trace on FS load from Warn to debug
> ---------------------------------------------------
>
>                 Key: HADOOP-13323
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13323
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 2.7.3
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Minor
>         Attachments: HADOOP-13323-branch-2-001.patch
>
>
> HADOOP-12636 catches exceptions on FS creation, but prints a stack trace @ warn every time..this is noisy and irrelevant if the installation doesn't need connectivity to a specific filesystem or object store.
> I propose: only printing the toString values of the exception chain @ warn; the full stack comes out at debug.
> We could some more tuning: 
> * have a specific log for this exception, which allows installations to turn even the warnings off.
> * add a link to a wiki page listing the dependencies of the shipped filesystems



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org