You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "John Gordon (JIRA)" <ji...@apache.org> on 2012/06/26 01:57:44 UTC
[jira] [Updated] (MAPREDUCE-4368) TaskRunner fails to start jars
when the java.library.path contains a quoted path with embedded spaces
[ https://issues.apache.org/jira/browse/MAPREDUCE-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Gordon updated MAPREDUCE-4368:
-----------------------------------
Fix Version/s: (was: 1-win)
Labels: patch (was: )
Target Version/s: 1-win
Status: Patch Available (was: Open)
Remove embedded quotes specifically for java.library.path and refactor double for loop to reduce overhead.
> TaskRunner fails to start jars when the java.library.path contains a quoted path with embedded spaces
> -----------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4368
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4368
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 1-win
> Environment: on Windows:
> set PATH=%PATH%;"C:\this memorable place".
> Reporter: John Gordon
> Labels: patch
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> TaskRunner splits arguments by space before it adds them back to the vargs list, so it loses all context of quote escaped strings with embedded spaces. This gets fixed up later by wrapping all arguments with " -- so you get something like java "-D<opt>=<value>". This is problematic for paths with embedded spaces, where we end up creating "-D<opt>=<first part" "last part>". To java, the jar being run is last part. So with the environment above, you will see "ClassNoDefFoundError: memorable" and the jar will fail to start. In this particular case, we know that java.libarary.path contains paths and the tests often use %PATH% to seed this, so the fix is to remove embedded quotes in listed path elements because we know the aggregate will be quoted when the JVM is started.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira