You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Chad Metcalf (JIRA)" <ji...@apache.org> on 2009/12/17 22:54:18 UTC
[jira] Created: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
--------------------------------------------------------------------
Key: HADOOP-6453
URL: https://issues.apache.org/jira/browse/HADOOP-6453
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.20.1
Reporter: Chad Metcalf
Priority: Minor
Fix For: 0.20.2
Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
JAVA_LIBRARY_PATH=''
This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Kevin Weil (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792187#action_12792187 ]
Kevin Weil commented on HADOOP-6453:
------------------------------------
We (Twitter) would love to see this patch committed -- I should have submitted it 6 months ago. Our deploy process currently involves updating to a new version and then manually commenting out the line that empties the JAVA_LIBRARY_PATH environment variable (i.e. an inferior version of applying Chad's patch). We want to set JAVA_LIBRARY_PATH in hadoop-env.sh and have it used elsewhere, which this patch makes possible.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902032#action_12902032 ]
Hudson commented on HADOOP-6453:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #364 (See [https://hudson.apache.org/hudson/job/Hadoop-Common-trunk-Commit/364/])
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792165#action_12792165 ]
Chad Metcalf commented on HADOOP-6453:
--------------------------------------
Clarification this is a 0.20.x only patch. I didn't find any JAVA_LIBRARY_PATH in trunk so I'm guessing its been obsoleted?
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453v1.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Status: In Progress (was: Patch Available)
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: HADOOP-6453-0.20v2.patch
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794894#action_12794894 ]
Chad Metcalf commented on HADOOP-6453:
--------------------------------------
No test included for change to wrapper script.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12901822#action_12901822 ]
Hudson commented on HADOOP-6453:
--------------------------------
Integrated in Hadoop-Common-trunk #432 (See [https://hudson.apache.org/hudson/job/Hadoop-Common-trunk/432/])
HADOOP-6453. Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH. Contributed by Chad Metcalf.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795051#action_12795051 ]
Steve Loughran commented on HADOOP-6453:
----------------------------------------
I should add that it's script patches that have the greatest cost/line in Ant; we dropped support for win9x not because java didn't work on it, but the .BAT syntax was weaker and we couldn't face debugging it. Windows + Cygwin is equally trouble, so before any patch goes in we really need to think about how to test on that platform.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Status: Patch Available (was: In Progress)
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Kevin Weil (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798619#action_12798619 ]
Kevin Weil commented on HADOOP-6453:
------------------------------------
So are we good to go on this, or are there any more modifications desired? We're happy with the current patch FWIW.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: (was: HADOOP-6453v1.patch)
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: HADOOP-6453-trunkv3.patch
Thanks
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: HADOOP-6453.trunk.patch
Its been a long week. This moved to hadoop-config in a post split world. This problem exists in trunk and 20.x.
There are no tests, its a wrapper script. Doesn't change the default behavior except for the unlikely case where people were setting JAVA_LIBRARY_PATH and it was getting stomped on and when its no longer stomped on they'll break. Very unlikely case.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795044#action_12795044 ]
Steve Loughran commented on HADOOP-6453:
----------------------------------------
I don't use the startup scripts, so it doesn't have any effect to me, but I see the benefit for anyone who has native libs they do want in the runtime.
# There is a risk that this will break things, namely any system that has a JAVA_LIBRARY_PATH env variable set to something that is incompatible with HADOOP. This is the usual badly-configured CLASSPATH problem, the reason a lot of java launcher scripts either ignore that env variable completely, or provide some way to disable it (e.g. Ant's -noclasspath option)
# Even if there is no automated test, someone needs to manually check that if the existing value of JAVA_LIBRARY_PATH is set to something with spaces in, such as c:\Program Files\some application\ then everything still propagates correctly. As usual, Cygwin will be the troublespot here.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12901493#action_12901493 ]
Jakob Homan commented on HADOOP-6453:
-------------------------------------
Hudson has completely disappeared and test-patch was already run on a prior version of this patch, so I'm going to go ahead and commit this as-is.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: (was: HADOOP-6453-trunkv3.patch)
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795088#action_12795088 ]
Chad Metcalf commented on HADOOP-6453:
--------------------------------------
Added:
{code}
JAVA_LIBRARY_PATH=`cygpath -p -w "$JAVA_LIBRARY_PATH"`
{code}
For trunk and 0.20 in the appropriate places. This now receives the same level of protection that {{CLASSPATH}} does. As I acknowledged above there is indeed a possibility that a user will have a broken {{JAVA_LIBRARY_PATH}} and this will break for them. That possibility is slim. A quick google of {{JAVA_LIBRARY_PATH}} brings this jira up as #5 which indicates its a significantly less common env then {{CLASSPATH}}. Regardless the possibility exists.
With the cygpath fix above this change makes every reasonable effort to protect cygwin users. Which places them in the same boat as all the other bash users (Linux, Mac, Solaris, etc). If you have a broken env there is nothing I can do. It would the same if you had a broken {{CLASSPATH}}. As with all possibly breaking changes there is a trade off between the users that need the functionality and the users it will break.
Users that need to get native libraries in as it stands have to hack the wrapper. This is tedious and error prone over setting a env. And its not immediately obvious that its what you have to do. The wrapper script respects {{CLASSPATH}} logically it should respect others. And its not documented that if you want to do this, oh by the way you have to hack this.
I'm all for testing. But the risk here is broken user env's which is not something in the scope of this jira to address. We can test the patch and add a release note so that if it breaks someone they can read that this was changed. If people are really that worried about it we can add:
{code}
echo "Existing JAVA_LIBRARY_PATH detected, if things are breaking please check this first."
{code}
But most likely that will just send someone who breaks for a different reason off on a 5 minute wild goose chase.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: HADOOP-6453-0.20.patch
0.20.x version
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jakob Homan updated HADOOP-6453:
--------------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
I've committed this. Resolving as fixed. Thanks, Chad!
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf reassigned HADOOP-6453:
------------------------------------
Assignee: Chad Metcalf
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: HADOOP-6453-trunkv3.patch
Thanks.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jakob Homan updated HADOOP-6453:
--------------------------------
Hadoop Flags: [Incompatible change, Reviewed] (was: [Incompatible change])
Component/s: scripts
+1
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: HADOOP-6453-trunkv2.patch
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Status: Patch Available (was: Open)
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453v1.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Attachment: HADOOP-6453v1.patch
Low risk patch. Doesn't actually change the default behavior of the wrapper script. It just allows users to pass in additional libs in the path.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453v1.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Affects Version/s: (was: 0.20.1)
0.22.0
0.21.0
0.20.2
Fix Version/s: 0.22.0
0.21.0
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795100#action_12795100 ]
Steve Loughran commented on HADOOP-6453:
----------------------------------------
I agree, handling broken env variables is a losing battle. They can break it in so many ways that it's impossible to fix; the classic enemy is the quotation marks halfway through PATH; this screws up the quote logic and your scripts don't stand a chance, not in anything vaguely cross platform. Perl or Python entry scripts, that's a different story.
For bash, the cygpath patch should be enough.
I've been thinking about how to test this. TestCLI can be used to run stuff on the command line, all we need is a hadoop diagnostics command whose output includes all the env variables. If JAVA_LIBRARY_PATH is then set to values with and without a space in in different test cases (that will be the tricky bit; may need some extensions to the cli execution), the test could look for the value in the output. I will file that as a separate feature.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792163#action_12792163 ]
Hadoop QA commented on HADOOP-6453:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12428348/HADOOP-6453v1.patch
against trunk revision 891511.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-h4.grid.sp2.yahoo.net/217/console
This message is automatically generated.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453v1.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-6453:
----------------------------------
Fix Version/s: (was: 0.22.0)
(was: 0.20.2)
(was: 0.21.0)
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794893#action_12794893 ]
Hadoop QA commented on HADOOP-6453:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12428360/HADOOP-6453.trunk.patch
against trunk revision 893666.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-h4.grid.sp2.yahoo.net/243/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-h4.grid.sp2.yahoo.net/243/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-h4.grid.sp2.yahoo.net/243/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch-h4.grid.sp2.yahoo.net/243/console
This message is automatically generated.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795656#action_12795656 ]
Chad Metcalf commented on HADOOP-6453:
--------------------------------------
Confused as to the remaining open actions on this JIRA. What more needs to be done?
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796016#action_12796016 ]
Steve Loughran commented on HADOOP-6453:
----------------------------------------
I think its OK as is, we just need to (currently manually) check that things work on cygwin. To automate a command line check needs the cli tester to excec the shell scripts, which it doesnt (yet), or use some other testrunner -antunit is the obvious choice-
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Chad Metcalf (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chad Metcalf updated HADOOP-6453:
---------------------------------
Status: Patch Available (was: Open)
Hadoop Flags: [Incompatible change]
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453-trunkv3.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-6453) Hadoop wrapper script shouldn't
ignore an existing JAVA_LIBRARY_PATH
Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jakob Homan updated HADOOP-6453:
--------------------------------
Status: Open (was: Patch Available)
Fix Version/s: 0.22.0
The trunk patch has unfortunately gone stale. However, this seems like a good change to make with essentially no risk. This will treat JAVA_LIBRARY_PATH consistently with JAVA_HOME, and can be marked as incompatible change. cygwin should be fine. Chad, can you please spin up a new patch and, barring any objections, I'll review and commit it.
> Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH
> --------------------------------------------------------------------
>
> Key: HADOOP-6453
> URL: https://issues.apache.org/jira/browse/HADOOP-6453
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Chad Metcalf
> Assignee: Chad Metcalf
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: HADOOP-6453-0.20.patch, HADOOP-6453-0.20v2.patch, HADOOP-6453-trunkv2.patch, HADOOP-6453.trunk.patch
>
>
> Currently the hadoop wrapper script assumes its the only place that uses JAVA_LIBRARY_PATH and initializes it to a blank line.
> JAVA_LIBRARY_PATH=''
> This prevents anyone from setting this outside of the hadoop wrapper (say hadoop-config.sh) for their own native libraries.
> The fix is pretty simple. Don't initialize it to '' and append the native libs like normal.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.