You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Roman Shaposhnik (Created) (JIRA)" <ji...@apache.org> on 2012/02/01 01:22:56 UTC
[jira] [Created] (HADOOP-8010) hadoop-config.sh spews error message
when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
-------------------------------------------------------------------------------------------------------------
Key: HADOOP-8010
URL: https://issues.apache.org/jira/browse/HADOOP-8010
Project: Hadoop Common
Issue Type: Bug
Components: scripts
Affects Versions: 1.0.0
Reporter: Roman Shaposhnik
Assignee: Roman Shaposhnik
Priority: Minor
Fix For: 1.0.1
Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
{noformat}
[: 76: true: unexpected operator
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8010) hadoop-config.sh spews error message
when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
Posted by "Matt Foley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated HADOOP-8010:
-------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed to branch-1 and branch-1.0.
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198015#comment-13198015 ]
Roman Shaposhnik commented on HADOOP-8010:
------------------------------------------
@Matt, thank a lot for committing it!
@Eli, the difference between hadoop-config.sh and everything else is that hadoop-config.sh doesn't control which scripts are sourcing it (it is meant to be sourced not executed) and thus needs to be as POSIX compliant as possible. The rest of the scripts where '==' is used in Hadoop 1.0 branch are all specifying #!/usr/bin/env bash so there's no issue.
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197558#comment-13197558 ]
Eli Collins commented on HADOOP-8010:
-------------------------------------
I think this is because you're using sh (or dash) instead of bash. In bash "=" and "==" are equivalent.
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8010) hadoop-config.sh spews error message
when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated HADOOP-8010:
-------------------------------------
Attachment: HADOOP-8010.patch.txt
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Matt Foley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197671#comment-13197671 ]
Matt Foley commented on HADOOP-8010:
------------------------------------
+1 for code review. Frankly I'm not clear why the previous version had this error on some systems, and I can't reproduce it on my RHEL box. But the proposed patch brings the boolean test into POSIX conformance and is certainly acceptable.
Committing to 1.0.1 at Roman's request.
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197431#comment-13197431 ]
Hadoop QA commented on HADOOP-8010:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12512701/HADOOP-8010.patch.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/552//console
This message is automatically generated.
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8010) hadoop-config.sh spews error message
when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated HADOOP-8010:
-------------------------------------
Status: Patch Available (was: Open)
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198044#comment-13198044 ]
Eli Collins commented on HADOOP-8010:
-------------------------------------
Right, but both the daemons explicitly specify bash before sourcing hadoop-config.sh, so how are they triggering this?
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197561#comment-13197561 ]
Eli Collins commented on HADOOP-8010:
-------------------------------------
Adding env bash to hadoop-config.sh should fix this but given that the scripts that source hadoop-config.sh explicitly use env bash this shouldn't be necessary.
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198002#comment-13198002 ]
Eli Collins commented on HADOOP-8010:
-------------------------------------
We use "==" elsewhere in bin/hadoop* shouldn't those be fixed as well then?
I think there's another bug lurking here, == is obviously correct in bash.
{noformat}
hadoop-branch-1 $ bash bin/hadoop-config.sh
hadoop-branch-1 $ dash bin/hadoop-config.sh
[: 76: unexpected operator
hadoop-branch-1 $
{noformat}
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198163#comment-13198163 ]
Eli Collins commented on HADOOP-8010:
-------------------------------------
The change is fine by me, I'm just trying to understand it.
The bug is that running the hadoop daemon commands hits this error, but given that the error should only hit when not using bash, and the hadoop daemons explicitly use bash, I suspect there's something else going on here. Eg is this because bash is a symlink to dash on debian?
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HADOOP-8010) hadoop-config.sh spews error message
when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
Posted by "Matt Foley (Closed) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley closed HADOOP-8010.
------------------------------
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8010) hadoop-config.sh spews error
message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is
present
Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198121#comment-13198121 ]
Roman Shaposhnik commented on HADOOP-8010:
------------------------------------------
hadoop daemon scripts are not the only thing that sources hadoop-config.sh
Of course, one can argue that it doesn't constitute a stable API and hence shouldn't be sourced outside of Hadoop tree. That said, in this particular case it was easier to keep hadoop-config.sh free from bash'isms.
> hadoop-config.sh spews error message when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present
> -------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-8010
> URL: https://issues.apache.org/jira/browse/HADOOP-8010
> Project: Hadoop Common
> Issue Type: Bug
> Components: scripts
> Affects Versions: 1.0.0
> Reporter: Roman Shaposhnik
> Assignee: Roman Shaposhnik
> Priority: Minor
> Fix For: 1.0.1
>
> Attachments: HADOOP-8010.patch.txt
>
>
> Running hadoop daemon commands when HADOOP_HOME_WARN_SUPPRESS is set to true and HADOOP_HOME is present produces:
> {noformat}
> [: 76: true: unexpected operator
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira