You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Robert Joseph Evans (Created) (JIRA)" <ji...@apache.org> on 2011/12/08 23:13:40 UTC
[jira] [Created] (MAPREDUCE-3521) Hadoop Streaming ignores unknown
commands
Hadoop Streaming ignores unknown commands
-----------------------------------------
Key: MAPREDUCE-3521
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Priority: Minor
The hadoop streaming command will ignore any command line arguments to it.
{code}
hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
{code}
Works just fine. This can mask issues where quotes were mistakenly missed like
{code}
hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
{code}
Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177068#comment-13177068 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1478 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1478/])
MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225471
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3521) Hadoop Streaming ignores unknown
parameters
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3521:
-------------------------------------------
Attachment: MR-3521.txt
Simply adds in the check, and fails if it finds too many arguments.
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177089#comment-13177089 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #337 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/337/])
Merge -c 1225471 from trunk to branch-0.23 to fix MAPREDUCE-3521.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225472
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168749#comment-13168749 ]
Hadoop QA commented on MAPREDUCE-3521:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12507247/MR-3521.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1435//console
This message is automatically generated.
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177067#comment-13177067 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1550 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1550/])
MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225471
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177149#comment-13177149 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #122 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/122/])
Merge -c 1225471 from trunk to branch-0.23 to fix MAPREDUCE-3521.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225472
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169488#comment-13169488 ]
Robert Joseph Evans commented on MAPREDUCE-3521:
------------------------------------------------
The failures are expected because I changed tools, which test-patch is not set up to deal with yet HADOOP-7725.
I ran the streaming tests manually and they all pass.
{noformat}
main:
[INFO] Executed tasks
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop MapReduce Streaming ................. SUCCESS [4:12.117s]
[INFO] Apache Hadoop Archives ............................ SUCCESS [35.337s]
[INFO] Apache Hadoop Tools ............................... SUCCESS [0.072s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 4:47.842s
[INFO] Finished at: Wed Dec 14 10:17:23 CST 2011
[INFO] Final Memory: 10M/159M
[INFO] ------------------------------------------------------------------------
{noformat}
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177168#comment-13177168 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #143 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/143/])
Merge -c 1225471 from trunk to branch-0.23 to fix MAPREDUCE-3521.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225472
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177092#comment-13177092 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1499 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1499/])
MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225471
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177176#comment-13177176 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #942 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/942/])
MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225471
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177069#comment-13177069 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #315 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/315/])
Merge -c 1225471 from trunk to branch-0.23 to fix MAPREDUCE-3521.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225472
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3521) Hadoop Streaming ignores unknown
parameters
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3521:
-------------------------------------------
Summary: Hadoop Streaming ignores unknown parameters (was: Hadoop Streaming ignores unknown commands)
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177143#comment-13177143 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #909 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/909/])
MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225471
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3521) Hadoop Streaming ignores unknown
parameters
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3521:
-------------------------------------------
Status: Patch Available (was: Open)
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3521) Hadoop Streaming ignores
unknown parameters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177070#comment-13177070 ]
Hudson commented on MAPREDUCE-3521:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #326 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/326/])
Merge -c 1225471 from trunk to branch-0.23 to fix MAPREDUCE-3521.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1225472
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/main/java/org/apache/hadoop/streaming/StreamJob.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestStreamJob.java
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3521) Hadoop Streaming ignores unknown
parameters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3521:
-------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.1
Target Version/s: 0.23.1 (was: 0.24.0)
Status: Resolved (was: Patch Available)
I just committed this. Thanks Bobby!
> Hadoop Streaming ignores unknown parameters
> -------------------------------------------
>
> Key: MAPREDUCE-3521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3521
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Minor
> Fix For: 0.23.1
>
> Attachments: MR-3521.txt
>
>
> The hadoop streaming command will ignore any command line arguments to it.
> {code}
> hadoop jar streaming.jar -input input -output output -mapper cat -reducer cat ThisIsABadArgument
> {code}
> Works just fine. This can mask issues where quotes were mistakenly missed like
> {code}
> hadoop jar streaming.jar -input input -output output -mapper xargs cat -reducer cat -archive someArchive.tgz
> {code}
> Streaming should fail if it encounters an unexpected command line parameter
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira